Jul 24 15:43:17.969655 ip-10-0-134-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 15:43:17.969867 ip-10-0-134-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 15:43:17.969883 ip-10-0-134-8 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 15:43:17.970206 ip-10-0-134-8 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 15:43:27.982353 ip-10-0-134-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 15:43:27.982371 ip-10-0-134-8 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a1c5fb464b664b679094ae84cf810c55 --
Jul 24 15:45:25.731875 ip-10-0-134-8 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 15:45:26.116450 ip-10-0-134-8 kubenswrapper[2600]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 15:45:26.116450 ip-10-0-134-8 kubenswrapper[2600]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 15:45:26.116450 ip-10-0-134-8 kubenswrapper[2600]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 15:45:26.116450 ip-10-0-134-8 kubenswrapper[2600]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 15:45:26.116450 ip-10-0-134-8 kubenswrapper[2600]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 15:45:26.117260 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.117181    2600 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 15:45:26.122277 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122254    2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:45:26.122277 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122273    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:45:26.122277 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122277    2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:45:26.122277 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122280    2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:45:26.122277 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122283    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122287    2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122289    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122292    2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122295    2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122297    2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122300    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122303    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122305    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122308    2600 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122310    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122314    2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122317    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122319    2600 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122322    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122325    2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122327    2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122330    2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122332    2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122335    2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:45:26.122468 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122337    2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122340    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122343    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122345    2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122348    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122350    2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122353    2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122355    2600 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122358    2600 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122360    2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122363    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122366    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122369    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122371    2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122375    2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122377    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122380    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122382    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122385    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:45:26.122972 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122387    2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122392    2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122396    2600 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122399    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122402    2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122405    2600 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122407    2600 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122410    2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122413    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122416    2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122418    2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122422    2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122426    2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122429    2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122433    2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122435    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122438    2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122441    2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122444    2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:45:26.123415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122446    2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122449    2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122451    2600 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122454    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122457    2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122459    2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122462    2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122465    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122494    2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122499    2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122503    2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122506    2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122509    2600 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122511    2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122514    2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122517    2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122520    2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122523    2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122525    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:45:26.123874 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122528    2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122531    2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122534    2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122537    2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122539    2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122542    2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122545    2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122548    2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122550    2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122553    2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122555    2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122558    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122561    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122563    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122566    2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122569    2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122571    2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.122574    2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123254    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123259    2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:45:26.124319 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123262    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123265    2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123268    2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123270    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123272    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123275    2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123278    2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123280    2600 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123283    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123285    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123287    2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123290    2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123293    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123295    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123298    2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123301    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123304    2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123306    2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123309    2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123311    2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:45:26.124795 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123314    2600 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123316    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123319    2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123322    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123324    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123328    2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123330    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123333    2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123335    2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123338    2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123340    2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123342    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123345    2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123347    2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123352    2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123355    2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123358    2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123361    2600 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123364    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123367    2600 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:45:26.125270 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123369    2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123372    2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123374    2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123377    2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123379    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123381    2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123384    2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123386    2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123389    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123392    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123394    2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123396    2600 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123399    2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123401    2600 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123404    2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123406    2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123409    2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123412    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123414    2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123417    2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:45:26.125757 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123419    2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123422    2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123424    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123427    2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123429    2600 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123432    2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123434    2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123437    2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123439    2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123441    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123444    2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123446    2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123449    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123451    2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123453    2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123459    2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123462    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123464    2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123467    2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:45:26.126255 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123470    2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123473    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123475    2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123478    2600 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123481    2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123483    2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123486    2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123488    2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123491    2600 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123494    2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123498    2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123501    2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123503    2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123506    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123508    2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123510    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123513    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123515    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123868    2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123873    2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:45:26.126735 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123875    2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123879    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123882    2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123884    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123887    2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123889    2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123892    2600 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123894    2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123896    2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123899    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123901    2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123903    2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123906    2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123908    2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123911    2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123913    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123915    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123918    2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123923    2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:45:26.127223 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123927    2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123930    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123933    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123936    2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123938    2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123941    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123943    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123946    2600 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123948    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123952    2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123955    2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123958    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123960    2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123963    2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123965    2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123967    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123970    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123972    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123974    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:45:26.127708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123977    2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123979    2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123981    2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123983    2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123986    2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123988    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123990    2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123993    2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123995    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.123999    2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124001    2600 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124003    2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124006    2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124008    2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124011    2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124013    2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124016    2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124018    2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124020    2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124023    2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:45:26.128153 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124025    2600 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124027    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124030    2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124032    2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124034    2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124037    2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124039    2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124042    2600 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124044    2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124046    2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124049    2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124051    2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124054    2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124056    2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124058    2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124060    2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124063    2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124065    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124067    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124069    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:45:26.128644 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124072    2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124074    2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124077    2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124080    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124083    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124085    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124088    2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124091    2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124094    2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124097    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124100    2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124103    2600 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124105    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124108    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124111    2600 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124113    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124115    2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124118    2600 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124120    2600 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124185    2600 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 15:45:26.129139 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124192    2600 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124198    2600 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124203    2600 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124208    2600 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124213    2600 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124219    2600 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124224    2600 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124229    2600 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124233    2600 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124236    2600 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124239    2600 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124242    2600 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124245    2600 flags.go:64] FLAG: --cgroup-root=""
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124248    2600 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124250    2600 flags.go:64] FLAG: --client-ca-file=""
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124254    2600 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124259    2600 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124262    2600 flags.go:64] FLAG: --cluster-domain=""
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124266    2600 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124269    2600 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124272    2600 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124275    2600 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124279    2600 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 15:45:26.129616 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124282    2600 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124285    2600 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124288    2600 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124290    2600 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124293    2600 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124296    2600 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124299    2600 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124301    2600 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124305    2600 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124308    2600 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124310    2600 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124313    2600 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124316    2600 flags.go:64] FLAG: --enable-server="true"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124318    2600 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124323    2600 flags.go:64] FLAG: --event-burst="100"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124325    2600 flags.go:64] FLAG: --event-qps="50"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124328    2600 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124331    2600 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124334    2600 flags.go:64] FLAG: --eviction-hard=""
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124337    2600 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124340    2600 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124342    2600 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124345    2600 flags.go:64] FLAG: --eviction-soft=""
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124348    2600 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124350    2600 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 15:45:26.130197 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124355    2600 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124358    2600 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124362    2600 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124365    2600 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124367    2600 flags.go:64] FLAG: --feature-gates=""
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124371    2600 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124374    2600 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124376    2600 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124380    2600 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124382    2600 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124385    2600 flags.go:64] FLAG: --help="false"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124388    2600 flags.go:64] FLAG: --hostname-override="ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124391    2600 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124393    2600 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124396    2600 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124399    2600 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124402    2600 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124405    2600 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124408    2600 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124410    2600 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124413    2600 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124415    2600 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124419    2600 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124421    2600 flags.go:64] FLAG: --kube-reserved=""
Jul 24 15:45:26.130872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124424    2600 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124426    2600 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124429    2600 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124431    2600 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124434    2600 flags.go:64] FLAG: --lock-file=""
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124436    2600 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124439    2600 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124442    2600 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124448    2600 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124451    2600 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124455    2600 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124457    2600 flags.go:64] FLAG: --logging-format="text"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124460    2600 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124463    2600 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124466    2600 flags.go:64] FLAG: --manifest-url=""
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124468    2600 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124472    2600 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124475    2600 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124479    2600 flags.go:64] FLAG: --max-pods="110"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124481    2600 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124484    2600 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124487    2600 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124489    2600 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124492    2600 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124495    2600 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 15:45:26.131446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124498    2600 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124504    2600 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124507    2600 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124510    2600 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124512    2600 flags.go:64] FLAG: --pod-cidr=""
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124515    2600 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124520    2600 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124523    2600 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124525    2600 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124528    2600 flags.go:64] FLAG: --port="10250"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124531    2600 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124533    2600 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-074f93bc36ca0ccdc"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124536    2600 flags.go:64] FLAG: --qos-reserved=""
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124539    2600 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124542    2600 flags.go:64] FLAG: --register-node="true"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124544    2600 flags.go:64] FLAG: --register-with-taints=""
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124549    2600 flags.go:64] FLAG: --registry-burst="10"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124554    2600 flags.go:64] FLAG: --registry-qps="5"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124556    2600 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124559    2600 flags.go:64] FLAG: --reserved-memory=""
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124563    2600 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124565    2600 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124568    2600 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124571    2600 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124573    2600 flags.go:64] FLAG: --runonce="false"
Jul 24 15:45:26.132049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124576    2600 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124579    2600 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124582    2600 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124584    2600 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124587    2600 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124590    2600 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124592    2600 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124595    2600 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124598    2600 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124601    2600 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124616    2600 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124619    2600 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124622    2600 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124625    2600 flags.go:64] FLAG: --system-cgroups=""
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124627    2600 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124632    2600 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124635    2600 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124638    2600 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124641    2600 flags.go:64] FLAG: --tls-min-version=""
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124644    2600 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124646    2600 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124649    2600 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124652    2600 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124656    2600 flags.go:64] FLAG: --v="2"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124660    2600 flags.go:64] FLAG: --version="false"
Jul 24 15:45:26.132646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124665    2600 flags.go:64] FLAG: --vmodule=""
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124668    2600 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.124671    2600 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124782    2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124785    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124788    2600 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124791    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124794    2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124797    2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124800    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124803    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124805    2600 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124808    2600 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124810    2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124813    2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124815    2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124818    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124820    2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124823    2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124826    2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:45:26.133232 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124828    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124831    2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124833    2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124836    2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124838    2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124841    2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124843    2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124846    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124848    2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124850    2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124854    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124858    2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124861    2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124864    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124866    2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124868    2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124871    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124874    2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124876    2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124878    2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:45:26.133766 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124881    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124883    2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124886    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124888    2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124891    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124893    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124895    2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124898    2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124900    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124902    2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124905    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124907    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124910    2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124912    2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124915    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124917    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124920    2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124922    2600 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124925    2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:45:26.134287 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124927    2600 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124929    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124932    2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124936    2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124939    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124942    2600 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124946    2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124949    2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124952    2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124954    2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124957    2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124959    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124962    2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124964    2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124966    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124970    2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124973    2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124976    2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124979    2600 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:45:26.134764 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124982    2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124984    2600 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124987    2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124990    2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124993    2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124996    2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.124999    2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125002    2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125005    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125008    2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125011    2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125013    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125016    2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125018    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125021    2600 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125023    2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125028    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125032    2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125035    2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125037    2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:45:26.135236 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125040    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125043    2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125045    2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.125048    2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.125914    2600 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.132270    2600 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.132284    2600 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.132296    2600 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.132302    2600 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132354    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132358    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132362    2600 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132364    2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132367    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132370    2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:45:26.135708 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132373    2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132376    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132379    2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132381    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132384    2600 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132386    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132389    2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132391    2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132394    2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132397    2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132401    2600 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132404    2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132407    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132410    2600 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132413    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132415    2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132418    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132420    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132423    2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132426    2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:45:26.136085 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132428    2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132430    2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132433    2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132436    2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132439    2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132441    2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132444    2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132446    2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132449    2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132451    2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132454    2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132456    2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132459    2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132461    2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132464    2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132466    2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132469    2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132472    2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132476    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:45:26.136537 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132479    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132481    2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132484    2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132487    2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132489    2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132491    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132494    2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132496    2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132498    2600 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132501    2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132503    2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132506    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132509    2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132512    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132514    2600 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132517    2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132519    2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132522    2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132526    2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132529    2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:45:26.137044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132532    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132534    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132537    2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132539    2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132542    2600 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132544    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132547    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132549    2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132552    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132554    2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132556    2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132558    2600 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132561    2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132563    2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132566    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132568    2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132570    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132573    2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132575    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132577    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:45:26.137516 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132579    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132582    2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132584    2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132587    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132589    2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132592    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132594    2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132597    2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132600    2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132617    2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132621    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132626    2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132629    2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132631    2600 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.132637    2600 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 15:45:26.138044 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132752    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132757    2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132760    2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132763    2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132765    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132768    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132770    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132773    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132776    2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132778    2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132780    2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132783    2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132785    2600 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132788    2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132790    2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132793    2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132795    2600 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132797    2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132800    2600 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132802    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:45:26.138417 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132805    2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132807    2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132809    2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132812    2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132815    2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132817    2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132820    2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132822    2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132824    2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132827    2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132829    2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132831    2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132834    2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132836    2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132838    2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132840    2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132843    2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132845    2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132847    2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132849    2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:45:26.139014 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132852    2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132854    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132856    2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132858    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132861    2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132863    2600 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132865    2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132867    2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132870    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132872    2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132874    2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132877    2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132879    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132881    2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132884    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132886    2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132892    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132894    2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132898    2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132901    2600 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:45:26.139477 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132904    2600 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132907    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132910    2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132912    2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132915    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132917    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132920    2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132924    2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132927    2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132930    2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132932    2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132935    2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132938    2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132940    2600 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132943    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132945    2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132948    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132950    2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132952    2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:45:26.139970 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132954    2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132957    2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132960    2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132964    2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132967    2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132969    2600 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132972    2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132974    2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132977    2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132979    2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132982    2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132984    2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132987    2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132989    2600 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132991    2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132993    2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132996    2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.132998    2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.133001    2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:45:26.140415 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:26.133003    2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:45:26.140891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.133007    2600 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 15:45:26.140891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.133089    2600 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 15:45:26.140891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.135060    2600 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 15:45:26.140891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.136596    2600 server.go:1019] "Starting client certificate rotation"
Jul 24 15:45:26.140891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.136711    2600 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 15:45:26.140891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.137738    2600 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 15:45:26.140891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.138967    2600 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 15:45:26.145657 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.145635    2600 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 15:45:26.156374 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.156361    2600 log.go:25] "Validated CRI v1 runtime API"
Jul 24 15:45:26.158363 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.158347    2600 log.go:25] "Validated CRI v1 image API"
Jul 24 15:45:26.159185 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.159168    2600 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 15:45:26.163369 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.163350    2600 fs.go:135] Filesystem UUIDs: map[45d6ae61-349e-4dc7-9eff-8b6d6a9c4d2c:/dev/nvme0n1p4 6ee69b3c-3f6b-4188-9cad-70131c9ac544:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 24 15:45:26.163429 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.163368    2600 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 15:45:26.164226 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.164208    2600 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 15:45:26.168909 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.168816    2600 manager.go:216] Machine: {Timestamp:2026-07-24 15:45:26.167652614 +0000 UTC m=+0.325519304 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3125446 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dd8bcdfcc6634ee5570f65cd17014 SystemUUID:ec2dd8bc-dfcc-6634-ee55-70f65cd17014 BootID:a1c5fb46-4b66-4b67-9094-ae84cf810c55 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:40:5c:dd:91:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:40:5c:dd:91:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:5e:fb:b7:b5:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 15:45:26.168909 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.168905    2600 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 15:45:26.169016 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.168974    2600 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 15:45:26.172380 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.172354    2600 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 15:45:26.172503 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.172383    2600 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 15:45:26.172988 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.172978    2600 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 15:45:26.173021 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.172991    2600 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 15:45:26.173021 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.172999    2600 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 15:45:26.173692 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.173682    2600 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 15:45:26.174900 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.174889    2600 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 15:45:26.177714 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.177703    2600 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 15:45:26.177856 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.177846    2600 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 15:45:26.177892 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.177876    2600 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 15:45:26.177923 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.177893    2600 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 15:45:26.177923 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.177910    2600 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 15:45:26.177975 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.177923    2600 kubelet.go:398] "Adding apiserver pod source"
Jul 24 15:45:26.177975 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.177934    2600 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 15:45:26.178845 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.178830    2600 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 15:45:26.178910 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.178858    2600 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 15:45:26.181670 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.181650    2600 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 15:45:26.183704 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.183688    2600 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 15:45:26.183767 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.183719    2600 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 15:45:26.184352 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184342    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 15:45:26.184389 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184358    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 15:45:26.184389 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184364    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 15:45:26.184389 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184370    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 15:45:26.184389 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184377    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 15:45:26.184389 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184383    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 15:45:26.184508 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184395    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 15:45:26.184508 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184401    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 15:45:26.184508 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184408    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 15:45:26.184508 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184413    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 15:45:26.184508 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184421    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 15:45:26.184508 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.184429    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 15:45:26.185172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.185162    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 15:45:26.185172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.185173    2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 15:45:26.186906 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.186883    2600 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 15:45:26.187468 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.187444    2600 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 15:45:26.187511 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.187467    2600 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 15:45:26.188576 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.188561    2600 server.go:1268] "Started kubelet"
Jul 24 15:45:26.188697 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.188677    2600 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 15:45:26.188841 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.188651    2600 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 15:45:26.188909 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.188893    2600 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 15:45:26.189239 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.189219    2600 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kd8bz"
Jul 24 15:45:26.189438 ip-10-0-134-8 systemd[1]: Started Kubernetes Kubelet.
Jul 24 15:45:26.191023 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.191006    2600 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 15:45:26.191155 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.191140    2600 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 15:45:26.193887 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.193872    2600 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 15:45:26.196743 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.196730    2600 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 15:45:26.196816 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.196794    2600 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 15:45:26.197354 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.197094    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.197518 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.197501    2600 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kd8bz"
Jul 24 15:45:26.197623 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.197505    2600 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 15:45:26.197623 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.197506    2600 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 15:45:26.197623 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.197542    2600 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 15:45:26.197772 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.197650    2600 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 15:45:26.197772 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.197659    2600 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 15:45:26.197884 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.197795    2600 factory.go:55] Registering systemd factory
Jul 24 15:45:26.197884 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.197808    2600 factory.go:223] Registration of the systemd container factory successfully
Jul 24 15:45:26.199580 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.198164    2600 factory.go:153] Registering CRI-O factory
Jul 24 15:45:26.199580 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.198183    2600 factory.go:223] Registration of the crio container factory successfully
Jul 24 15:45:26.199580 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.198244    2600 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 15:45:26.199580 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.198267    2600 factory.go:103] Registering Raw factory
Jul 24 15:45:26.199580 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.198282    2600 manager.go:1196] Started watching for new ooms in manager
Jul 24 15:45:26.199580 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.199144    2600 manager.go:349] Starting recovery of all containers
Jul 24 15:45:26.203424 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.203393    2600 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 15:45:26.204183 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.204113    2600 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 15:45:26.204470 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.203508    2600 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-8.ec2.internal.18c5444d513f1ccd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-8.ec2.internal,UID:ip-10-0-134-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-8.ec2.internal,},FirstTimestamp:2026-07-24 15:45:26.188530893 +0000 UTC m=+0.346397582,LastTimestamp:2026-07-24 15:45:26.188530893 +0000 UTC m=+0.346397582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-8.ec2.internal,}"
Jul 24 15:45:26.211921 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.211771    2600 manager.go:354] Recovery completed
Jul 24 15:45:26.213917 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.213887    2600 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 24 15:45:26.216781 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.216770    2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:45:26.218471 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.218456    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:45:26.218520 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.218485    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:45:26.218520 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.218495    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:45:26.218968 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.218943    2600 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 15:45:26.218968 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.218967    2600 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 15:45:26.219042 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.218980    2600 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 15:45:26.219042 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.219002    2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:45:26.219681 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.219663    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:45:26.219750 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.219692    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:45:26.219750 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.219701    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:45:26.220195 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.220184    2600 policy_none.go:49] "None policy: Start"
Jul 24 15:45:26.220239 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.220200    2600 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 15:45:26.220239 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.220209    2600 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 15:45:26.221167 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.221157    2600 policy_none.go:47] "Start"
Jul 24 15:45:26.262188 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.262165    2600 manager.go:337] "Starting Device Plugin manager"
Jul 24 15:45:26.262266 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.262199    2600 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 15:45:26.262266 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.262211    2600 server.go:87] "Starting device plugin registration server"
Jul 24 15:45:26.262440 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.262428    2600 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 15:45:26.262500 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.262442    2600 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 15:45:26.262556 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.262533    2600 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 15:45:26.262690 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.262641    2600 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 15:45:26.262690 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.262658    2600 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 15:45:26.263156 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.263138    2600 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 15:45:26.263226 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.263182    2600 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.362800 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.362780    2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:45:26.364745 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.364527    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:45:26.364745 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.364553    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:45:26.364745 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.364564    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:45:26.364745 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.364599    2600 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.372364 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.372325    2600 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.372364 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.372343    2600 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-8.ec2.internal\": node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.381757 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.381741    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.395691 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.395666    2600 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 15:45:26.396886 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.396872    2600 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 15:45:26.396937 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.396908    2600 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 15:45:26.396970 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.396950    2600 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 15:45:26.397014 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.396978    2600 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 15:45:26.399081 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.399066    2600 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:45:26.482000 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.481969    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.497137 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.497115    2600 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"]
Jul 24 15:45:26.497210 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.497181    2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:45:26.498058 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.498031    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:45:26.498058 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.498057    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:45:26.498177 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.498070    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:45:26.499300 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.499285    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9adaaed0eb9e1e379ca9054dcfb08b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"c9adaaed0eb9e1e379ca9054dcfb08b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.499342 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.499308    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9adaaed0eb9e1e379ca9054dcfb08b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"c9adaaed0eb9e1e379ca9054dcfb08b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.500259 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.500245    2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:45:26.500363 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.500349    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.500400 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.500375    2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:45:26.500998 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.500986    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:45:26.500998 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.500994    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:45:26.501102 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.501007    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:45:26.501102 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.501011    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:45:26.501102 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.501017    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:45:26.501102 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.501020    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:45:26.503262 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.503246    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.503315 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.503277    2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:45:26.503971 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.503953    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:45:26.504060 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.503980    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:45:26.504060 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.503993    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:45:26.527141 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.527121    2600 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-8.ec2.internal\" not found" node="ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.531550 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.531534    2600 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-8.ec2.internal\" not found" node="ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.582904 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.582866    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.600212 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.600192    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9adaaed0eb9e1e379ca9054dcfb08b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"c9adaaed0eb9e1e379ca9054dcfb08b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.600282 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.600215    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9adaaed0eb9e1e379ca9054dcfb08b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"c9adaaed0eb9e1e379ca9054dcfb08b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.600282 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.600235    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b4c93f4e70558b77ddac96ac849afbc-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"5b4c93f4e70558b77ddac96ac849afbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.600282 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.600272    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9adaaed0eb9e1e379ca9054dcfb08b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"c9adaaed0eb9e1e379ca9054dcfb08b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.600398 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.600306    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9adaaed0eb9e1e379ca9054dcfb08b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"c9adaaed0eb9e1e379ca9054dcfb08b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.683635 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.683599    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.700904 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.700887    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b4c93f4e70558b77ddac96ac849afbc-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"5b4c93f4e70558b77ddac96ac849afbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.700962 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.700917    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b4c93f4e70558b77ddac96ac849afbc-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"5b4c93f4e70558b77ddac96ac849afbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.784089 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.784054    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.829582 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.829562    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.835436 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:26.835062    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:26.885059 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.885033    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:26.985668 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:26.985586    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:27.014847 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.014826    2600 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:45:27.086743 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:27.086715    2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Jul 24 15:45:27.136255 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.136233    2600 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 15:45:27.136733 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.136359    2600 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 15:45:27.136733 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.136373    2600 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 15:45:27.185446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.185429    2600 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:45:27.197535 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.197515    2600 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:27.197646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.197534    2600 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 15:45:27.203483 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.203460    2600 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 15:40:26 +0000 UTC" deadline="2028-03-24 02:19:51.117988189 +0000 UTC"
Jul 24 15:45:27.203556 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.203481    2600 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14602h34m23.914509849s"
Jul 24 15:45:27.206618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.206587    2600 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 15:45:27.208041 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.208025    2600 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 15:45:27.209872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.209854    2600 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Jul 24 15:45:27.218084 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.218069    2600 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 15:45:27.226086 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.226060    2600 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tcr8s"
Jul 24 15:45:27.233268 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.233252    2600 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tcr8s"
Jul 24 15:45:27.361147 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:27.361113    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4c93f4e70558b77ddac96ac849afbc.slice/crio-1805858bcb68f65cd45953626bb8f121f56f7e932612372a9c1154e4f66cad3a WatchSource:0}: Error finding container 1805858bcb68f65cd45953626bb8f121f56f7e932612372a9c1154e4f66cad3a: Status 404 returned error can't find the container with id 1805858bcb68f65cd45953626bb8f121f56f7e932612372a9c1154e4f66cad3a
Jul 24 15:45:27.361317 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:27.361299    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9adaaed0eb9e1e379ca9054dcfb08b6.slice/crio-0fbf48cd412b08a19fdc894388a2db587aa959a4cccf4e8e2fc3694c6eb42d95 WatchSource:0}: Error finding container 0fbf48cd412b08a19fdc894388a2db587aa959a4cccf4e8e2fc3694c6eb42d95: Status 404 returned error can't find the container with id 0fbf48cd412b08a19fdc894388a2db587aa959a4cccf4e8e2fc3694c6eb42d95
Jul 24 15:45:27.364778 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.364695    2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:45:27.400041 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.400000    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"c9adaaed0eb9e1e379ca9054dcfb08b6","Type":"ContainerStarted","Data":"0fbf48cd412b08a19fdc894388a2db587aa959a4cccf4e8e2fc3694c6eb42d95"}
Jul 24 15:45:27.400997 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.400980    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal" event={"ID":"5b4c93f4e70558b77ddac96ac849afbc","Type":"ContainerStarted","Data":"1805858bcb68f65cd45953626bb8f121f56f7e932612372a9c1154e4f66cad3a"}
Jul 24 15:45:27.693094 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:27.692238    2600 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:45:28.178859 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.178826    2600 apiserver.go:52] "Watching apiserver"
Jul 24 15:45:28.191155 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.190994    2600 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 15:45:28.193448 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.191484    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-f4lh6","kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx","openshift-cluster-node-tuning-operator/tuned-rkhfr","openshift-image-registry/node-ca-ftg7x","openshift-multus/network-metrics-daemon-6tfmz","openshift-network-diagnostics/network-check-target-qqqpc","openshift-ovn-kubernetes/ovnkube-node-hgljr","kube-system/global-pull-secret-syncer-9x7gq","openshift-dns/node-resolver-ssqh6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal","openshift-multus/multus-2tmk5","openshift-multus/multus-additional-cni-plugins-nm5zn","openshift-network-operator/iptables-alerter-plrt6"]
Jul 24 15:45:28.194282 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.194260    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:28.194369 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.194345    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:28.196915 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.196891    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.199287 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.199260    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.200023 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.200003    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 15:45:28.200598 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.200142    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 15:45:28.200598 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.200239    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c2bc7\""
Jul 24 15:45:28.200598 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.200335    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 15:45:28.200598 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.200511    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 15:45:28.200900 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.200793    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 15:45:28.201774 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.201635    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 15:45:28.203020 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.201910    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-57hwg\""
Jul 24 15:45:28.203020 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.202070    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 15:45:28.203020 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.202121    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.203020 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.202917    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 15:45:28.204322 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.204301    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m5xgj\""
Jul 24 15:45:28.204489 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.204305    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 15:45:28.204489 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.204437    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 15:45:28.204646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.204628    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.207982    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208183    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208408    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-22gft\""
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208621    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208827    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-cnibin\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208860    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-os-release\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208889    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-cni-binary-copy\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208914    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/096e926e-7d4d-42fc-acc2-46dd965ee2df-host-slash\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208942    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208968    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-system-cni-dir\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.208992    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.209016    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.209036    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/096e926e-7d4d-42fc-acc2-46dd965ee2df-iptables-alerter-script\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.209053    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.209080    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p79c4\" (UniqueName: \"kubernetes.io/projected/65ad8993-ef49-45ea-88e0-4d95c4903f16-kube-api-access-p79c4\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.209100    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59d2j\" (UniqueName: \"kubernetes.io/projected/096e926e-7d4d-42fc-acc2-46dd965ee2df-kube-api-access-59d2j\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.209342    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.209421    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:28.217063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.216304    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.218817 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.218284    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:28.219620 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.218949    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pc56q\""
Jul 24 15:45:28.219620 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.219170    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 15:45:28.219620 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.219185    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 15:45:28.219620 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.219330    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 15:45:28.219620 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.219441    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 15:45:28.220656 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.220633    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 15:45:28.223058 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.221800    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.223058 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.222824    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 15:45:28.223212 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.223086    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 15:45:28.223212 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.223135    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mmcmz\""
Jul 24 15:45:28.223800 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.223780    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 15:45:28.224717 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.224698    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-64b9x\""
Jul 24 15:45:28.224808 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.224702    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 15:45:28.227102 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.226519    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.234268 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.234243    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.234382 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.234310    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:28.234382 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.234322    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 15:45:28.234502 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.234245    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bmltr\""
Jul 24 15:45:28.235108 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.235073    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 15:45:28.236590 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.236525    2600 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 15:40:27 +0000 UTC" deadline="2028-02-21 16:00:45.678112991 +0000 UTC"
Jul 24 15:45:28.236590 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.236568    2600 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13848h15m17.441548901s"
Jul 24 15:45:28.237246 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.237226    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.239602 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.239582    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 15:45:28.239932 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.239913    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 15:45:28.240122 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.240105    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 15:45:28.240377 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.240360    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zrnw6\""
Jul 24 15:45:28.298841 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.298816    2600 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 15:45:28.309812 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.309784    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-modprobe-d\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.309919 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.309827    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-lib-modules\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.309919 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.309855    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-run-netns\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.309919 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.309880    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-etc-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.309919 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.309904    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.309929    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-cni-bin\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.309961    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.309988    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-socket-dir-parent\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310015    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-env-overrides\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310040    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310057    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-dbus\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310072    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-slash\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310108    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.310136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310125    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-os-release\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310142    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwrr\" (UniqueName: \"kubernetes.io/projected/2f6fd689-f03c-4443-a4a7-96497451e596-kube-api-access-tlwrr\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310162    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-cnibin\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310182    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/096e926e-7d4d-42fc-acc2-46dd965ee2df-host-slash\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310207    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-cnibin\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310226    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-conf-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310240    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysctl-conf\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310256    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59b61266-88d9-40f8-b466-79fa17e899b2-etc-tuned\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310271    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qfq\" (UniqueName: \"kubernetes.io/projected/a980785d-cf7b-4399-b226-8e15d53bb10d-kube-api-access-99qfq\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310286    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-k8s-cni-cncf-io\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310301    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-cni-multus\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310317    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-tmp-dir\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310332    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-kubelet-config\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310349    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysconfig\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310384    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmsnr\" (UniqueName: \"kubernetes.io/projected/59b61266-88d9-40f8-b466-79fa17e899b2-kube-api-access-fmsnr\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310406    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-var-lib-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.310567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310420    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a980785d-cf7b-4399-b226-8e15d53bb10d-ovn-node-metrics-cert\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310438    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-kubelet\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310453    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-var-lib-kubelet\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310469    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-cni-netd\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310490    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-ovnkube-script-lib\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310527    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-netns\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310544    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-cni-bin\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310559    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fce065fc-79ff-415b-8a02-6f87c9099f68-cni-binary-copy\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310573    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-etc-kubernetes\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310603    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1-agent-certs\") pod \"konnectivity-agent-f4lh6\" (UID: \"0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1\") " pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310626    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-sys\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310659    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4plnn\" (UniqueName: \"kubernetes.io/projected/1b94016e-0ac6-4037-9c48-59aab4e71e3c-kube-api-access-4plnn\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310683    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-node-log\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310716    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-hostroot\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310741    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-multus-certs\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310765    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-device-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310809    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-ovnkube-config\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.311404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310844    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-system-cni-dir\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310861    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/458477e6-def3-441c-9cdd-59e70e711840-host\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310885    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/458477e6-def3-441c-9cdd-59e70e711840-serviceca\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310901    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-kubernetes\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310922    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysctl-d\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310945    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310971    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-kubelet\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.310999    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/096e926e-7d4d-42fc-acc2-46dd965ee2df-iptables-alerter-script\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311027    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-daemon-config\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311054    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311080    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-run\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311107    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-systemd\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311137    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p79c4\" (UniqueName: \"kubernetes.io/projected/65ad8993-ef49-45ea-88e0-4d95c4903f16-kube-api-access-p79c4\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311163    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311192    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311220    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-etc-selinux\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.312618 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311248    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1-konnectivity-ca\") pod \"konnectivity-agent-f4lh6\" (UID: \"0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1\") " pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311274    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-hosts-file\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311301    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgksh\" (UniqueName: \"kubernetes.io/projected/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-kube-api-access-dgksh\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311327    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-systemd\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311352    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b61266-88d9-40f8-b466-79fa17e899b2-tmp\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311377    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-log-socket\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311412    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311441    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311467    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-registration-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311493    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-sys-fs\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311520    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5hsx\" (UniqueName: \"kubernetes.io/projected/458477e6-def3-441c-9cdd-59e70e711840-kube-api-access-h5hsx\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311550    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59d2j\" (UniqueName: \"kubernetes.io/projected/096e926e-7d4d-42fc-acc2-46dd965ee2df-kube-api-access-59d2j\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311579    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-system-cni-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311605    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-cni-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311632    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bxm4\" (UniqueName: \"kubernetes.io/projected/fce065fc-79ff-415b-8a02-6f87c9099f68-kube-api-access-8bxm4\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311659    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-socket-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.313408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311703    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-host\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311731    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-systemd-units\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311759    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-ovn\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311789    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-os-release\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.311818    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-cni-binary-copy\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.312469    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-cni-binary-copy\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.312726    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.313185    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.313618    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65ad8993-ef49-45ea-88e0-4d95c4903f16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.313723    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-cnibin\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.313771    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/096e926e-7d4d-42fc-acc2-46dd965ee2df-host-slash\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.314357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.314068    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-system-cni-dir\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.314957 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.314599    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/096e926e-7d4d-42fc-acc2-46dd965ee2df-iptables-alerter-script\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.315521 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.315500    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ad8993-ef49-45ea-88e0-4d95c4903f16-os-release\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.325109 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.325087    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:45:28.325109 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.325113    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:45:28.325272 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.325123    2600 projected.go:196] Error preparing data for projected volume kube-api-access-dz769 for pod openshift-network-diagnostics/network-check-target-qqqpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:28.325272 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.325170    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769 podName:13489cf3-a86e-4225-9873-3f81d8c4da91 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:28.825154616 +0000 UTC m=+2.983021294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dz769" (UniqueName: "kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769") pod "network-check-target-qqqpc" (UID: "13489cf3-a86e-4225-9873-3f81d8c4da91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:28.325655 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.325633    2600 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 15:45:28.329916 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.329894    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p79c4\" (UniqueName: \"kubernetes.io/projected/65ad8993-ef49-45ea-88e0-4d95c4903f16-kube-api-access-p79c4\") pod \"multus-additional-cni-plugins-nm5zn\" (UID: \"65ad8993-ef49-45ea-88e0-4d95c4903f16\") " pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.329995 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.329899    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59d2j\" (UniqueName: \"kubernetes.io/projected/096e926e-7d4d-42fc-acc2-46dd965ee2df-kube-api-access-59d2j\") pod \"iptables-alerter-plrt6\" (UID: \"096e926e-7d4d-42fc-acc2-46dd965ee2df\") " pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.393036 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.393009    2600 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:45:28.412049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412021    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-etc-selinux\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412193 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412076    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1-konnectivity-ca\") pod \"konnectivity-agent-f4lh6\" (UID: \"0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1\") " pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:28.412193 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412096    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-hosts-file\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.412193 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412119    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgksh\" (UniqueName: \"kubernetes.io/projected/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-kube-api-access-dgksh\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.412193 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412143    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-systemd\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.412193 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412164    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b61266-88d9-40f8-b466-79fa17e899b2-tmp\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.412193 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412186    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-log-socket\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412214    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-etc-selinux\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412225    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-hosts-file\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412221    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412277    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412277    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-registration-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412318    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-sys-fs\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412323    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-registration-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412344    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5hsx\" (UniqueName: \"kubernetes.io/projected/458477e6-def3-441c-9cdd-59e70e711840-kube-api-access-h5hsx\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412370    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-system-cni-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412378    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-systemd\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412394    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-cni-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412423    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bxm4\" (UniqueName: \"kubernetes.io/projected/fce065fc-79ff-415b-8a02-6f87c9099f68-kube-api-access-8bxm4\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412438    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-sys-fs\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412441    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-log-socket\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412451    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-socket-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412479    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-host\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.412506 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412483    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-system-cni-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412503    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-systemd-units\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412558    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-systemd-units\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412593    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-cni-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412647    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-host\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412696    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-ovn\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412715    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-socket-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412726    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-modprobe-d\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412741    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1-konnectivity-ca\") pod \"konnectivity-agent-f4lh6\" (UID: \"0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1\") " pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412773    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-ovn\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412792    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-lib-modules\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412826    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-run-netns\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412833    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-modprobe-d\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412851    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-etc-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412892    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-run-netns\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412900    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412938    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-etc-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412937    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-lib-modules\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.413243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412947    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412965    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-cni-bin\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.412989    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-socket-dir-parent\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413004    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-env-overrides\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413032    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-dbus\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413049    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-cni-bin\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413061    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-slash\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413069    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-socket-dir-parent\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413089    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-os-release\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413114    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwrr\" (UniqueName: \"kubernetes.io/projected/2f6fd689-f03c-4443-a4a7-96497451e596-kube-api-access-tlwrr\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413140    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-os-release\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413090    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-slash\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413141    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-cnibin\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413161    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-dbus\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413175    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-conf-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413191    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysctl-conf\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413207    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59b61266-88d9-40f8-b466-79fa17e899b2-etc-tuned\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413220    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-conf-dir\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.414178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413240    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99qfq\" (UniqueName: \"kubernetes.io/projected/a980785d-cf7b-4399-b226-8e15d53bb10d-kube-api-access-99qfq\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413265    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-cnibin\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413265    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-k8s-cni-cncf-io\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413302    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-k8s-cni-cncf-io\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413335    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-cni-multus\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413349    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysctl-conf\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413361    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-tmp-dir\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413386    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-kubelet-config\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413395    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-cni-multus\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413408    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysconfig\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413632    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmsnr\" (UniqueName: \"kubernetes.io/projected/59b61266-88d9-40f8-b466-79fa17e899b2-kube-api-access-fmsnr\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413707    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-var-lib-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413717    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-tmp-dir\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413733    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a980785d-cf7b-4399-b226-8e15d53bb10d-ovn-node-metrics-cert\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413757    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-kubelet\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413769    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysconfig\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413780    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-var-lib-kubelet\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413797    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-var-lib-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.415112 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413813    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-cni-netd\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413838    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-kubelet-config\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413845    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-ovnkube-script-lib\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413875    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-netns\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413901    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-cni-bin\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413925    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fce065fc-79ff-415b-8a02-6f87c9099f68-cni-binary-copy\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413953    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-etc-kubernetes\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.413994    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1-agent-certs\") pod \"konnectivity-agent-f4lh6\" (UID: \"0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1\") " pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414018    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-sys\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414068    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-kubelet\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414127    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-var-lib-kubelet\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414168    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-cni-netd\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414196    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4plnn\" (UniqueName: \"kubernetes.io/projected/1b94016e-0ac6-4037-9c48-59aab4e71e3c-kube-api-access-4plnn\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414225    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-node-log\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414250    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-hostroot\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414275    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-multus-certs\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414301    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-device-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414328    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-ovnkube-config\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414354    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/458477e6-def3-441c-9cdd-59e70e711840-host\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414379    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/458477e6-def3-441c-9cdd-59e70e711840-serviceca\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414403    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-kubernetes\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414427    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysctl-d\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414451    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414475    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-kubelet\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414501    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-daemon-config\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414528    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414551    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-run\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414575    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-systemd\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414601    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414610    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-ovnkube-script-lib\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414628    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414678    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-netns\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414723    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414074    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-sys\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.414764    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-var-lib-cni-bin\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415035    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-node-log\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.416798 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415086    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-hostroot\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415125    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-host-run-multus-certs\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415185    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f6fd689-f03c-4443-a4a7-96497451e596-device-dir\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415318    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fce065fc-79ff-415b-8a02-6f87c9099f68-cni-binary-copy\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415377    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fce065fc-79ff-415b-8a02-6f87c9099f68-etc-kubernetes\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415534    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-host-kubelet\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415558    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59b61266-88d9-40f8-b466-79fa17e899b2-etc-tuned\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415588    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/458477e6-def3-441c-9cdd-59e70e711840-host\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415606    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b61266-88d9-40f8-b466-79fa17e899b2-tmp\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415631    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-run\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415716    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-ovnkube-config\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415775    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-systemd\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415742    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-sysctl-d\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415821    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a980785d-cf7b-4399-b226-8e15d53bb10d-run-openvswitch\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.415864    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b61266-88d9-40f8-b466-79fa17e899b2-etc-kubernetes\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.415903    2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.415943    2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:28.417442 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.415960    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs podName:1b94016e-0ac6-4037-9c48-59aab4e71e3c nodeName:}" failed. No retries permitted until 2026-07-24 15:45:28.915943427 +0000 UTC m=+3.073810110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs") pod "network-metrics-daemon-6tfmz" (UID: "1b94016e-0ac6-4037-9c48-59aab4e71e3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:28.418076 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.416006    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret podName:498b446f-d1a3-4f46-ae0a-489ed8f0fa92 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:28.915988631 +0000 UTC m=+3.073855308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret") pod "global-pull-secret-syncer-9x7gq" (UID: "498b446f-d1a3-4f46-ae0a-489ed8f0fa92") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:28.418076 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.416149    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fce065fc-79ff-415b-8a02-6f87c9099f68-multus-daemon-config\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.418076 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.416219    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/458477e6-def3-441c-9cdd-59e70e711840-serviceca\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.418076 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.416439    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a980785d-cf7b-4399-b226-8e15d53bb10d-env-overrides\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.418076 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.416598    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a980785d-cf7b-4399-b226-8e15d53bb10d-ovn-node-metrics-cert\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.418076 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.418061    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1-agent-certs\") pod \"konnectivity-agent-f4lh6\" (UID: \"0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1\") " pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:28.423225 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.423204    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgksh\" (UniqueName: \"kubernetes.io/projected/0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9-kube-api-access-dgksh\") pod \"node-resolver-ssqh6\" (UID: \"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9\") " pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.423332 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.423209    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmsnr\" (UniqueName: \"kubernetes.io/projected/59b61266-88d9-40f8-b466-79fa17e899b2-kube-api-access-fmsnr\") pod \"tuned-rkhfr\" (UID: \"59b61266-88d9-40f8-b466-79fa17e899b2\") " pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.425707 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.425664    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwrr\" (UniqueName: \"kubernetes.io/projected/2f6fd689-f03c-4443-a4a7-96497451e596-kube-api-access-tlwrr\") pod \"aws-ebs-csi-driver-node-chhtx\" (UID: \"2f6fd689-f03c-4443-a4a7-96497451e596\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.426058 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.426041    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bxm4\" (UniqueName: \"kubernetes.io/projected/fce065fc-79ff-415b-8a02-6f87c9099f68-kube-api-access-8bxm4\") pod \"multus-2tmk5\" (UID: \"fce065fc-79ff-415b-8a02-6f87c9099f68\") " pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.426136 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.426068    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5hsx\" (UniqueName: \"kubernetes.io/projected/458477e6-def3-441c-9cdd-59e70e711840-kube-api-access-h5hsx\") pod \"node-ca-ftg7x\" (UID: \"458477e6-def3-441c-9cdd-59e70e711840\") " pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.426521 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.426500    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qfq\" (UniqueName: \"kubernetes.io/projected/a980785d-cf7b-4399-b226-8e15d53bb10d-kube-api-access-99qfq\") pod \"ovnkube-node-hgljr\" (UID: \"a980785d-cf7b-4399-b226-8e15d53bb10d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.426607 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.426521    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4plnn\" (UniqueName: \"kubernetes.io/projected/1b94016e-0ac6-4037-9c48-59aab4e71e3c-kube-api-access-4plnn\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:28.518317 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.518259    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nm5zn"
Jul 24 15:45:28.538874 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.538850    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-plrt6"
Jul 24 15:45:28.549905 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.549879    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rkhfr"
Jul 24 15:45:28.556827 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.556811    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ftg7x"
Jul 24 15:45:28.564820 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.564801    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:28.571781 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.571761    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:28.580804 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.580781    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tmk5"
Jul 24 15:45:28.587621 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.587581    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ssqh6"
Jul 24 15:45:28.595718 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.595683    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx"
Jul 24 15:45:28.917860 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.917766    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:28.917860 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.917816    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:28.917860 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:28.917843    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:28.918128 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.917943    2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:28.918128 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.917995    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:45:28.918128 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.918015    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:45:28.918128 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.918023    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret podName:498b446f-d1a3-4f46-ae0a-489ed8f0fa92 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:29.918000222 +0000 UTC m=+4.075866912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret") pod "global-pull-secret-syncer-9x7gq" (UID: "498b446f-d1a3-4f46-ae0a-489ed8f0fa92") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:28.918128 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.918025    2600 projected.go:196] Error preparing data for projected volume kube-api-access-dz769 for pod openshift-network-diagnostics/network-check-target-qqqpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:28.918128 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.917943    2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:28.918128 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.918077    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769 podName:13489cf3-a86e-4225-9873-3f81d8c4da91 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:29.918060683 +0000 UTC m=+4.075927383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dz769" (UniqueName: "kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769") pod "network-check-target-qqqpc" (UID: "13489cf3-a86e-4225-9873-3f81d8c4da91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:28.918128 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:28.918113    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs podName:1b94016e-0ac6-4037-9c48-59aab4e71e3c nodeName:}" failed. No retries permitted until 2026-07-24 15:45:29.918095264 +0000 UTC m=+4.075961957 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs") pod "network-metrics-daemon-6tfmz" (UID: "1b94016e-0ac6-4037-9c48-59aab4e71e3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:29.237560 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.237480    2600 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 15:40:27 +0000 UTC" deadline="2028-02-11 20:00:36.051386966 +0000 UTC"
Jul 24 15:45:29.237560 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.237547    2600 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13612h15m6.813842899s"
Jul 24 15:45:29.333804 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:29.333776    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0f870c_5c0e_49e2_a6ff_b7ebdff6ace1.slice/crio-511d0e8d730a37bae956b13b5c1de8d9206c9aae0e2aac7d16bd3a8757499cb2 WatchSource:0}: Error finding container 511d0e8d730a37bae956b13b5c1de8d9206c9aae0e2aac7d16bd3a8757499cb2: Status 404 returned error can't find the container with id 511d0e8d730a37bae956b13b5c1de8d9206c9aae0e2aac7d16bd3a8757499cb2
Jul 24 15:45:29.335717 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:29.335598    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce065fc_79ff_415b_8a02_6f87c9099f68.slice/crio-9140248f29e3d60ab976d4f128c0c77868c3beb7667bb4e53588c29f1e5f4e26 WatchSource:0}: Error finding container 9140248f29e3d60ab976d4f128c0c77868c3beb7667bb4e53588c29f1e5f4e26: Status 404 returned error can't find the container with id 9140248f29e3d60ab976d4f128c0c77868c3beb7667bb4e53588c29f1e5f4e26
Jul 24 15:45:29.336758 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:29.336651    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b61266_88d9_40f8_b466_79fa17e899b2.slice/crio-cd896321961f06b5cdba07d0a530b06abb965c11f0d79188eb25bcdf2942fab7 WatchSource:0}: Error finding container cd896321961f06b5cdba07d0a530b06abb965c11f0d79188eb25bcdf2942fab7: Status 404 returned error can't find the container with id cd896321961f06b5cdba07d0a530b06abb965c11f0d79188eb25bcdf2942fab7
Jul 24 15:45:29.338112 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:29.337713    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ad8993_ef49_45ea_88e0_4d95c4903f16.slice/crio-430b2ab0e105183352f47b51bba5ea805fb9ae625e789d69309d8878325d295d WatchSource:0}: Error finding container 430b2ab0e105183352f47b51bba5ea805fb9ae625e789d69309d8878325d295d: Status 404 returned error can't find the container with id 430b2ab0e105183352f47b51bba5ea805fb9ae625e789d69309d8878325d295d
Jul 24 15:45:29.364215 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:29.364190    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda980785d_cf7b_4399_b226_8e15d53bb10d.slice/crio-3b37e8de684fd813492619e6c77f2b816fd7bce0d12cdf1ba1cf66c409d14b34 WatchSource:0}: Error finding container 3b37e8de684fd813492619e6c77f2b816fd7bce0d12cdf1ba1cf66c409d14b34: Status 404 returned error can't find the container with id 3b37e8de684fd813492619e6c77f2b816fd7bce0d12cdf1ba1cf66c409d14b34
Jul 24 15:45:29.364999 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:29.364951    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458477e6_def3_441c_9cdd_59e70e711840.slice/crio-74cff19c5413ee696d96b1c1c1150207da4a48eedf99578b1474387a278cb16d WatchSource:0}: Error finding container 74cff19c5413ee696d96b1c1c1150207da4a48eedf99578b1474387a278cb16d: Status 404 returned error can't find the container with id 74cff19c5413ee696d96b1c1c1150207da4a48eedf99578b1474387a278cb16d
Jul 24 15:45:29.365932 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:29.365911    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096e926e_7d4d_42fc_acc2_46dd965ee2df.slice/crio-26830e2903e41f6994b16219bbbc5c058692ee963c7771c61ba76c63820929af WatchSource:0}: Error finding container 26830e2903e41f6994b16219bbbc5c058692ee963c7771c61ba76c63820929af: Status 404 returned error can't find the container with id 26830e2903e41f6994b16219bbbc5c058692ee963c7771c61ba76c63820929af
Jul 24 15:45:29.367386 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:45:29.367357    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6fd689_f03c_4443_a4a7_96497451e596.slice/crio-a41e08f459b9371fdb79d110e87536cc8edf37e3b1a7ae3d2a1c4002d073dca8 WatchSource:0}: Error finding container a41e08f459b9371fdb79d110e87536cc8edf37e3b1a7ae3d2a1c4002d073dca8: Status 404 returned error can't find the container with id a41e08f459b9371fdb79d110e87536cc8edf37e3b1a7ae3d2a1c4002d073dca8
Jul 24 15:45:29.405792 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.405653    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"3b37e8de684fd813492619e6c77f2b816fd7bce0d12cdf1ba1cf66c409d14b34"}
Jul 24 15:45:29.406753 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.406719    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rkhfr" event={"ID":"59b61266-88d9-40f8-b466-79fa17e899b2","Type":"ContainerStarted","Data":"cd896321961f06b5cdba07d0a530b06abb965c11f0d79188eb25bcdf2942fab7"}
Jul 24 15:45:29.407682 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.407663    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx" event={"ID":"2f6fd689-f03c-4443-a4a7-96497451e596","Type":"ContainerStarted","Data":"a41e08f459b9371fdb79d110e87536cc8edf37e3b1a7ae3d2a1c4002d073dca8"}
Jul 24 15:45:29.410025 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.410005    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-plrt6" event={"ID":"096e926e-7d4d-42fc-acc2-46dd965ee2df","Type":"ContainerStarted","Data":"26830e2903e41f6994b16219bbbc5c058692ee963c7771c61ba76c63820929af"}
Jul 24 15:45:29.413665 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.413638    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ftg7x" event={"ID":"458477e6-def3-441c-9cdd-59e70e711840","Type":"ContainerStarted","Data":"74cff19c5413ee696d96b1c1c1150207da4a48eedf99578b1474387a278cb16d"}
Jul 24 15:45:29.415262 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.415241    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ssqh6" event={"ID":"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9","Type":"ContainerStarted","Data":"c9735dc2fab7a7af06302a9cf7591f104f46d8636ad455574bcd37331c1a7699"}
Jul 24 15:45:29.416439 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.416413    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tmk5" event={"ID":"fce065fc-79ff-415b-8a02-6f87c9099f68","Type":"ContainerStarted","Data":"9140248f29e3d60ab976d4f128c0c77868c3beb7667bb4e53588c29f1e5f4e26"}
Jul 24 15:45:29.417503 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.417483    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" event={"ID":"65ad8993-ef49-45ea-88e0-4d95c4903f16","Type":"ContainerStarted","Data":"430b2ab0e105183352f47b51bba5ea805fb9ae625e789d69309d8878325d295d"}
Jul 24 15:45:29.418503 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.418479    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f4lh6" event={"ID":"0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1","Type":"ContainerStarted","Data":"511d0e8d730a37bae956b13b5c1de8d9206c9aae0e2aac7d16bd3a8757499cb2"}
Jul 24 15:45:29.926109 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.926068    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:29.926269 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.926128    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:29.926269 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.926168    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:29.926383 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:29.926359    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:45:29.926383 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:29.926378    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:45:29.926485 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:29.926392    2600 projected.go:196] Error preparing data for projected volume kube-api-access-dz769 for pod openshift-network-diagnostics/network-check-target-qqqpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:29.926485 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:29.926455    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769 podName:13489cf3-a86e-4225-9873-3f81d8c4da91 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:31.926436514 +0000 UTC m=+6.084303200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dz769" (UniqueName: "kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769") pod "network-check-target-qqqpc" (UID: "13489cf3-a86e-4225-9873-3f81d8c4da91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:29.926807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:29.926787    2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:29.926890 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:29.926823    2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:29.926890 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:29.926846    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret podName:498b446f-d1a3-4f46-ae0a-489ed8f0fa92 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:31.926830753 +0000 UTC m=+6.084697435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret") pod "global-pull-secret-syncer-9x7gq" (UID: "498b446f-d1a3-4f46-ae0a-489ed8f0fa92") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:29.927013 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:29.926891    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs podName:1b94016e-0ac6-4037-9c48-59aab4e71e3c nodeName:}" failed. No retries permitted until 2026-07-24 15:45:31.926872519 +0000 UTC m=+6.084739206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs") pod "network-metrics-daemon-6tfmz" (UID: "1b94016e-0ac6-4037-9c48-59aab4e71e3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:29.958147 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:29.958120    2600 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:45:30.399566 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:30.398787    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:30.399566 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:30.398827    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:30.399566 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:30.398925    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:30.399566 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:30.398787    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:30.399566 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:30.399416    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:30.399566 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:30.399524    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:30.455868 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:30.455835    2600 generic.go:356] "Generic (PLEG): container finished" podID="c9adaaed0eb9e1e379ca9054dcfb08b6" containerID="3390cb5a4a75a8f560b9fe1b17e13e2c7d84443fbc48f01fcae89d8f856e443d" exitCode=0
Jul 24 15:45:30.456460 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:30.456433    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"c9adaaed0eb9e1e379ca9054dcfb08b6","Type":"ContainerDied","Data":"3390cb5a4a75a8f560b9fe1b17e13e2c7d84443fbc48f01fcae89d8f856e443d"}
Jul 24 15:45:30.461524 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:30.461089    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal" event={"ID":"5b4c93f4e70558b77ddac96ac849afbc","Type":"ContainerStarted","Data":"e6dd7c1602f1de48a8587fc2bb1c4679bbcb1510bdbeca18c0df9d17d6a4345a"}
Jul 24 15:45:31.484879 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:31.484699    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"c9adaaed0eb9e1e379ca9054dcfb08b6","Type":"ContainerStarted","Data":"bca70fabcc212dfa1572825f3087c5161e1f1daffb0b7ab8bddc9f966dc3f854"}
Jul 24 15:45:31.502274 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:31.501622    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal" podStartSLOduration=4.501600557 podStartE2EDuration="4.501600557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:30.488078526 +0000 UTC m=+4.645945228" watchObservedRunningTime="2026-07-24 15:45:31.501600557 +0000 UTC m=+5.659467263"
Jul 24 15:45:31.945541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:31.945492    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:31.945740 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:31.945547    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:31.945740 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:31.945582    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:31.945740 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:31.945690    2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:31.945926 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:31.945778    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs podName:1b94016e-0ac6-4037-9c48-59aab4e71e3c nodeName:}" failed. No retries permitted until 2026-07-24 15:45:35.945752356 +0000 UTC m=+10.103619037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs") pod "network-metrics-daemon-6tfmz" (UID: "1b94016e-0ac6-4037-9c48-59aab4e71e3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:31.945926 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:31.945806    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:45:31.945926 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:31.945826    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:45:31.945926 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:31.945840    2600 projected.go:196] Error preparing data for projected volume kube-api-access-dz769 for pod openshift-network-diagnostics/network-check-target-qqqpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:31.945926 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:31.945891    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769 podName:13489cf3-a86e-4225-9873-3f81d8c4da91 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:35.945875284 +0000 UTC m=+10.103741973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dz769" (UniqueName: "kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769") pod "network-check-target-qqqpc" (UID: "13489cf3-a86e-4225-9873-3f81d8c4da91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:31.946183 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:31.945961    2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:31.946183 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:31.945993    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret podName:498b446f-d1a3-4f46-ae0a-489ed8f0fa92 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:35.945982117 +0000 UTC m=+10.103848798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret") pod "global-pull-secret-syncer-9x7gq" (UID: "498b446f-d1a3-4f46-ae0a-489ed8f0fa92") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:32.400393 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:32.400309    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:32.400561 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:32.400440    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:32.400857 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:32.400833    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:32.400961 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:32.400940    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:32.401020 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:32.400999    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:32.401099 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:32.401077    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:34.398627 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:34.398588    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:34.398627 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:34.398602    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:34.399187 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:34.398741    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:34.399187 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:34.398759    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:34.399187 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:34.398841    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:34.399187 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:34.398918    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:35.979225 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:35.979193    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:35.979710 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:35.979239    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:35.979710 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:35.979274    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:35.979710 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:35.979428    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:45:35.979710 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:35.979445    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:45:35.979710 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:35.979459    2600 projected.go:196] Error preparing data for projected volume kube-api-access-dz769 for pod openshift-network-diagnostics/network-check-target-qqqpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:35.979710 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:35.979516    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769 podName:13489cf3-a86e-4225-9873-3f81d8c4da91 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:43.979497472 +0000 UTC m=+18.137364151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dz769" (UniqueName: "kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769") pod "network-check-target-qqqpc" (UID: "13489cf3-a86e-4225-9873-3f81d8c4da91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:35.980025 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:35.979912    2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:35.980025 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:35.979966    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs podName:1b94016e-0ac6-4037-9c48-59aab4e71e3c nodeName:}" failed. No retries permitted until 2026-07-24 15:45:43.979947586 +0000 UTC m=+18.137814276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs") pod "network-metrics-daemon-6tfmz" (UID: "1b94016e-0ac6-4037-9c48-59aab4e71e3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:35.980025 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:35.980019    2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:35.980146 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:35.980053    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret podName:498b446f-d1a3-4f46-ae0a-489ed8f0fa92 nodeName:}" failed. No retries permitted until 2026-07-24 15:45:43.980041142 +0000 UTC m=+18.137907822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret") pod "global-pull-secret-syncer-9x7gq" (UID: "498b446f-d1a3-4f46-ae0a-489ed8f0fa92") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:36.398586 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:36.398067    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:36.398586 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:36.398167    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:36.398586 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:36.398186    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:36.398586 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:36.398289    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:36.398586 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:36.398332    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:36.398586 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:36.398401    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:38.398278 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:38.398238    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:38.398765 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:38.398241    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:38.398765 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:38.398364    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:38.398765 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:38.398383    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:38.398765 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:38.398490    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:38.398765 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:38.398567    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:40.397858 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:40.397823    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:40.398234 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:40.397823    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:40.398234 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:40.397938    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:40.398234 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:40.397842    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:40.398234 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:40.398000    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:40.398234 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:40.398096    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:42.397587 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:42.397556    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:42.398071 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:42.397556    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:42.398071 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:42.397696    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:42.398071 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:42.397698    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:42.398071 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:42.397804    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:42.398071 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:42.397889    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:44.041021 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:44.040989    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:44.041021 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:44.041026    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:44.041048    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.041155    2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.041158    2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.041172    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.041192    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.041205    2600 projected.go:196] Error preparing data for projected volume kube-api-access-dz769 for pod openshift-network-diagnostics/network-check-target-qqqpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.041226    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret podName:498b446f-d1a3-4f46-ae0a-489ed8f0fa92 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:00.041208513 +0000 UTC m=+34.199075209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret") pod "global-pull-secret-syncer-9x7gq" (UID: "498b446f-d1a3-4f46-ae0a-489ed8f0fa92") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.041241    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769 podName:13489cf3-a86e-4225-9873-3f81d8c4da91 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:00.041231828 +0000 UTC m=+34.199098506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dz769" (UniqueName: "kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769") pod "network-check-target-qqqpc" (UID: "13489cf3-a86e-4225-9873-3f81d8c4da91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:45:44.041525 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.041257    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs podName:1b94016e-0ac6-4037-9c48-59aab4e71e3c nodeName:}" failed. No retries permitted until 2026-07-24 15:46:00.041249579 +0000 UTC m=+34.199116255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs") pod "network-metrics-daemon-6tfmz" (UID: "1b94016e-0ac6-4037-9c48-59aab4e71e3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:45:44.397576 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:44.397494    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:44.397576 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:44.397544    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:44.397801 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:44.397494    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:44.397801 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.397648    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:44.397801 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.397702    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:44.397801 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:44.397759    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:46.398443 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:46.398407    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:46.398901 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:46.398528    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:46.398901 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:46.398523    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:46.398901 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:46.398634    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:46.398901 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:46.398751    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:46.398901 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:46.398835    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:48.397163 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:48.397131    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:48.397723 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:48.397134    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:48.397723 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:48.397243    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:48.397723 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:48.397350    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:48.397723 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:48.397137    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:48.397723 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:48.397448    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:49.525774 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.525315    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f4lh6" event={"ID":"0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1","Type":"ContainerStarted","Data":"b85d65c18bf61e753addc2dc22d6c2c44b65b77a364c6bba5518c157bd05cec1"}
Jul 24 15:45:49.528822 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.528795    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"923b12764a20b761adbf6f3f13ce1f003d2844a2dd2913c25e23160e43374190"}
Jul 24 15:45:49.528959 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.528880    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"528b4b2085147ba698c59b703f0fdbabdc3ba5e100397765071ac1b00344f8df"}
Jul 24 15:45:49.528959 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.528929    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"4d43718fc2e74056a9d152684641dc30203d33ecf710766302834efc92b15e26"}
Jul 24 15:45:49.529070 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.528976    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"c1062cd6adc9dddb0f870c9b69d69016908cd47e7ee1f1a26d6b915f31334f49"}
Jul 24 15:45:49.529070 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.529014    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"0f66f5743ebef60ff063b0bc3004b5ccadc597e7c2f17ce39be68dbb2732c669"}
Jul 24 15:45:49.529070 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.529044    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"16579b06f7fa7cb9d9798130816436b65efe3cc4385667b1ad5341963c937f69"}
Jul 24 15:45:49.530825 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.530401    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rkhfr" event={"ID":"59b61266-88d9-40f8-b466-79fa17e899b2","Type":"ContainerStarted","Data":"c8ea69cb71346cdee5dfcd1df3d50e3d91ee528ef8654569625a478489c20dfe"}
Jul 24 15:45:49.532115 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.532091    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx" event={"ID":"2f6fd689-f03c-4443-a4a7-96497451e596","Type":"ContainerStarted","Data":"d514dc0b51e45df50bd03462f0cbebc2689c71a0d8967acc713e3591f226776e"}
Jul 24 15:45:49.533541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.533521    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ftg7x" event={"ID":"458477e6-def3-441c-9cdd-59e70e711840","Type":"ContainerStarted","Data":"b0042ebe1856760b563a8f140581bd96a3c40aed36765ced791d88447fcee062"}
Jul 24 15:45:49.535504 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.535091    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ssqh6" event={"ID":"0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9","Type":"ContainerStarted","Data":"01481074801e71bae117b80a1dcfe2ecd7641be6620d347252ff64d84d716b62"}
Jul 24 15:45:49.537364 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.537340    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tmk5" event={"ID":"fce065fc-79ff-415b-8a02-6f87c9099f68","Type":"ContainerStarted","Data":"ffb60f34fabf828b6bb6db11f08a184823dad490a303652668a54e0564d36814"}
Jul 24 15:45:49.538917 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.538893    2600 generic.go:356] "Generic (PLEG): container finished" podID="65ad8993-ef49-45ea-88e0-4d95c4903f16" containerID="12b8099471c91bdb42a82a918b2d6d70c4316527dbc173f90ab52d21e2dbebff" exitCode=0
Jul 24 15:45:49.539019 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.538927    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" event={"ID":"65ad8993-ef49-45ea-88e0-4d95c4903f16","Type":"ContainerDied","Data":"12b8099471c91bdb42a82a918b2d6d70c4316527dbc173f90ab52d21e2dbebff"}
Jul 24 15:45:49.540081 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.540045    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" podStartSLOduration=22.540031896 podStartE2EDuration="22.540031896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:31.502241604 +0000 UTC m=+5.660108306" watchObservedRunningTime="2026-07-24 15:45:49.540031896 +0000 UTC m=+23.697898586"
Jul 24 15:45:49.558554 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.558501    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f4lh6" podStartSLOduration=4.1431079 podStartE2EDuration="23.558482173s" totalImagesPullingTime="19.415374273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:49.54059506 +0000 UTC m=+23.698461760" watchObservedRunningTime="2026-07-24 15:45:49.558482173 +0000 UTC m=+23.716348853"
Jul 24 15:45:49.558977 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.558944    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rkhfr" podStartSLOduration=4.141455104 podStartE2EDuration="23.558930272s" totalImagesPullingTime="19.417475168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:49.558482045 +0000 UTC m=+23.716348744" watchObservedRunningTime="2026-07-24 15:45:49.558930272 +0000 UTC m=+23.716796972"
Jul 24 15:45:49.573052 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.573003    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ftg7x" podStartSLOduration=4.191472429 podStartE2EDuration="23.572987524s" totalImagesPullingTime="19.381515095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:49.572823223 +0000 UTC m=+23.730689923" watchObservedRunningTime="2026-07-24 15:45:49.572987524 +0000 UTC m=+23.730854224"
Jul 24 15:45:49.592162 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.592117    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2tmk5" podStartSLOduration=4.11174618 podStartE2EDuration="23.592074031s" totalImagesPullingTime="19.480327851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:49.590249807 +0000 UTC m=+23.748116505" watchObservedRunningTime="2026-07-24 15:45:49.592074031 +0000 UTC m=+23.749940732"
Jul 24 15:45:49.659489 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:49.659445    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ssqh6" podStartSLOduration=4.25957026 podStartE2EDuration="23.659432138s" totalImagesPullingTime="19.399861878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:49.65913488 +0000 UTC m=+23.817001579" watchObservedRunningTime="2026-07-24 15:45:49.659432138 +0000 UTC m=+23.817298836"
Jul 24 15:45:50.248396 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.248051    2600 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 15:45:50.276221 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.276081    2600 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T15:45:50.248071766Z","UUID":"1c4fa6c2-c781-4769-84f2-43368778a1c2","Handler":null,"Name":"","Endpoint":""}
Jul 24 15:45:50.277531 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.277508    2600 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 15:45:50.277625 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.277552    2600 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 15:45:50.397660 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.397571    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:50.397660 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.397627    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:50.397968 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:50.397715    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:50.397968 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:50.397773    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:50.397968 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.397819    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:50.397968 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:50.397936    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:50.543690 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.543654    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx" event={"ID":"2f6fd689-f03c-4443-a4a7-96497451e596","Type":"ContainerStarted","Data":"337ec40b1e91d0e59fb38d8a658e535641793094c435fce6b3c5f98b0dc6dccd"}
Jul 24 15:45:50.545413 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.545385    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-plrt6" event={"ID":"096e926e-7d4d-42fc-acc2-46dd965ee2df","Type":"ContainerStarted","Data":"4e7e7fbd5231ece9bf517557e00700075e543021f881ba54e208d8267b7d4a61"}
Jul 24 15:45:50.561047 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:50.561007    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-plrt6" podStartSLOduration=5.163186314 podStartE2EDuration="24.560992796s" totalImagesPullingTime="19.397806482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:50.560385484 +0000 UTC m=+24.718252194" watchObservedRunningTime="2026-07-24 15:45:50.560992796 +0000 UTC m=+24.718859496"
Jul 24 15:45:51.549346 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:51.549314    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx" event={"ID":"2f6fd689-f03c-4443-a4a7-96497451e596","Type":"ContainerStarted","Data":"3815ad8e409e735281e2f707c5f2ea6c38417bdadca9983b9fae43f2dbefaefe"}
Jul 24 15:45:51.567808 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:51.567750    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chhtx" podStartSLOduration=3.010311052 podStartE2EDuration="24.567731013s" totalImagesPullingTime="21.557419961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:51.567252661 +0000 UTC m=+25.725119362" watchObservedRunningTime="2026-07-24 15:45:51.567731013 +0000 UTC m=+25.725597713"
Jul 24 15:45:52.397473 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:52.397437    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:52.397664 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:52.397444    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:52.397664 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:52.397563    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:52.397664 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:52.397628    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:52.397822 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:52.397736    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:52.397864 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:52.397818    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:52.556313 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:52.556110    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"0ad7fa441d3002dcd493610ac8d25798e62631437b5d082ba622afca9256353a"}
Jul 24 15:45:53.439679 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:53.439643    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:53.440266 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:53.440243    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:53.558962 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:53.558932    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:53.559411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:53.559393    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f4lh6"
Jul 24 15:45:54.398095 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.397888    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:54.398288 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.397891    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:54.398288 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:54.398195    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:54.398288 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.397938    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:54.398288 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:54.398259    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:54.398476 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:54.398324    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:54.562378 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.562297    2600 generic.go:356] "Generic (PLEG): container finished" podID="65ad8993-ef49-45ea-88e0-4d95c4903f16" containerID="c223d5750bbd5d9d766a3f32d5cf0d9373d09662cab389d4241fbb52a5d96cb1" exitCode=0
Jul 24 15:45:54.563198 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.562386    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" event={"ID":"65ad8993-ef49-45ea-88e0-4d95c4903f16","Type":"ContainerDied","Data":"c223d5750bbd5d9d766a3f32d5cf0d9373d09662cab389d4241fbb52a5d96cb1"}
Jul 24 15:45:54.565877 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.565854    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" event={"ID":"a980785d-cf7b-4399-b226-8e15d53bb10d","Type":"ContainerStarted","Data":"76bb5410641ba7d01a74dd9cb330fc3bc5998273e453decc4cd6657d6a9fcb5b"}
Jul 24 15:45:54.566154 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.566127    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:54.566247 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.566185    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:54.581998 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.581967    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:54.609116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:54.609074    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr" podStartSLOduration=9.156157718 podStartE2EDuration="28.609060157s" totalImagesPullingTime="19.452902439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:45:54.608481904 +0000 UTC m=+28.766348603" watchObservedRunningTime="2026-07-24 15:45:54.609060157 +0000 UTC m=+28.766926867"
Jul 24 15:45:55.581152 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:55.581061    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:55.599784 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:55.599761    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:45:55.854312 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:55.854220    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9x7gq"]
Jul 24 15:45:55.854477 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:55.854352    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:55.854477 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:55.854454    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:55.857327 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:55.857303    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qqqpc"]
Jul 24 15:45:55.857468 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:55.857405    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:55.857518 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:55.857498    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:55.857927 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:55.857905    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tfmz"]
Jul 24 15:45:55.858039 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:55.858013    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:55.858108 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:55.858091    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:56.572277 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:56.572245    2600 generic.go:356] "Generic (PLEG): container finished" podID="65ad8993-ef49-45ea-88e0-4d95c4903f16" containerID="90f7585888382cbc0d953a91122250b7311429577ab7dc919ab54e96639a75a5" exitCode=0
Jul 24 15:45:56.572456 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:56.572343    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" event={"ID":"65ad8993-ef49-45ea-88e0-4d95c4903f16","Type":"ContainerDied","Data":"90f7585888382cbc0d953a91122250b7311429577ab7dc919ab54e96639a75a5"}
Jul 24 15:45:57.397954 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:57.397768    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:57.398333 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:57.397774    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:57.398333 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:57.398047    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:45:57.398333 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:57.397799    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:57.398333 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:57.398096    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:57.398333 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:57.398189    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:58.580170 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:58.580136    2600 generic.go:356] "Generic (PLEG): container finished" podID="65ad8993-ef49-45ea-88e0-4d95c4903f16" containerID="f1ca5f884fe3b01c359049c48d3a09d4ccbf257cad4997040fff31a1fa30211d" exitCode=0
Jul 24 15:45:58.580533 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:58.580200    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" event={"ID":"65ad8993-ef49-45ea-88e0-4d95c4903f16","Type":"ContainerDied","Data":"f1ca5f884fe3b01c359049c48d3a09d4ccbf257cad4997040fff31a1fa30211d"}
Jul 24 15:45:59.397721 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:59.397689    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:45:59.397907 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:59.397725    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:45:59.397907 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:45:59.397795    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:45:59.397907 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:59.397812    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:45:59.397907 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:59.397885    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:45:59.398080 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:45:59.397966    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:46:00.061195 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:00.061163    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:46:00.061195 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:00.061196    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:00.061230    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:00.061347    2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:00.061411    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs podName:1b94016e-0ac6-4037-9c48-59aab4e71e3c nodeName:}" failed. No retries permitted until 2026-07-24 15:46:32.061395965 +0000 UTC m=+66.219262642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs") pod "network-metrics-daemon-6tfmz" (UID: "1b94016e-0ac6-4037-9c48-59aab4e71e3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:00.061347    2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:00.061472    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret podName:498b446f-d1a3-4f46-ae0a-489ed8f0fa92 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:32.061458457 +0000 UTC m=+66.219325133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret") pod "global-pull-secret-syncer-9x7gq" (UID: "498b446f-d1a3-4f46-ae0a-489ed8f0fa92") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:00.061352    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:00.061496    2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:00.061508    2600 projected.go:196] Error preparing data for projected volume kube-api-access-dz769 for pod openshift-network-diagnostics/network-check-target-qqqpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:46:00.061807 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:00.061549    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769 podName:13489cf3-a86e-4225-9873-3f81d8c4da91 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:32.061538056 +0000 UTC m=+66.219404738 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dz769" (UniqueName: "kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769") pod "network-check-target-qqqpc" (UID: "13489cf3-a86e-4225-9873-3f81d8c4da91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:46:01.397556 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.397511    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:46:01.397556 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.397551    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:46:01.398192 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.397511    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:46:01.398192 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:01.397671    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9x7gq" podUID="498b446f-d1a3-4f46-ae0a-489ed8f0fa92"
Jul 24 15:46:01.398192 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:01.397740    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tfmz" podUID="1b94016e-0ac6-4037-9c48-59aab4e71e3c"
Jul 24 15:46:01.398192 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:01.397837    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqqpc" podUID="13489cf3-a86e-4225-9873-3f81d8c4da91"
Jul 24 15:46:01.671242 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.671163    2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeReady"
Jul 24 15:46:01.671382 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.671304    2600 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 15:46:01.745169 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.745026    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77695b44b7-tvnps"]
Jul 24 15:46:01.747910 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.747888    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rvkc6"]
Jul 24 15:46:01.748035 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.748019    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.749549 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.749531    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jpwf4"]
Jul 24 15:46:01.749670 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.749653    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.750406 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.750382    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 15:46:01.751047 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.751026    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 15:46:01.751406 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.751391    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jpwf4"
Jul 24 15:46:01.752058 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.752039    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 15:46:01.752190 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.752173    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 15:46:01.753656 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.753631    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 15:46:01.753741 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.753674    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vwj8g\""
Jul 24 15:46:01.753741 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.753722    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nsfqx\""
Jul 24 15:46:01.756623 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.756581    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 15:46:01.757887 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.757639    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 15:46:01.757887 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.757643    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-82l8s\""
Jul 24 15:46:01.757996 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.757942    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 15:46:01.761761 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.761657    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 15:46:01.766875 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.766848    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jpwf4"]
Jul 24 15:46:01.768006 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.767984    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77695b44b7-tvnps"]
Jul 24 15:46:01.770935 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.770914    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rvkc6"]
Jul 24 15:46:01.803649 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.803593    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:01.876007 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.875979    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkg4p\" (UniqueName: \"kubernetes.io/projected/8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c-kube-api-access-kkg4p\") pod \"ingress-canary-jpwf4\" (UID: \"8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c\") " pod="openshift-ingress-canary/ingress-canary-jpwf4"
Jul 24 15:46:01.876174 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876017    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c-cert\") pod \"ingress-canary-jpwf4\" (UID: \"8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c\") " pod="openshift-ingress-canary/ingress-canary-jpwf4"
Jul 24 15:46:01.876174 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876039    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-tmp-dir\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.876174 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876063    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.876174 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876136    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jvw\" (UniqueName: \"kubernetes.io/projected/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-kube-api-access-s4jvw\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.876364 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876182    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-image-registry-private-configuration\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.876364 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876208    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-installation-pull-secrets\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.876364 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876231    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-bound-sa-token\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.876364 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876280    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.876364 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876305    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7756e437-15c8-419f-8b9c-a2c3a7327ab9-ca-trust-extracted\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.876364 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876343    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-trusted-ca\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.876577 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876373    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-config-volume\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.876577 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876431    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4ldm\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-kube-api-access-j4ldm\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.876577 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.876451    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-certificates\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.901850 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.901822    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:01.977055 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977015    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-image-registry-private-configuration\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977055 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977058    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-installation-pull-secrets\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977299 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977080    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-bound-sa-token\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977299 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977114    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977299 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977136    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7756e437-15c8-419f-8b9c-a2c3a7327ab9-ca-trust-extracted\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977299 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977158    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-trusted-ca\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977299 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977180    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-config-volume\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.977529 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:01.977406    2600 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 15:46:01.977529 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977410    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4ldm\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-kube-api-access-j4ldm\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977529 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977455    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-certificates\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977529 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977497    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkg4p\" (UniqueName: \"kubernetes.io/projected/8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c-kube-api-access-kkg4p\") pod \"ingress-canary-jpwf4\" (UID: \"8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c\") " pod="openshift-ingress-canary/ingress-canary-jpwf4"
Jul 24 15:46:01.977744 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977544    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c-cert\") pod \"ingress-canary-jpwf4\" (UID: \"8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c\") " pod="openshift-ingress-canary/ingress-canary-jpwf4"
Jul 24 15:46:01.977744 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977571    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-tmp-dir\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.977744 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977598    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.977744 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977651    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jvw\" (UniqueName: \"kubernetes.io/projected/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-kube-api-access-s4jvw\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.977744 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.977681    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7756e437-15c8-419f-8b9c-a2c3a7327ab9-ca-trust-extracted\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.977984 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:01.977426    2600 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77695b44b7-tvnps: secret "image-registry-tls" not found
Jul 24 15:46:01.977984 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:01.977938    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls podName:7756e437-15c8-419f-8b9c-a2c3a7327ab9 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:02.477915933 +0000 UTC m=+36.635782618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls") pod "image-registry-77695b44b7-tvnps" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9") : secret "image-registry-tls" not found
Jul 24 15:46:01.978096 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.978017    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-config-volume\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.978151 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:01.978107    2600 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:46:01.978195 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.978144    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-tmp-dir\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.978195 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:01.978164    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls podName:98efb8c4-0bf4-4f4c-9018-69c95f0d2f01 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:02.478145976 +0000 UTC m=+36.636012654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls") pod "dns-default-rvkc6" (UID: "98efb8c4-0bf4-4f4c-9018-69c95f0d2f01") : secret "dns-default-metrics-tls" not found
Jul 24 15:46:01.978394 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.978374    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-trusted-ca\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.978530 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.978511    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-certificates\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.982143 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.982122    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c-cert\") pod \"ingress-canary-jpwf4\" (UID: \"8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c\") " pod="openshift-ingress-canary/ingress-canary-jpwf4"
Jul 24 15:46:01.982279 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.982124    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-installation-pull-secrets\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.987178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.987143    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4ldm\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-kube-api-access-j4ldm\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.987294 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.987235    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-bound-sa-token\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:01.987796 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.987765    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jvw\" (UniqueName: \"kubernetes.io/projected/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-kube-api-access-s4jvw\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:01.988048 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.988023    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkg4p\" (UniqueName: \"kubernetes.io/projected/8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c-kube-api-access-kkg4p\") pod \"ingress-canary-jpwf4\" (UID: \"8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c\") " pod="openshift-ingress-canary/ingress-canary-jpwf4"
Jul 24 15:46:01.992017 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:01.991992    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-image-registry-private-configuration\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:02.076440 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:02.076405    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jpwf4"
Jul 24 15:46:02.482081 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:02.482040    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:02.482517 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:02.482156    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:02.482517 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:02.482213    2600 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 15:46:02.482517 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:02.482237    2600 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77695b44b7-tvnps: secret "image-registry-tls" not found
Jul 24 15:46:02.482517 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:02.482255    2600 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:46:02.482517 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:02.482310    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls podName:98efb8c4-0bf4-4f4c-9018-69c95f0d2f01 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:03.48229467 +0000 UTC m=+37.640161372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls") pod "dns-default-rvkc6" (UID: "98efb8c4-0bf4-4f4c-9018-69c95f0d2f01") : secret "dns-default-metrics-tls" not found
Jul 24 15:46:02.482517 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:02.482326    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls podName:7756e437-15c8-419f-8b9c-a2c3a7327ab9 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:03.482317594 +0000 UTC m=+37.640184271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls") pod "image-registry-77695b44b7-tvnps" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9") : secret "image-registry-tls" not found
Jul 24 15:46:02.760664 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:02.760419    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jpwf4"]
Jul 24 15:46:02.766744 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:02.766719    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d17eeb9_14fd_4d1a_a01f_5fe3c11b472c.slice/crio-65544956b2cdb738fa428977c0e78cb5203ea032613c9405d048a6e5d0aeb1b4 WatchSource:0}: Error finding container 65544956b2cdb738fa428977c0e78cb5203ea032613c9405d048a6e5d0aeb1b4: Status 404 returned error can't find the container with id 65544956b2cdb738fa428977c0e78cb5203ea032613c9405d048a6e5d0aeb1b4
Jul 24 15:46:03.397760 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.397725    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:46:03.398057 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.397734    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:46:03.398057 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.397734    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:46:03.400751 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.400724    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cbp7q\""
Jul 24 15:46:03.401996 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.401664    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 15:46:03.401996 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.401757    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pqxfk\""
Jul 24 15:46:03.401996 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.401674    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 15:46:03.401996 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.401767    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 15:46:03.401996 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.401759    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 15:46:03.491048 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.491013    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:03.491504 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.491097    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:03.491504 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:03.491213    2600 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:46:03.491504 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:03.491222    2600 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 15:46:03.491504 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:03.491242    2600 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77695b44b7-tvnps: secret "image-registry-tls" not found
Jul 24 15:46:03.491504 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:03.491287    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls podName:98efb8c4-0bf4-4f4c-9018-69c95f0d2f01 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:05.49126736 +0000 UTC m=+39.649134050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls") pod "dns-default-rvkc6" (UID: "98efb8c4-0bf4-4f4c-9018-69c95f0d2f01") : secret "dns-default-metrics-tls" not found
Jul 24 15:46:03.491504 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:03.491333    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls podName:7756e437-15c8-419f-8b9c-a2c3a7327ab9 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:05.491311434 +0000 UTC m=+39.649178125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls") pod "image-registry-77695b44b7-tvnps" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9") : secret "image-registry-tls" not found
Jul 24 15:46:03.593162 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.593120    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jpwf4" event={"ID":"8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c","Type":"ContainerStarted","Data":"65544956b2cdb738fa428977c0e78cb5203ea032613c9405d048a6e5d0aeb1b4"}
Jul 24 15:46:03.596308 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.596280    2600 generic.go:356] "Generic (PLEG): container finished" podID="65ad8993-ef49-45ea-88e0-4d95c4903f16" containerID="1830dfe747a20b24065e2c1b049741fe04219b6a7473e01823bb40f8482b0094" exitCode=0
Jul 24 15:46:03.596446 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:03.596326    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" event={"ID":"65ad8993-ef49-45ea-88e0-4d95c4903f16","Type":"ContainerDied","Data":"1830dfe747a20b24065e2c1b049741fe04219b6a7473e01823bb40f8482b0094"}
Jul 24 15:46:04.005815 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:04.005759    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:04.063247 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:04.063218    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:04.602529 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:04.602493    2600 generic.go:356] "Generic (PLEG): container finished" podID="65ad8993-ef49-45ea-88e0-4d95c4903f16" containerID="183aafe392cf7f86f74997bb5f18dcb498d479d2eac54de77091eb646604bf89" exitCode=0
Jul 24 15:46:04.602976 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:04.602547    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" event={"ID":"65ad8993-ef49-45ea-88e0-4d95c4903f16","Type":"ContainerDied","Data":"183aafe392cf7f86f74997bb5f18dcb498d479d2eac54de77091eb646604bf89"}
Jul 24 15:46:04.741378 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:04.741348    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:04.842249 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:04.842209    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:04.988571 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:04.988411    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:05.079902 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.079879    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:05.506157 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.506116    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:05.506343 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.506206    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:05.506343 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:05.506291    2600 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 15:46:05.506343 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:05.506305    2600 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:46:05.506343 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:05.506311    2600 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77695b44b7-tvnps: secret "image-registry-tls" not found
Jul 24 15:46:05.506497 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:05.506363    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls podName:98efb8c4-0bf4-4f4c-9018-69c95f0d2f01 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:09.506346886 +0000 UTC m=+43.664213568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls") pod "dns-default-rvkc6" (UID: "98efb8c4-0bf4-4f4c-9018-69c95f0d2f01") : secret "dns-default-metrics-tls" not found
Jul 24 15:46:05.506497 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:05.506377    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls podName:7756e437-15c8-419f-8b9c-a2c3a7327ab9 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:09.506371404 +0000 UTC m=+43.664238081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls") pod "image-registry-77695b44b7-tvnps" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9") : secret "image-registry-tls" not found
Jul 24 15:46:05.608954 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.608874    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" event={"ID":"65ad8993-ef49-45ea-88e0-4d95c4903f16","Type":"ContainerStarted","Data":"97bb136ef9514b8e64ade3a0d6ba1d91d1154b9b6999d5f2ee6d530777a86bbb"}
Jul 24 15:46:05.610314 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.610289    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jpwf4" event={"ID":"8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c","Type":"ContainerStarted","Data":"e375b89fdadf16aacf48c8976f17a8504d430ce9b045520ce593bef5e0cb70a8"}
Jul 24 15:46:05.632895 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.632848    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nm5zn" podStartSLOduration=9.769917273 podStartE2EDuration="39.632835809s" totalImagesPullingTime="29.862918536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:05.630965286 +0000 UTC m=+39.788831988" watchObservedRunningTime="2026-07-24 15:46:05.632835809 +0000 UTC m=+39.790702508"
Jul 24 15:46:05.646668 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.646600    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jpwf4" podStartSLOduration=2.085644075 podStartE2EDuration="4.646587955s" totalImagesPullingTime="2.56094388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:05.645728493 +0000 UTC m=+39.803595193" watchObservedRunningTime="2026-07-24 15:46:05.646587955 +0000 UTC m=+39.804454653"
Jul 24 15:46:05.741680 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.741651    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:05.840945 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:05.840912    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:06.011072 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:06.011045    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:06.073792 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:06.073756    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:08.658887 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:08.658855    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:09.533942 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:09.533907    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:09.534127 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:09.533991    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:09.534127 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:09.534073    2600 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:46:09.534127 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:09.534078    2600 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 15:46:09.534127 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:09.534098    2600 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77695b44b7-tvnps: secret "image-registry-tls" not found
Jul 24 15:46:09.534266 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:09.534136    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls podName:98efb8c4-0bf4-4f4c-9018-69c95f0d2f01 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:17.534122415 +0000 UTC m=+51.691989092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls") pod "dns-default-rvkc6" (UID: "98efb8c4-0bf4-4f4c-9018-69c95f0d2f01") : secret "dns-default-metrics-tls" not found
Jul 24 15:46:09.534266 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:09.534155    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls podName:7756e437-15c8-419f-8b9c-a2c3a7327ab9 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:17.534141626 +0000 UTC m=+51.692008302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls") pod "image-registry-77695b44b7-tvnps" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9") : secret "image-registry-tls" not found
Jul 24 15:46:10.965426 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:10.965395    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:11.066207 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.066176    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:11.415204 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.415127    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:11.471128 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.471091    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:11.574320 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.574281    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4f88q"]
Jul 24 15:46:11.579737 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.579712    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:11.592551 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.592525    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.592914 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.592868    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4f88q"]
Jul 24 15:46:11.598667 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.598641    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 15:46:11.598777 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.598705    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 15:46:11.598777 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.598751    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 15:46:11.599957 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.599935    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vfsm2\""
Jul 24 15:46:11.600163 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.600150    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 15:46:11.750838 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.750810    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.750992 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.750844    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.750992 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.750866    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm7mj\" (UniqueName: \"kubernetes.io/projected/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-api-access-jm7mj\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.750992 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.750950    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc886a86-467f-4220-b0ba-2a3319fc7d6e-data-volume\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.750992 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.750985    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc886a86-467f-4220-b0ba-2a3319fc7d6e-crio-socket\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.755754 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.755736    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:11.813773 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.813749    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:11.851617 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.851587    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc886a86-467f-4220-b0ba-2a3319fc7d6e-data-volume\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.851688 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.851653    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc886a86-467f-4220-b0ba-2a3319fc7d6e-crio-socket\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.851739 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.851723    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.851781 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.851753    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.851829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.851777    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm7mj\" (UniqueName: \"kubernetes.io/projected/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-api-access-jm7mj\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.851829 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:11.851802    2600 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:46:11.851916 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:11.851883    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:12.351860101 +0000 UTC m=+46.509726798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : configmap "kube-rbac-proxy" not found
Jul 24 15:46:11.851916 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.851881    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc886a86-467f-4220-b0ba-2a3319fc7d6e-crio-socket\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.852017 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:11.851916    2600 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:11.852017 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.851946    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc886a86-467f-4220-b0ba-2a3319fc7d6e-data-volume\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:11.852017 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:11.851979    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:12.351961566 +0000 UTC m=+46.509828257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:11.862075 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:11.862056    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm7mj\" (UniqueName: \"kubernetes.io/projected/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-api-access-jm7mj\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:12.355568 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:12.355530    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:12.355568 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:12.355565    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:12.356004 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:12.355678    2600 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:46:12.356004 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:12.355688    2600 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:12.356004 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:12.355743    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:13.355728386 +0000 UTC m=+47.513595063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : configmap "kube-rbac-proxy" not found
Jul 24 15:46:12.356004 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:12.355758    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:13.355752124 +0000 UTC m=+47.513618800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:13.319751 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:13.319691    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:13.363995 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:13.363965    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:13.364327 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:13.364002    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:13.364327 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:13.364078    2600 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:46:13.364327 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:13.364096    2600 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:13.364327 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:13.364137    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:15.364121585 +0000 UTC m=+49.521988261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : configmap "kube-rbac-proxy" not found
Jul 24 15:46:13.364327 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:13.364151    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:15.364144787 +0000 UTC m=+49.522011464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:13.387291 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:13.387267    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:13.679682 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:13.679644    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:13.765981 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:13.765952    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ssqh6_0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9/dns-node-resolver/0.log"
Jul 24 15:46:13.780617 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:13.780585    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:14.248955 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:14.248923    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:14.567310 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:14.567243    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ftg7x_458477e6-def3-441c-9cdd-59e70e711840/node-ca/0.log"
Jul 24 15:46:15.379896 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:15.379862    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:15.379896 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:15.379894    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:15.380094 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:15.379982    2600 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:46:15.380094 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:15.379994    2600 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:15.380094 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:15.380048    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:19.380033611 +0000 UTC m=+53.537900287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:15.380094 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:15.380060    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:19.380054359 +0000 UTC m=+53.537921037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : configmap "kube-rbac-proxy" not found
Jul 24 15:46:15.567834 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:15.567807    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jpwf4_8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c/serve-healthcheck-canary/0.log"
Jul 24 15:46:16.358114 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:16.358083    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:16.552403 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:16.552369    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:16.653571 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:16.653500    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:16.713705 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:16.713675    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:17.078534 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:17.078504    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:17.305621 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:17.305581    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:17.599029 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:17.598990    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:17.599221 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:17.599048    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:17.599221 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:17.599127    2600 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:46:17.599221 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:17.599166    2600 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 15:46:17.599221 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:17.599180    2600 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77695b44b7-tvnps: secret "image-registry-tls" not found
Jul 24 15:46:17.599221 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:17.599190    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls podName:98efb8c4-0bf4-4f4c-9018-69c95f0d2f01 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:33.599173942 +0000 UTC m=+67.757040623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls") pod "dns-default-rvkc6" (UID: "98efb8c4-0bf4-4f4c-9018-69c95f0d2f01") : secret "dns-default-metrics-tls" not found
Jul 24 15:46:17.599402 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:17.599226    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls podName:7756e437-15c8-419f-8b9c-a2c3a7327ab9 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:33.599211253 +0000 UTC m=+67.757077944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls") pod "image-registry-77695b44b7-tvnps" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9") : secret "image-registry-tls" not found
Jul 24 15:46:17.868462 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:17.868384    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:18.308148 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:18.308115    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:18.658826 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:18.658745    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:19.057239 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:19.057209    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:19.260164 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:19.260130    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:19.412390 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:19.412297    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:19.412390 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:19.412331    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:19.412635 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:19.412427    2600 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:46:19.412635 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:19.412442    2600 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:19.412635 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:19.412496    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:27.412481666 +0000 UTC m=+61.570348342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:46:19.412635 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:19.412570    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm podName:bc886a86-467f-4220-b0ba-2a3319fc7d6e nodeName:}" failed. No retries permitted until 2026-07-24 15:46:27.412548865 +0000 UTC m=+61.570415546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4f88q" (UID: "bc886a86-467f-4220-b0ba-2a3319fc7d6e") : configmap "kube-rbac-proxy" not found
Jul 24 15:46:19.653175 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:19.653143    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:20.057152 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:20.057121    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:20.251444 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:20.251409    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:20.459520 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:20.459493    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:20.589105 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:20.589074    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:20.863944 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:20.863858    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:21.059834 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:21.059801    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:21.126519 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:21.126448    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:21.263641 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:21.263591    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:21.657591 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:21.657561    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:21.759321 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:21.759292    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:21.813018 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:21.812992    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:22.325055 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:22.325022    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:22.460722 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:22.460689    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:22.582057 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:22.581992    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:22.862822 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:22.862736    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:23.266187 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:23.266150    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:23.662309 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:23.662229    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:24.253878 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:24.253843    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:24.593363 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:24.593287    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:24.693587 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:24.693555    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:25.109125 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:25.109092    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:25.271289 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:25.271255    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:25.666371 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:25.666332    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:26.462296 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:26.462266    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:26.663579 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:26.663545    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:26.853007 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:26.852918    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:27.055263 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.055237    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:27.472193 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.472155    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:27.472193 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.472193    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:27.472889 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.472869    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc886a86-467f-4220-b0ba-2a3319fc7d6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:27.474553 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.474533    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc886a86-467f-4220-b0ba-2a3319fc7d6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f88q\" (UID: \"bc886a86-467f-4220-b0ba-2a3319fc7d6e\") " pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:27.505101 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.505075    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vfsm2\""
Jul 24 15:46:27.513189 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.513162    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4f88q"
Jul 24 15:46:27.593313 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.593284    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgljr"
Jul 24 15:46:27.631232 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.631177    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:27.657792 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.657759    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4f88q"]
Jul 24 15:46:27.660912 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:27.660885    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc886a86_467f_4220_b0ba_2a3319fc7d6e.slice/crio-56eb99d47a7984840b0ed855bcce96107b595205dd9d65ec4b06b1d4836398b1 WatchSource:0}: Error finding container 56eb99d47a7984840b0ed855bcce96107b595205dd9d65ec4b06b1d4836398b1: Status 404 returned error can't find the container with id 56eb99d47a7984840b0ed855bcce96107b595205dd9d65ec4b06b1d4836398b1
Jul 24 15:46:27.733111 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:27.733036    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:28.665011 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:28.664975    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4f88q" event={"ID":"bc886a86-467f-4220-b0ba-2a3319fc7d6e","Type":"ContainerStarted","Data":"56eb99d47a7984840b0ed855bcce96107b595205dd9d65ec4b06b1d4836398b1"}
Jul 24 15:46:32.114927 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.114888    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:46:32.114927 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.114932    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:46:32.115366 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.114964    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:46:32.117871 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.117843    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 15:46:32.118709 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.118675    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 15:46:32.118838 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.118758    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 15:46:32.128497 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.128472    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b94016e-0ac6-4037-9c48-59aab4e71e3c-metrics-certs\") pod \"network-metrics-daemon-6tfmz\" (UID: \"1b94016e-0ac6-4037-9c48-59aab4e71e3c\") " pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:46:32.128628 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.128512    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/498b446f-d1a3-4f46-ae0a-489ed8f0fa92-original-pull-secret\") pod \"global-pull-secret-syncer-9x7gq\" (UID: \"498b446f-d1a3-4f46-ae0a-489ed8f0fa92\") " pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:46:32.128628 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.128561    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 15:46:32.139150 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.139121    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz769\" (UniqueName: \"kubernetes.io/projected/13489cf3-a86e-4225-9873-3f81d8c4da91-kube-api-access-dz769\") pod \"network-check-target-qqqpc\" (UID: \"13489cf3-a86e-4225-9873-3f81d8c4da91\") " pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:46:32.213250 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.213223    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pqxfk\""
Jul 24 15:46:32.218724 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.218701    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cbp7q\""
Jul 24 15:46:32.219681 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.219660    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tfmz"
Jul 24 15:46:32.223685 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.223665    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9x7gq"
Jul 24 15:46:32.226556 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.226538    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:46:32.260081 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.260041    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"]
Jul 24 15:46:32.262829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.262810    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.265694 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.265657    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 24 15:46:32.265802 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.265749    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 15:46:32.265943 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.265925    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 24 15:46:32.266106 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.265940    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 24 15:46:32.266106 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.265971    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 15:46:32.266870 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.266749    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 24 15:46:32.266870 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.266764    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 15:46:32.278178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.278156    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"]
Jul 24 15:46:32.312171 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.312149    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77695b44b7-tvnps"]
Jul 24 15:46:32.312378 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:32.312359    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-77695b44b7-tvnps" podUID="7756e437-15c8-419f-8b9c-a2c3a7327ab9"
Jul 24 15:46:32.316101 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.316078    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rdtt\" (UniqueName: \"kubernetes.io/projected/1f3ccb3a-4105-4836-a6ab-0a8d00023908-kube-api-access-8rdtt\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.316187 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.316120    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.316241 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.316185    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-hub\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.316241 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.316211    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.316336 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.316248    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-ca\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.316336 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.316270    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3ccb3a-4105-4836-a6ab-0a8d00023908-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.395167 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.395102    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:32.417394 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.417372    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.417512 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.417409    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-hub\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.417512 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.417443    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.417651 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.417564    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-ca\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.417651 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.417601    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3ccb3a-4105-4836-a6ab-0a8d00023908-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.417764 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.417687    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rdtt\" (UniqueName: \"kubernetes.io/projected/1f3ccb3a-4105-4836-a6ab-0a8d00023908-kube-api-access-8rdtt\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.418707 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.418674    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3ccb3a-4105-4836-a6ab-0a8d00023908-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.420526 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.420503    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.420657 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.420593    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-ca\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.420837 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.420820    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-hub\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.420987 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.420968    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1f3ccb3a-4105-4836-a6ab-0a8d00023908-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.429414 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.429388    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rdtt\" (UniqueName: \"kubernetes.io/projected/1f3ccb3a-4105-4836-a6ab-0a8d00023908-kube-api-access-8rdtt\") pod \"cluster-proxy-proxy-agent-85c9cc566c-j26vq\" (UID: \"1f3ccb3a-4105-4836-a6ab-0a8d00023908\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.523856 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.523793    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:32.580050 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.580015    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"
Jul 24 15:46:32.636896 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.636831    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:32.642936 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.642882    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9x7gq"]
Jul 24 15:46:32.647666 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:32.647639    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498b446f_d1a3_4f46_ae0a_489ed8f0fa92.slice/crio-8e41a608f3147d1dc4bab35a60300d672f94e115fe0bbbd2cfa22073934e77cf WatchSource:0}: Error finding container 8e41a608f3147d1dc4bab35a60300d672f94e115fe0bbbd2cfa22073934e77cf: Status 404 returned error can't find the container with id 8e41a608f3147d1dc4bab35a60300d672f94e115fe0bbbd2cfa22073934e77cf
Jul 24 15:46:32.670586 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.669637    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qqqpc"]
Jul 24 15:46:32.671998 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:32.671973    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13489cf3_a86e_4225_9873_3f81d8c4da91.slice/crio-59a4ce175d3548f74f2cf27ff1c7dff980befd6e2fbea25585635bcd0e69e744 WatchSource:0}: Error finding container 59a4ce175d3548f74f2cf27ff1c7dff980befd6e2fbea25585635bcd0e69e744: Status 404 returned error can't find the container with id 59a4ce175d3548f74f2cf27ff1c7dff980befd6e2fbea25585635bcd0e69e744
Jul 24 15:46:32.676898 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.676871    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4f88q" event={"ID":"bc886a86-467f-4220-b0ba-2a3319fc7d6e","Type":"ContainerStarted","Data":"4b6d37fe7d521b49d04243a7e11b49671bea35022e2bb40a40e5805025e2c620"}
Jul 24 15:46:32.678660 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.678638    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9x7gq" event={"ID":"498b446f-d1a3-4f46-ae0a-489ed8f0fa92","Type":"ContainerStarted","Data":"8e41a608f3147d1dc4bab35a60300d672f94e115fe0bbbd2cfa22073934e77cf"}
Jul 24 15:46:32.680025 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.680006    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:32.680291 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.680268    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qqqpc" event={"ID":"13489cf3-a86e-4225-9873-3f81d8c4da91","Type":"ContainerStarted","Data":"59a4ce175d3548f74f2cf27ff1c7dff980befd6e2fbea25585635bcd0e69e744"}
Jul 24 15:46:32.690754 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.690731    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:32.720108 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720088    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-installation-pull-secrets\") pod \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") "
Jul 24 15:46:32.720227 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720135    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-bound-sa-token\") pod \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") "
Jul 24 15:46:32.720227 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720160    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7756e437-15c8-419f-8b9c-a2c3a7327ab9-ca-trust-extracted\") pod \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") "
Jul 24 15:46:32.720227 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720178    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-certificates\") pod \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") "
Jul 24 15:46:32.720227 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720197    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4ldm\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-kube-api-access-j4ldm\") pod \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") "
Jul 24 15:46:32.720428 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720233    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-trusted-ca\") pod \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") "
Jul 24 15:46:32.720428 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720261    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-image-registry-private-configuration\") pod \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") "
Jul 24 15:46:32.720540 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720499    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7756e437-15c8-419f-8b9c-a2c3a7327ab9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7756e437-15c8-419f-8b9c-a2c3a7327ab9" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:46:32.720590 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720563    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7756e437-15c8-419f-8b9c-a2c3a7327ab9" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:46:32.720705 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.720672    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7756e437-15c8-419f-8b9c-a2c3a7327ab9" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:46:32.722476 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.722445    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-kube-api-access-j4ldm" (OuterVolumeSpecName: "kube-api-access-j4ldm") pod "7756e437-15c8-419f-8b9c-a2c3a7327ab9" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9"). InnerVolumeSpecName "kube-api-access-j4ldm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:32.722567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.722493    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7756e437-15c8-419f-8b9c-a2c3a7327ab9" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:46:32.722567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.722533    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7756e437-15c8-419f-8b9c-a2c3a7327ab9" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:32.722692 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.722672    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7756e437-15c8-419f-8b9c-a2c3a7327ab9" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:46:32.725796 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.725777    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:32.740591 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.740570    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq"]
Jul 24 15:46:32.743427 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:32.743404    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f3ccb3a_4105_4836_a6ab_0a8d00023908.slice/crio-5748d80e3e07b8395421a41cd4b54ef6fe02398d8915e6a3cf95de043ec1c06c WatchSource:0}: Error finding container 5748d80e3e07b8395421a41cd4b54ef6fe02398d8915e6a3cf95de043ec1c06c: Status 404 returned error can't find the container with id 5748d80e3e07b8395421a41cd4b54ef6fe02398d8915e6a3cf95de043ec1c06c
Jul 24 15:46:32.820817 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.820793    2600 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-image-registry-private-configuration\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:46:32.820817 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.820813    2600 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7756e437-15c8-419f-8b9c-a2c3a7327ab9-installation-pull-secrets\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:46:32.820932 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.820824    2600 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-bound-sa-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:46:32.820932 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.820833    2600 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7756e437-15c8-419f-8b9c-a2c3a7327ab9-ca-trust-extracted\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:46:32.820932 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.820841    2600 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-certificates\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:46:32.820932 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.820849    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4ldm\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-kube-api-access-j4ldm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:46:32.820932 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.820857    2600 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7756e437-15c8-419f-8b9c-a2c3a7327ab9-trusted-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:46:32.831669 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.831645    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:32.858820 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.858800    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tfmz"]
Jul 24 15:46:32.861634 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:32.861617    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b94016e_0ac6_4037_9c48_59aab4e71e3c.slice/crio-01d9a6a39a406d3b60adf7e51461f4466396d316f3f147e42c05bf356d495af9 WatchSource:0}: Error finding container 01d9a6a39a406d3b60adf7e51461f4466396d316f3f147e42c05bf356d495af9: Status 404 returned error can't find the container with id 01d9a6a39a406d3b60adf7e51461f4466396d316f3f147e42c05bf356d495af9
Jul 24 15:46:32.913619 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:32.913556    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:33.627804 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.627763    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:33.628275 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.627829    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:33.635539 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.635485    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"image-registry-77695b44b7-tvnps\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") " pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:33.639907 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.639879    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98efb8c4-0bf4-4f4c-9018-69c95f0d2f01-metrics-tls\") pod \"dns-default-rvkc6\" (UID: \"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01\") " pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:33.691967 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.691903    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tfmz" event={"ID":"1b94016e-0ac6-4037-9c48-59aab4e71e3c","Type":"ContainerStarted","Data":"01d9a6a39a406d3b60adf7e51461f4466396d316f3f147e42c05bf356d495af9"}
Jul 24 15:46:33.695647 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.695623    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77695b44b7-tvnps"
Jul 24 15:46:33.695943 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.695901    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq" event={"ID":"1f3ccb3a-4105-4836-a6ab-0a8d00023908","Type":"ContainerStarted","Data":"5748d80e3e07b8395421a41cd4b54ef6fe02398d8915e6a3cf95de043ec1c06c"}
Jul 24 15:46:33.728728 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.728553    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") pod \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\" (UID: \"7756e437-15c8-419f-8b9c-a2c3a7327ab9\") "
Jul 24 15:46:33.747108 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.747077    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7756e437-15c8-419f-8b9c-a2c3a7327ab9" (UID: "7756e437-15c8-419f-8b9c-a2c3a7327ab9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:46:33.829783 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.829750    2600 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7756e437-15c8-419f-8b9c-a2c3a7327ab9-registry-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:46:33.872203 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.872175    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vwj8g\""
Jul 24 15:46:33.880333 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:33.880271    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:34.040824 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:34.040794    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77695b44b7-tvnps"]
Jul 24 15:46:34.044304 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:34.044276    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77695b44b7-tvnps"]
Jul 24 15:46:34.083529 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:34.083417    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rvkc6"]
Jul 24 15:46:34.404229 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:34.404024    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7756e437-15c8-419f-8b9c-a2c3a7327ab9" path="/var/lib/kubelet/pods/7756e437-15c8-419f-8b9c-a2c3a7327ab9/volumes"
Jul 24 15:46:34.713740 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:34.713704    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvkc6" event={"ID":"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01","Type":"ContainerStarted","Data":"a600ab632d8ee62b1ecfd7efb45a70d5478108410ad003eba6a065a0058d75d3"}
Jul 24 15:46:40.551994 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.551953    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:40.714676 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.714619    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:40.717049 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.717022    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"]
Jul 24 15:46:40.719392 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.719375    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"
Jul 24 15:46:40.721817 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.721800    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 24 15:46:40.721955 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.721938    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fsttx\""
Jul 24 15:46:40.730023 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.729995    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"]
Jul 24 15:46:40.782395 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.782366    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d354d76a-9037-4f01-940f-e0a6bdd985be-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-qnlqt\" (UID: \"d354d76a-9037-4f01-940f-e0a6bdd985be\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"
Jul 24 15:46:40.805002 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.804925    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:40.883146 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.883113    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d354d76a-9037-4f01-940f-e0a6bdd985be-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-qnlqt\" (UID: \"d354d76a-9037-4f01-940f-e0a6bdd985be\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"
Jul 24 15:46:40.886119 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:40.886091    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d354d76a-9037-4f01-940f-e0a6bdd985be-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-qnlqt\" (UID: \"d354d76a-9037-4f01-940f-e0a6bdd985be\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"
Jul 24 15:46:41.029537 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:41.029509    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"
Jul 24 15:46:41.177497 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:41.177458    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:41.276074 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:41.276036    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:41.331656 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:41.331621    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:41.398234 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:41.398184    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:41.762583 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:41.762547    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:41.824399 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:41.824310    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:42.261341 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.261215    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"]
Jul 24 15:46:42.265331 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:42.265302    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd354d76a_9037_4f01_940f_e0a6bdd985be.slice/crio-67606012b5ce8c4f1eae3509071df548c0e881aa4e5930e9947c7dd0117f96b4 WatchSource:0}: Error finding container 67606012b5ce8c4f1eae3509071df548c0e881aa4e5930e9947c7dd0117f96b4: Status 404 returned error can't find the container with id 67606012b5ce8c4f1eae3509071df548c0e881aa4e5930e9947c7dd0117f96b4
Jul 24 15:46:42.739513 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.739479    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4f88q" event={"ID":"bc886a86-467f-4220-b0ba-2a3319fc7d6e","Type":"ContainerStarted","Data":"120c1b9e0ef089f0b230e31b4d4f20c5a843d97688b1c5e96dfa0125f7e5b8a9"}
Jul 24 15:46:42.741373 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.741334    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9x7gq" event={"ID":"498b446f-d1a3-4f46-ae0a-489ed8f0fa92","Type":"ContainerStarted","Data":"daa1ce5da3de81876091e2d282920f7df1f293e72f199a6a5e593ec202a05342"}
Jul 24 15:46:42.742985 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.742955    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qqqpc" event={"ID":"13489cf3-a86e-4225-9873-3f81d8c4da91","Type":"ContainerStarted","Data":"9920dc1d7e6de0339b61666f7273fc79e0ad7c3cd15ee27cf5553106b5e0b2fb"}
Jul 24 15:46:42.743114 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.743011    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:46:42.745062 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.745029    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tfmz" event={"ID":"1b94016e-0ac6-4037-9c48-59aab4e71e3c","Type":"ContainerStarted","Data":"a080a010067ac675157a671e418247389c94c7685235aa24690184b4240db299"}
Jul 24 15:46:42.745191 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.745092    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tfmz" event={"ID":"1b94016e-0ac6-4037-9c48-59aab4e71e3c","Type":"ContainerStarted","Data":"488947e098b7014bff7973e6310dd2879b3e264e39053eea4c0067cc18689872"}
Jul 24 15:46:42.747476 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.747448    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq" event={"ID":"1f3ccb3a-4105-4836-a6ab-0a8d00023908","Type":"ContainerStarted","Data":"e6e6375510d438adcfb5ec9d2f6edcda83d62b2708e2daff6deb6951ffe4661c"}
Jul 24 15:46:42.747583 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.747493    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq" event={"ID":"1f3ccb3a-4105-4836-a6ab-0a8d00023908","Type":"ContainerStarted","Data":"b4939215747dae5efe7b107ae75671ab5ab5126c0ed884144472548f5a65077e"}
Jul 24 15:46:42.747583 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.747512    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq" event={"ID":"1f3ccb3a-4105-4836-a6ab-0a8d00023908","Type":"ContainerStarted","Data":"318c8c74021bdfc7bdb144314ee75ab4133156c6a2ac44132d807b0e59e804ef"}
Jul 24 15:46:42.749393 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.749328    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvkc6" event={"ID":"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01","Type":"ContainerStarted","Data":"2df0f868c6114fd78262855bb11a15ffbaa80620dd4b5280f9f7b7609605fae2"}
Jul 24 15:46:42.749393 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.749392    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:42.749811 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.749419    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvkc6" event={"ID":"98efb8c4-0bf4-4f4c-9018-69c95f0d2f01","Type":"ContainerStarted","Data":"970d8bd9a40f0591e8ed97e5e7b7f99cedd0dc9e9216fafd383c43c447aaceb0"}
Jul 24 15:46:42.750722 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.750703    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt" event={"ID":"d354d76a-9037-4f01-940f-e0a6bdd985be","Type":"ContainerStarted","Data":"67606012b5ce8c4f1eae3509071df548c0e881aa4e5930e9947c7dd0117f96b4"}
Jul 24 15:46:42.777832 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.777779    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c9cc566c-j26vq" podStartSLOduration=1.430883179 podStartE2EDuration="10.777760205s" totalImagesPullingTime="9.346877026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:46:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:42.776461121 +0000 UTC m=+76.934327821" watchObservedRunningTime="2026-07-24 15:46:42.777760205 +0000 UTC m=+76.935626906"
Jul 24 15:46:42.778256 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.778032    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9x7gq" podStartSLOduration=66.341952525 podStartE2EDuration="1m15.778022873s" totalImagesPullingTime="9.436070348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:42.758401018 +0000 UTC m=+76.916267718" watchObservedRunningTime="2026-07-24 15:46:42.778022873 +0000 UTC m=+76.935889552"
Jul 24 15:46:42.790843 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.790803    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6tfmz" podStartSLOduration=68.137298884 podStartE2EDuration="1m16.790789126s" totalImagesPullingTime="8.653490242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:42.790541694 +0000 UTC m=+76.948408393" watchObservedRunningTime="2026-07-24 15:46:42.790789126 +0000 UTC m=+76.948655840"
Jul 24 15:46:42.809868 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.809821    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qqqpc" podStartSLOduration=67.393438737 podStartE2EDuration="1m16.809803239s" totalImagesPullingTime="9.416364502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:42.809755244 +0000 UTC m=+76.967621943" watchObservedRunningTime="2026-07-24 15:46:42.809803239 +0000 UTC m=+76.967669940"
Jul 24 15:46:42.826678 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.826640    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rvkc6" podStartSLOduration=34.361311935 podStartE2EDuration="41.826601275s" totalImagesPullingTime="7.46528934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:42.825965399 +0000 UTC m=+76.983832100" watchObservedRunningTime="2026-07-24 15:46:42.826601275 +0000 UTC m=+76.984467974"
Jul 24 15:46:42.890796 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:42.890767    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:43.156225 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:43.156160    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:43.255167 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:43.255141    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:44.760268 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:44.760227    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt" event={"ID":"d354d76a-9037-4f01-940f-e0a6bdd985be","Type":"ContainerStarted","Data":"3fee6a840dae5aeeac1c179f4782ab48d60e78f719192e47b58faec36b0357f8"}
Jul 24 15:46:44.760742 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:44.760577    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"
Jul 24 15:46:44.765972 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:44.765945    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt"
Jul 24 15:46:44.787767 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:44.787715    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-qnlqt" podStartSLOduration=3.218348649 podStartE2EDuration="4.787702073s" totalImagesPullingTime="1.569353424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:44.787002553 +0000 UTC m=+78.944869251" watchObservedRunningTime="2026-07-24 15:46:44.787702073 +0000 UTC m=+78.945568772"
Jul 24 15:46:45.741729 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.741687    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:45.765876 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.765809    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4f88q" event={"ID":"bc886a86-467f-4220-b0ba-2a3319fc7d6e","Type":"ContainerStarted","Data":"fd9b25ed1dc5ca23b46ef2bd7663fbf26712a3b2ad5912713430338734b340d0"}
Jul 24 15:46:45.782436 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.782412    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"]
Jul 24 15:46:45.784343 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.784329    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.787090 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.787070    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 15:46:45.787090 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.787080    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 15:46:45.787261 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.787077    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 15:46:45.787261 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.787234    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 15:46:45.788066 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.788050    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xp7k2\""
Jul 24 15:46:45.788148 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.788048    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 15:46:45.790744 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.790635    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4f88q" podStartSLOduration=17.024907381 podStartE2EDuration="34.790599145s" totalImagesPullingTime="17.765691764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:46:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:45.789746859 +0000 UTC m=+79.947613583" watchObservedRunningTime="2026-07-24 15:46:45.790599145 +0000 UTC m=+79.948465850"
Jul 24 15:46:45.797061 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.797042    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"]
Jul 24 15:46:45.820966 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.820945    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:45.821948 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.821932    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.822014 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.821956    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e0e2c51-36e6-4e07-9022-738f36cf31f9-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.822014 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.821994    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp4l4\" (UniqueName: \"kubernetes.io/projected/8e0e2c51-36e6-4e07-9022-738f36cf31f9-kube-api-access-lp4l4\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.822100 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.822040    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.922817 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.922764    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.922817 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.922806    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.922967 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.922823    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e0e2c51-36e6-4e07-9022-738f36cf31f9-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.922967 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:45.922910    2600 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 24 15:46:45.922967 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.922952    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp4l4\" (UniqueName: \"kubernetes.io/projected/8e0e2c51-36e6-4e07-9022-738f36cf31f9-kube-api-access-lp4l4\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.923079 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:45.922982    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-tls podName:8e0e2c51-36e6-4e07-9022-738f36cf31f9 nodeName:}" failed. No retries permitted until 2026-07-24 15:46:46.422963011 +0000 UTC m=+80.580829705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-p7ggw" (UID: "8e0e2c51-36e6-4e07-9022-738f36cf31f9") : secret "prometheus-operator-tls" not found
Jul 24 15:46:45.923490 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.923471    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e0e2c51-36e6-4e07-9022-738f36cf31f9-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.925178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.925152    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:45.931227 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:45.931208    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp4l4\" (UniqueName: \"kubernetes.io/projected/8e0e2c51-36e6-4e07-9022-738f36cf31f9-kube-api-access-lp4l4\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:46.070467 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:46.070439    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:46.427232 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:46.427202    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:46.429555 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:46.429529    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0e2c51-36e6-4e07-9022-738f36cf31f9-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-p7ggw\" (UID: \"8e0e2c51-36e6-4e07-9022-738f36cf31f9\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:46.693315 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:46.693224    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"
Jul 24 15:46:46.812150 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:46.812124    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-p7ggw"]
Jul 24 15:46:46.815010 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:46.814983    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0e2c51_36e6_4e07_9022_738f36cf31f9.slice/crio-59fb9b3222359b46c30d296fdbb6d48659103ed9b5893d84c85f4ff78ef2fdac WatchSource:0}: Error finding container 59fb9b3222359b46c30d296fdbb6d48659103ed9b5893d84c85f4ff78ef2fdac: Status 404 returned error can't find the container with id 59fb9b3222359b46c30d296fdbb6d48659103ed9b5893d84c85f4ff78ef2fdac
Jul 24 15:46:47.774665 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:47.774627    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw" event={"ID":"8e0e2c51-36e6-4e07-9022-738f36cf31f9","Type":"ContainerStarted","Data":"59fb9b3222359b46c30d296fdbb6d48659103ed9b5893d84c85f4ff78ef2fdac"}
Jul 24 15:46:48.544535 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:48.544458    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:48.779203 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:48.779171    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw" event={"ID":"8e0e2c51-36e6-4e07-9022-738f36cf31f9","Type":"ContainerStarted","Data":"115e2cf3285212b6ffc58fe50be7c5b19d1341241d043ca19beded13e13d28bc"}
Jul 24 15:46:48.779391 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:48.779228    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw" event={"ID":"8e0e2c51-36e6-4e07-9022-738f36cf31f9","Type":"ContainerStarted","Data":"5423d2feb780d37c3cd33dce72530a8a889b3b60547b3ed8481ab77df8f6b735"}
Jul 24 15:46:48.797659 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:48.797570    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-p7ggw" podStartSLOduration=2.32132998 podStartE2EDuration="3.797552953s" totalImagesPullingTime="1.476222973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:48.796163788 +0000 UTC m=+82.954030487" watchObservedRunningTime="2026-07-24 15:46:48.797552953 +0000 UTC m=+82.955419653"
Jul 24 15:46:50.887232 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:50.887195    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:51.098173 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.098128    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:51.158661 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.158568    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m6xpk"]
Jul 24 15:46:51.162068 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.162054    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.164401 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.164380    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 15:46:51.164691 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.164671    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 15:46:51.164823 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.164722    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7fcwn\""
Jul 24 15:46:51.164823 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.164757    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 15:46:51.187941 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.187918    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:51.258223 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258201    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.258323 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258228    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-tls\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.258323 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258245    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm5mc\" (UniqueName: \"kubernetes.io/projected/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-kube-api-access-hm5mc\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.258323 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258263    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-wtmp\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.258323 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258305    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-root\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.258534 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258357    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-sys\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.258534 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258411    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-metrics-client-ca\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.258534 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258440    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.258534 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.258477    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-textfile\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.359816 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359787    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-metrics-client-ca\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.359990 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359822    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.359990 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359844    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-textfile\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.359990 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359890    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.359990 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359907    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-tls\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.359990 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359921    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm5mc\" (UniqueName: \"kubernetes.io/projected/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-kube-api-access-hm5mc\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.359990 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359944    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-wtmp\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.359990 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359965    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-root\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.360334 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.359995    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-sys\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.360334 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.360071    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-root\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.360334 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:51.360078    2600 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 15:46:51.360334 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.360117    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-sys\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.360334 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:46:51.360171    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-tls podName:8d68260c-fc8c-49b2-9a6c-a6537eba1e1a nodeName:}" failed. No retries permitted until 2026-07-24 15:46:51.860148623 +0000 UTC m=+86.018015302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-tls") pod "node-exporter-m6xpk" (UID: "8d68260c-fc8c-49b2-9a6c-a6537eba1e1a") : secret "node-exporter-tls" not found
Jul 24 15:46:51.360334 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.360166    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-wtmp\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.360553 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.360453    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.360632 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.360599    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-metrics-client-ca\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.360672 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.360644    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-textfile\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.362440 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.362415    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.370409 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.370390    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm5mc\" (UniqueName: \"kubernetes.io/projected/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-kube-api-access-hm5mc\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.385110 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.385089    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:51.485165 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.485118    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:51.587046 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.587018    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:51.688963 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.688929    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:51.787111 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.787030    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:51.864234 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.864211    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-tls\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:51.866644 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:51.866625    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d68260c-fc8c-49b2-9a6c-a6537eba1e1a-node-exporter-tls\") pod \"node-exporter-m6xpk\" (UID: \"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a\") " pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:52.075819 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:52.075548    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m6xpk"
Jul 24 15:46:52.088135 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:52.088102    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d68260c_fc8c_49b2_9a6c_a6537eba1e1a.slice/crio-48023b96d9e94427729738ae3d7f2f97aa54c483d3295ed04d3cd0d4d7fbe656 WatchSource:0}: Error finding container 48023b96d9e94427729738ae3d7f2f97aa54c483d3295ed04d3cd0d4d7fbe656: Status 404 returned error can't find the container with id 48023b96d9e94427729738ae3d7f2f97aa54c483d3295ed04d3cd0d4d7fbe656
Jul 24 15:46:52.116353 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:52.116330    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:52.209199 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:52.209167    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:52.328715 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:52.328588    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:52.794267 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:52.794235    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6xpk" event={"ID":"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a","Type":"ContainerStarted","Data":"48023b96d9e94427729738ae3d7f2f97aa54c483d3295ed04d3cd0d4d7fbe656"}
Jul 24 15:46:53.762051 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:53.762015    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rvkc6"
Jul 24 15:46:53.799865 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:53.799835    2600 generic.go:356] "Generic (PLEG): container finished" podID="8d68260c-fc8c-49b2-9a6c-a6537eba1e1a" containerID="c79ea417bfb982a2633bebd669de0fc39fafec65aff3098182a5d26da8c10934" exitCode=0
Jul 24 15:46:53.799998 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:53.799914    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6xpk" event={"ID":"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a","Type":"ContainerDied","Data":"c79ea417bfb982a2633bebd669de0fc39fafec65aff3098182a5d26da8c10934"}
Jul 24 15:46:54.035125 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.035056    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-rxjjs"]
Jul 24 15:46:54.040104 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.040079    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-rxjjs"
Jul 24 15:46:54.042646 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.042596    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 15:46:54.042770 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.042663    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 15:46:54.042770 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.042689    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qzg6s\""
Jul 24 15:46:54.049809 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.049785    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-rxjjs"]
Jul 24 15:46:54.049922 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.049827    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:54.082358 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.082335    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fh56\" (UniqueName: \"kubernetes.io/projected/2e14f60f-5082-4447-8d5e-a1927cbcc4d5-kube-api-access-6fh56\") pod \"downloads-7c97dc4555-rxjjs\" (UID: \"2e14f60f-5082-4447-8d5e-a1927cbcc4d5\") " pod="openshift-console/downloads-7c97dc4555-rxjjs"
Jul 24 15:46:54.145961 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.145926    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:54.182846 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.182818    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fh56\" (UniqueName: \"kubernetes.io/projected/2e14f60f-5082-4447-8d5e-a1927cbcc4d5-kube-api-access-6fh56\") pod \"downloads-7c97dc4555-rxjjs\" (UID: \"2e14f60f-5082-4447-8d5e-a1927cbcc4d5\") " pod="openshift-console/downloads-7c97dc4555-rxjjs"
Jul 24 15:46:54.192362 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.192335    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fh56\" (UniqueName: \"kubernetes.io/projected/2e14f60f-5082-4447-8d5e-a1927cbcc4d5-kube-api-access-6fh56\") pod \"downloads-7c97dc4555-rxjjs\" (UID: \"2e14f60f-5082-4447-8d5e-a1927cbcc4d5\") " pod="openshift-console/downloads-7c97dc4555-rxjjs"
Jul 24 15:46:54.245842 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.245818    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:54.347134 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.347079    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:54.352038 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.352020    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-rxjjs"
Jul 24 15:46:54.446414 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.446388    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:54.483207 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.483161    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-rxjjs"]
Jul 24 15:46:54.486625 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:46:54.486585    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e14f60f_5082_4447_8d5e_a1927cbcc4d5.slice/crio-071cb4d9b523522b2f049baf244a38ec220f8dd39d39078cf2d4085f532973ef WatchSource:0}: Error finding container 071cb4d9b523522b2f049baf244a38ec220f8dd39d39078cf2d4085f532973ef: Status 404 returned error can't find the container with id 071cb4d9b523522b2f049baf244a38ec220f8dd39d39078cf2d4085f532973ef
Jul 24 15:46:54.546644 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.546593    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:54.700361 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.700336    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:54.801542 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.801518    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:54.805550 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.805526    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6xpk" event={"ID":"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a","Type":"ContainerStarted","Data":"706b8dda5af4850efe4f504b346b28c27a364e9f7ec56aa123b4ad9289d228fe"}
Jul 24 15:46:54.805686 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.805573    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6xpk" event={"ID":"8d68260c-fc8c-49b2-9a6c-a6537eba1e1a","Type":"ContainerStarted","Data":"bfc9147d1bb6e0e0f8f5de62faa84352267457e10e02aef8bebc52e952680c45"}
Jul 24 15:46:54.806588 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.806570    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-rxjjs" event={"ID":"2e14f60f-5082-4447-8d5e-a1927cbcc4d5","Type":"ContainerStarted","Data":"071cb4d9b523522b2f049baf244a38ec220f8dd39d39078cf2d4085f532973ef"}
Jul 24 15:46:54.824552 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.824516    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m6xpk" podStartSLOduration=2.925393598 podStartE2EDuration="3.82450258s" totalImagesPullingTime="827.338125ms" totalInitContainerRuntime="71.770857ms" isStatefulPod=true podCreationTimestamp="2026-07-24 15:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:54.823925166 +0000 UTC m=+88.981791866" watchObservedRunningTime="2026-07-24 15:46:54.82450258 +0000 UTC m=+88.982369270"
Jul 24 15:46:54.910114 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:54.910083    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:55.110827 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.110747    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:55.302505 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.302474    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:55.359218 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.359191    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:55.427432 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.427403    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65575967c9-cm682"]
Jul 24 15:46:55.429649 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.429599    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.432414 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.432199    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 15:46:55.432414 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.432214    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 15:46:55.433258 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.433233    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 15:46:55.433408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.433286    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jr82t\""
Jul 24 15:46:55.433408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.433331    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-11ojn7vdqeiqi\""
Jul 24 15:46:55.433408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.433238    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 15:46:55.440083 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.440027    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65575967c9-cm682"]
Jul 24 15:46:55.494091 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.493801    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6b709c2-0d67-4164-891e-356c13a7e160-metrics-server-audit-profiles\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.494091 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.493877    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-secret-metrics-server-client-certs\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.494091 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.493901    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-client-ca-bundle\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.494091 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.493935    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bthxb\" (UniqueName: \"kubernetes.io/projected/a6b709c2-0d67-4164-891e-356c13a7e160-kube-api-access-bthxb\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.494091 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.493962    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b709c2-0d67-4164-891e-356c13a7e160-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.494091 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.493991    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-secret-metrics-server-tls\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.494091 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.494034    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6b709c2-0d67-4164-891e-356c13a7e160-audit-log\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.594630 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.594573    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6b709c2-0d67-4164-891e-356c13a7e160-audit-log\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.594777 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.594644    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6b709c2-0d67-4164-891e-356c13a7e160-metrics-server-audit-profiles\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.594777 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.594714    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-secret-metrics-server-client-certs\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.594777 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.594739    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-client-ca-bundle\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.594777 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.594764    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bthxb\" (UniqueName: \"kubernetes.io/projected/a6b709c2-0d67-4164-891e-356c13a7e160-kube-api-access-bthxb\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.594982 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.594783    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b709c2-0d67-4164-891e-356c13a7e160-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.594982 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.594806    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-secret-metrics-server-tls\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.594982 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.594968    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6b709c2-0d67-4164-891e-356c13a7e160-audit-log\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.595721 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.595696    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b709c2-0d67-4164-891e-356c13a7e160-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.595891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.595869    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6b709c2-0d67-4164-891e-356c13a7e160-metrics-server-audit-profiles\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.598065 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.598038    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-secret-metrics-server-tls\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.598570 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.598545    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-secret-metrics-server-client-certs\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.598683 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.598662    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6b709c2-0d67-4164-891e-356c13a7e160-client-ca-bundle\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.603402 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.603380    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bthxb\" (UniqueName: \"kubernetes.io/projected/a6b709c2-0d67-4164-891e-356c13a7e160-kube-api-access-bthxb\") pod \"metrics-server-65575967c9-cm682\" (UID: \"a6b709c2-0d67-4164-891e-356c13a7e160\") " pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.711702 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.711631    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:55.743505 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.743480    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:46:55.873159 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.873122    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65575967c9-cm682"]
Jul 24 15:46:55.898303 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:55.898275    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:56.002172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:56.002091    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:56.071654 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:56.071590    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:56.195104 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:56.195068    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:56.296864 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:56.296777    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:56.535547 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:56.535513    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:56.588256 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:56.588183    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:56.820729 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:56.820560    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65575967c9-cm682" event={"ID":"a6b709c2-0d67-4164-891e-356c13a7e160","Type":"ContainerStarted","Data":"d120ad2ea2efaac22692235f4c33bab38a49bc8200c23afb52ebb21316785144"}
Jul 24 15:46:57.359651 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.359592    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:57.365379 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.365235    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:46:57.368270 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.368250    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.372705 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.372674    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 15:46:57.372705 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.372703    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 15:46:57.372864 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.372715    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 15:46:57.372864 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.372840    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 15:46:57.372970 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.372962    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 15:46:57.373021 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.372988    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 15:46:57.373072 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.373051    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 15:46:57.373123 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.373094    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 15:46:57.373178 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.373170    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7s8fp\""
Jul 24 15:46:57.374556 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.374535    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-55keft5ocbi27\""
Jul 24 15:46:57.374877 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.374764    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 15:46:57.376331 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.376093    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 15:46:57.377876 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.377559    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 15:46:57.377876 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.377716    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 15:46:57.381482 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.381113    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 15:46:57.387005 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.385241    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 15:46:57.387144 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.387040    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:46:57.412419 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412385    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412531 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412463    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412531 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412522    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412690 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412584    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412690 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412651    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412796 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412700    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412796 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412723    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412796 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412737    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412946 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412802    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412946 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412844    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412946 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412877    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.412946 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412928    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.413134 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.412951    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.413134 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.413016    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.413134 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.413052    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhrf\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-kube-api-access-glhrf\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.413134 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.413079    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.413327 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.413190    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.413327 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.413221    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.413327 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.413297    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.413472 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.413356    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.513873    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.513911    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.513938    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.513970    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.513997    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514020    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514052    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514077    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glhrf\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-kube-api-access-glhrf\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514105    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514142    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514161    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514188    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514207    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514243    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514265    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514290    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.515541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514317    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.516494 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514332    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.516494 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514361    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.516494 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.514388    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.516494 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.515121    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.516705 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.516549    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.517501 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.517213    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.517501 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.517366    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.518348 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.517981    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.519156 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.518710    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.519156 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.519148    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.525146 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.524877    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.525146 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.524908    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.525146 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.525046    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.525701 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.525680    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.525981 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.525802    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.525981 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.525851    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhrf\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-kube-api-access-glhrf\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.532567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.526300    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.532567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.526834    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.532567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.527009    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.532567 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.527153    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.534745 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.533090    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.534745 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.533625    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.535794 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.535508    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.683471 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.683164    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:46:57.830330 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.829834    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65575967c9-cm682" event={"ID":"a6b709c2-0d67-4164-891e-356c13a7e160","Type":"ContainerStarted","Data":"a7f1475f952cd3e083b69d3199df6e479989fb4dc7b41d1dfd1f6904d2bddd12"}
Jul 24 15:46:57.838039 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.837973    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:57.857502 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.857431    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65575967c9-cm682" podStartSLOduration=1.461141579 podStartE2EDuration="2.857415344s" totalImagesPullingTime="1.396273765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:46:57.847792411 +0000 UTC m=+92.005659110" watchObservedRunningTime="2026-07-24 15:46:57.857415344 +0000 UTC m=+92.015282042"
Jul 24 15:46:57.858059 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.858040    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:46:57.940660 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:57.940625    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:46:58.835560 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:58.835511    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerStarted","Data":"c70889712fb674ff1bb695d3adc7b4a366b4601ba4d4bd868e1b40c1f86836c0"}
Jul 24 15:46:59.840933 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:59.840900    2600 generic.go:356] "Generic (PLEG): container finished" podID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968" exitCode=0
Jul 24 15:46:59.841381 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:46:59.840965    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerDied","Data":"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"}
Jul 24 15:47:00.225984 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:00.225937    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:00.296433 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:00.296399    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:02.705858 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:02.705787    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:02.807022 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:02.806960    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:03.862962 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:03.862927    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerStarted","Data":"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"}
Jul 24 15:47:04.869627 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:04.869583    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerStarted","Data":"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"}
Jul 24 15:47:05.120120 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:05.120028    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:05.224009 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:05.223969    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:05.536125 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:05.536090    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:05.639783 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:05.639749    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:07.941242 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:07.941210    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:09.224504 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:09.224464    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:09.321685 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:09.321645    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:10.934625 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:10.934576    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:11.004251 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:11.004216    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:11.814847 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:11.814813    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:11.866848 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:11.866814    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:12.623365 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:12.623332    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:12.680325 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:12.680290    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:13.758662 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.758555    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qqqpc"
Jul 24 15:47:13.912452 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.912413    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-rxjjs" event={"ID":"2e14f60f-5082-4447-8d5e-a1927cbcc4d5","Type":"ContainerStarted","Data":"c89a994666ef6c2b78c886c6e126b57f09c54079379e0f94ddc6b7a8f8ce533f"}
Jul 24 15:47:13.912687 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.912657    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-rxjjs"
Jul 24 15:47:13.917752 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.917729    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerStarted","Data":"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"}
Jul 24 15:47:13.917855 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.917776    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerStarted","Data":"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"}
Jul 24 15:47:13.917855 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.917812    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerStarted","Data":"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"}
Jul 24 15:47:13.917855 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.917847    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerStarted","Data":"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"}
Jul 24 15:47:13.931988 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.931946    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-rxjjs" podStartSLOduration=1.2136939039999999 podStartE2EDuration="19.931924189s" totalImagesPullingTime="18.718230285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:13.931071224 +0000 UTC m=+108.088937923" watchObservedRunningTime="2026-07-24 15:47:13.931924189 +0000 UTC m=+108.089790887"
Jul 24 15:47:13.936639 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.936618    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-rxjjs"
Jul 24 15:47:13.965334 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:13.965218    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.884589462 podStartE2EDuration="16.965199397s" totalImagesPullingTime="14.059662768s" totalInitContainerRuntime="20.947167ms" isStatefulPod=false podCreationTimestamp="2026-07-24 15:46:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:13.96279301 +0000 UTC m=+108.120659748" watchObservedRunningTime="2026-07-24 15:47:13.965199397 +0000 UTC m=+108.123066098"
Jul 24 15:47:15.744363 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:15.744322    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:47:15.744787 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:15.744399    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:47:17.683919 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:17.683883    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:47:18.342079 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:18.342034    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:18.439787 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:18.439755    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:19.339699 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:19.339657    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:19.394092 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:19.394054    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:19.715854 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:19.715818    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:19.817420 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:19.817385    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:19.917408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:19.917373    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:20.167894 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:20.167818    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65575967c9-cm682_a6b709c2-0d67-4164-891e-356c13a7e160/metrics-server/0.log"
Jul 24 15:47:21.169142 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:21.169114    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6xpk_8d68260c-fc8c-49b2-9a6c-a6537eba1e1a/init-textfile/0.log"
Jul 24 15:47:21.376076 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:21.376045    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6xpk_8d68260c-fc8c-49b2-9a6c-a6537eba1e1a/node-exporter/0.log"
Jul 24 15:47:21.517427 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:21.517398    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:21.568341 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:21.568316    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6xpk_8d68260c-fc8c-49b2-9a6c-a6537eba1e1a/kube-rbac-proxy/0.log"
Jul 24 15:47:21.618055 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:21.618010    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:21.669815 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:21.669779    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:22.968411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:22.968389    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b294db4-0d3a-47e5-9c15-75c067e8d7f6/init-config-reloader/0.log"
Jul 24 15:47:23.173438 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:23.173413    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b294db4-0d3a-47e5-9c15-75c067e8d7f6/prometheus/0.log"
Jul 24 15:47:23.369407 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:23.369335    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b294db4-0d3a-47e5-9c15-75c067e8d7f6/config-reloader/0.log"
Jul 24 15:47:23.570333 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:23.570295    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b294db4-0d3a-47e5-9c15-75c067e8d7f6/thanos-sidecar/0.log"
Jul 24 15:47:23.768543 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:23.768521    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b294db4-0d3a-47e5-9c15-75c067e8d7f6/kube-rbac-proxy-web/0.log"
Jul 24 15:47:23.967503 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:23.967475    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b294db4-0d3a-47e5-9c15-75c067e8d7f6/kube-rbac-proxy/0.log"
Jul 24 15:47:24.168523 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:24.168455    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b294db4-0d3a-47e5-9c15-75c067e8d7f6/kube-rbac-proxy-thanos/0.log"
Jul 24 15:47:24.370226 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:24.370196    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-p7ggw_8e0e2c51-36e6-4e07-9022-738f36cf31f9/prometheus-operator/0.log"
Jul 24 15:47:24.567853 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:24.567825    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-p7ggw_8e0e2c51-36e6-4e07-9022-738f36cf31f9/kube-rbac-proxy/0.log"
Jul 24 15:47:24.767216 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:24.767186    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-qnlqt_d354d76a-9037-4f01-940f-e0a6bdd985be/prometheus-operator-admission-webhook/0.log"
Jul 24 15:47:27.173536 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:27.173508    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-rxjjs_2e14f60f-5082-4447-8d5e-a1927cbcc4d5/download-server/0.log"
Jul 24 15:47:27.633702 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:27.633666    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:27.734545 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:27.734514    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:27.969346 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:27.969324    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jpwf4_8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c/serve-healthcheck-canary/0.log"
Jul 24 15:47:35.749227 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:35.749196    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:47:35.753109 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:35.753088    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65575967c9-cm682"
Jul 24 15:47:42.621624 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:42.621563    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:42.683139 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:42.683112    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:47:57.684628 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:57.684576    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:47:57.745254 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:57.745231    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:47:58.093829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:47:58.093764    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:10.335697 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:10.335661    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:10.749218 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:10.749179    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:15.710432 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:15.710391    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:48:15.710897 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:15.710863    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="prometheus" containerID="cri-o://84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3" gracePeriod=600
Jul 24 15:48:15.710985 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:15.710877    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="thanos-sidecar" containerID="cri-o://dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752" gracePeriod=600
Jul 24 15:48:15.710985 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:15.710886    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540" gracePeriod=600
Jul 24 15:48:15.711091 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:15.710891    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="config-reloader" containerID="cri-o://584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917" gracePeriod=600
Jul 24 15:48:15.711184 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:15.711152    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy" containerID="cri-o://a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b" gracePeriod=600
Jul 24 15:48:15.711251 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:15.711228    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy-web" containerID="cri-o://c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56" gracePeriod=600
Jul 24 15:48:15.963552 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:15.963485    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.046868 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.046834    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config-out\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047054 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.046879    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-0\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047054 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.046910    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-web-config\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047054 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.046930    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047054 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.046946    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047054 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.046963    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-grpc-tls\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047054 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.046993    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-kubelet-serving-ca-bundle\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047054 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047024    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-kube-rbac-proxy\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047058    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-metrics-client-certs\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047085    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-metrics-client-ca\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047108    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-db\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047136    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-tls-assets\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047159    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-thanos-prometheus-http-client-file\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047186    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glhrf\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-kube-api-access-glhrf\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047211    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-trusted-ca-bundle\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047247    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-1\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047287    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047315    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-serving-certs-ca-bundle\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047350    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-2\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.047411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047397    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-tls\") pod \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\" (UID: \"4b294db4-0d3a-47e5-9c15-75c067e8d7f6\") "
Jul 24 15:48:16.048013 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.047651    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:48:16.048093 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.048064    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:48:16.049674 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.049370    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:48:16.050491 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.050159    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:48:16.050491 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.050182    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config-out" (OuterVolumeSpecName: "config-out") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:48:16.050699 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.050660    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:48:16.050775 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.050697    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:48:16.050775 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.050756    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config" (OuterVolumeSpecName: "config") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.050879 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.050788    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:48:16.050936 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.050900    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:48:16.051575 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.051373    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.051575 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.051393    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.051890 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.051854    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.052219 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.052187    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.052761 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.052730    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:48:16.053198 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.053178    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-kube-api-access-glhrf" (OuterVolumeSpecName: "kube-api-access-glhrf") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "kube-api-access-glhrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:48:16.053420 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.053397    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.053666 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.053647    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.054761 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.054733    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.061177 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.061156    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-web-config" (OuterVolumeSpecName: "web-config") pod "4b294db4-0d3a-47e5-9c15-75c067e8d7f6" (UID: "4b294db4-0d3a-47e5-9c15-75c067e8d7f6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:48:16.147973 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.147948    2600 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.147973 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.147971    2600 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.147981    2600 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.147990    2600 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148000    2600 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config-out\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148008    2600 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148017    2600 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-web-config\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148026    2600 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148034    2600 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-config\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148042    2600 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-grpc-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148050    2600 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148058    2600 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-kube-rbac-proxy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148066    2600 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-secret-metrics-client-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148074    2600 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-configmap-metrics-client-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148083    2600 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-db\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148091    2600 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-tls-assets\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148104    2600 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148118    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glhrf\" (UniqueName: \"kubernetes.io/projected/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-kube-api-access-glhrf\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148130    2600 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.148172 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.148139    2600 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b294db4-0d3a-47e5-9c15-75c067e8d7f6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:48:16.149833 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149812    2600 generic.go:356] "Generic (PLEG): container finished" podID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540" exitCode=0
Jul 24 15:48:16.149833 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149831    2600 generic.go:356] "Generic (PLEG): container finished" podID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b" exitCode=0
Jul 24 15:48:16.149950 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149838    2600 generic.go:356] "Generic (PLEG): container finished" podID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56" exitCode=0
Jul 24 15:48:16.149950 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149845    2600 generic.go:356] "Generic (PLEG): container finished" podID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752" exitCode=0
Jul 24 15:48:16.149950 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149851    2600 generic.go:356] "Generic (PLEG): container finished" podID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917" exitCode=0
Jul 24 15:48:16.149950 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149855    2600 generic.go:356] "Generic (PLEG): container finished" podID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3" exitCode=0
Jul 24 15:48:16.149950 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149899    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.149950 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149896    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerDied","Data":"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"}
Jul 24 15:48:16.150154 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.149983    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerDied","Data":"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"}
Jul 24 15:48:16.150154 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.150026    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerDied","Data":"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"}
Jul 24 15:48:16.150154 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.150055    2600 scope.go:117] "RemoveContainer" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"
Jul 24 15:48:16.150154 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.150067    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerDied","Data":"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"}
Jul 24 15:48:16.150154 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.150109    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerDied","Data":"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"}
Jul 24 15:48:16.150154 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.150150    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerDied","Data":"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"}
Jul 24 15:48:16.150404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.150190    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b294db4-0d3a-47e5-9c15-75c067e8d7f6","Type":"ContainerDied","Data":"c70889712fb674ff1bb695d3adc7b4a366b4601ba4d4bd868e1b40c1f86836c0"}
Jul 24 15:48:16.158246 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.158225    2600 scope.go:117] "RemoveContainer" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"
Jul 24 15:48:16.165300 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.165285    2600 scope.go:117] "RemoveContainer" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"
Jul 24 15:48:16.171716 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.171694    2600 scope.go:117] "RemoveContainer" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"
Jul 24 15:48:16.175009 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.174986    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:48:16.179031 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.179013    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:48:16.179230 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.179218    2600 scope.go:117] "RemoveContainer" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"
Jul 24 15:48:16.185642 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.185626    2600 scope.go:117] "RemoveContainer" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"
Jul 24 15:48:16.192731 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.192715    2600 scope.go:117] "RemoveContainer" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"
Jul 24 15:48:16.199134 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.199119    2600 scope.go:117] "RemoveContainer" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"
Jul 24 15:48:16.199403 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:48:16.199385    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": container with ID starting with 753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540 not found: ID does not exist" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"
Jul 24 15:48:16.199443 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.199412    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"} err="failed to get container status \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": rpc error: code = NotFound desc = could not find container \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": container with ID starting with 753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540 not found: ID does not exist"
Jul 24 15:48:16.199489 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.199442    2600 scope.go:117] "RemoveContainer" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"
Jul 24 15:48:16.199685 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:48:16.199664    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": container with ID starting with a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b not found: ID does not exist" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"
Jul 24 15:48:16.199769 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.199695    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"} err="failed to get container status \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": rpc error: code = NotFound desc = could not find container \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": container with ID starting with a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b not found: ID does not exist"
Jul 24 15:48:16.199769 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.199718    2600 scope.go:117] "RemoveContainer" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"
Jul 24 15:48:16.199936 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:48:16.199909    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": container with ID starting with c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56 not found: ID does not exist" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"
Jul 24 15:48:16.199979 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.199964    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"} err="failed to get container status \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": rpc error: code = NotFound desc = could not find container \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": container with ID starting with c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56 not found: ID does not exist"
Jul 24 15:48:16.200017 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.199983    2600 scope.go:117] "RemoveContainer" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"
Jul 24 15:48:16.200191 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:48:16.200170    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": container with ID starting with dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752 not found: ID does not exist" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"
Jul 24 15:48:16.200274 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.200193    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"} err="failed to get container status \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": rpc error: code = NotFound desc = could not find container \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": container with ID starting with dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752 not found: ID does not exist"
Jul 24 15:48:16.200274 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.200207    2600 scope.go:117] "RemoveContainer" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"
Jul 24 15:48:16.200452 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:48:16.200434    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": container with ID starting with 584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917 not found: ID does not exist" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"
Jul 24 15:48:16.200513 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.200459    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"} err="failed to get container status \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": rpc error: code = NotFound desc = could not find container \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": container with ID starting with 584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917 not found: ID does not exist"
Jul 24 15:48:16.200513 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.200482    2600 scope.go:117] "RemoveContainer" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"
Jul 24 15:48:16.200718 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:48:16.200690    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": container with ID starting with 84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3 not found: ID does not exist" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"
Jul 24 15:48:16.200795 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.200710    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"} err="failed to get container status \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": rpc error: code = NotFound desc = could not find container \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": container with ID starting with 84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3 not found: ID does not exist"
Jul 24 15:48:16.200795 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.200731    2600 scope.go:117] "RemoveContainer" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"
Jul 24 15:48:16.200954 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:48:16.200938    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": container with ID starting with 5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968 not found: ID does not exist" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"
Jul 24 15:48:16.200996 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.200958    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"} err="failed to get container status \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": rpc error: code = NotFound desc = could not find container \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": container with ID starting with 5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968 not found: ID does not exist"
Jul 24 15:48:16.200996 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.200971    2600 scope.go:117] "RemoveContainer" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"
Jul 24 15:48:16.201164 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.201150    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"} err="failed to get container status \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": rpc error: code = NotFound desc = could not find container \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": container with ID starting with 753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540 not found: ID does not exist"
Jul 24 15:48:16.201206 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.201164    2600 scope.go:117] "RemoveContainer" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"
Jul 24 15:48:16.201393 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.201373    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"} err="failed to get container status \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": rpc error: code = NotFound desc = could not find container \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": container with ID starting with a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b not found: ID does not exist"
Jul 24 15:48:16.201393 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.201393    2600 scope.go:117] "RemoveContainer" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"
Jul 24 15:48:16.201670 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.201649    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"} err="failed to get container status \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": rpc error: code = NotFound desc = could not find container \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": container with ID starting with c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56 not found: ID does not exist"
Jul 24 15:48:16.201725 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.201675    2600 scope.go:117] "RemoveContainer" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"
Jul 24 15:48:16.201906 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.201889    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"} err="failed to get container status \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": rpc error: code = NotFound desc = could not find container \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": container with ID starting with dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752 not found: ID does not exist"
Jul 24 15:48:16.201906 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.201908    2600 scope.go:117] "RemoveContainer" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"
Jul 24 15:48:16.202144 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.202126    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"} err="failed to get container status \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": rpc error: code = NotFound desc = could not find container \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": container with ID starting with 584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917 not found: ID does not exist"
Jul 24 15:48:16.202194 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.202145    2600 scope.go:117] "RemoveContainer" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"
Jul 24 15:48:16.202366 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.202350    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"} err="failed to get container status \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": rpc error: code = NotFound desc = could not find container \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": container with ID starting with 84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3 not found: ID does not exist"
Jul 24 15:48:16.202412 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.202366    2600 scope.go:117] "RemoveContainer" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"
Jul 24 15:48:16.202588 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.202570    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"} err="failed to get container status \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": rpc error: code = NotFound desc = could not find container \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": container with ID starting with 5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968 not found: ID does not exist"
Jul 24 15:48:16.202678 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.202589    2600 scope.go:117] "RemoveContainer" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"
Jul 24 15:48:16.202819 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.202803    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"} err="failed to get container status \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": rpc error: code = NotFound desc = could not find container \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": container with ID starting with 753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540 not found: ID does not exist"
Jul 24 15:48:16.202868 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.202820    2600 scope.go:117] "RemoveContainer" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"
Jul 24 15:48:16.203028 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.203011    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"} err="failed to get container status \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": rpc error: code = NotFound desc = could not find container \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": container with ID starting with a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b not found: ID does not exist"
Jul 24 15:48:16.203070 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.203029    2600 scope.go:117] "RemoveContainer" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"
Jul 24 15:48:16.203259 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.203243    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"} err="failed to get container status \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": rpc error: code = NotFound desc = could not find container \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": container with ID starting with c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56 not found: ID does not exist"
Jul 24 15:48:16.203326 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.203261    2600 scope.go:117] "RemoveContainer" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"
Jul 24 15:48:16.203633 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.203505    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"} err="failed to get container status \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": rpc error: code = NotFound desc = could not find container \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": container with ID starting with dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752 not found: ID does not exist"
Jul 24 15:48:16.203633 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.203556    2600 scope.go:117] "RemoveContainer" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"
Jul 24 15:48:16.203888 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.203860    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"} err="failed to get container status \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": rpc error: code = NotFound desc = could not find container \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": container with ID starting with 584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917 not found: ID does not exist"
Jul 24 15:48:16.204011 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.203887    2600 scope.go:117] "RemoveContainer" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"
Jul 24 15:48:16.204263 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.204142    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"} err="failed to get container status \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": rpc error: code = NotFound desc = could not find container \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": container with ID starting with 84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3 not found: ID does not exist"
Jul 24 15:48:16.204263 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.204167    2600 scope.go:117] "RemoveContainer" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"
Jul 24 15:48:16.204456 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.204438    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"} err="failed to get container status \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": rpc error: code = NotFound desc = could not find container \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": container with ID starting with 5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968 not found: ID does not exist"
Jul 24 15:48:16.204505 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.204457    2600 scope.go:117] "RemoveContainer" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"
Jul 24 15:48:16.204806 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.204786    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"} err="failed to get container status \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": rpc error: code = NotFound desc = could not find container \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": container with ID starting with 753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540 not found: ID does not exist"
Jul 24 15:48:16.204888 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.204808    2600 scope.go:117] "RemoveContainer" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"
Jul 24 15:48:16.205051 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205032    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"} err="failed to get container status \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": rpc error: code = NotFound desc = could not find container \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": container with ID starting with a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b not found: ID does not exist"
Jul 24 15:48:16.205097 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205052    2600 scope.go:117] "RemoveContainer" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"
Jul 24 15:48:16.205208 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205190    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:48:16.205260 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205242    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"} err="failed to get container status \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": rpc error: code = NotFound desc = could not find container \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": container with ID starting with c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56 not found: ID does not exist"
Jul 24 15:48:16.205299 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205259    2600 scope.go:117] "RemoveContainer" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"
Jul 24 15:48:16.205436 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205423    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="config-reloader"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205438    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="config-reloader"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205446    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy-thanos"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205451    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy-thanos"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205459    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="thanos-sidecar"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205465    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="thanos-sidecar"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205472    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205476    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205485    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="prometheus"
Jul 24 15:48:16.205486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205490    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="prometheus"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205500    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy-web"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205505    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy-web"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205511    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="init-config-reloader"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205516    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="init-config-reloader"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205451    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"} err="failed to get container status \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": rpc error: code = NotFound desc = could not find container \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": container with ID starting with dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752 not found: ID does not exist"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205545    2600 scope.go:117] "RemoveContainer" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205553    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="prometheus"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205559    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205565    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="thanos-sidecar"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205569    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy-web"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205575    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="kube-rbac-proxy-thanos"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205581    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" containerName="config-reloader"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205747    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"} err="failed to get container status \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": rpc error: code = NotFound desc = could not find container \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": container with ID starting with 584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917 not found: ID does not exist"
Jul 24 15:48:16.205829 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205760    2600 scope.go:117] "RemoveContainer" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"
Jul 24 15:48:16.206387 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.205986    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"} err="failed to get container status \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": rpc error: code = NotFound desc = could not find container \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": container with ID starting with 84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3 not found: ID does not exist"
Jul 24 15:48:16.206387 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.206009    2600 scope.go:117] "RemoveContainer" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"
Jul 24 15:48:16.206387 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.206250    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"} err="failed to get container status \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": rpc error: code = NotFound desc = could not find container \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": container with ID starting with 5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968 not found: ID does not exist"
Jul 24 15:48:16.206387 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.206264    2600 scope.go:117] "RemoveContainer" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"
Jul 24 15:48:16.206523 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.206503    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"} err="failed to get container status \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": rpc error: code = NotFound desc = could not find container \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": container with ID starting with 753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540 not found: ID does not exist"
Jul 24 15:48:16.206557 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.206526    2600 scope.go:117] "RemoveContainer" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"
Jul 24 15:48:16.206784 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.206766    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"} err="failed to get container status \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": rpc error: code = NotFound desc = could not find container \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": container with ID starting with a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b not found: ID does not exist"
Jul 24 15:48:16.206837 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.206785    2600 scope.go:117] "RemoveContainer" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"
Jul 24 15:48:16.207017 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207000    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"} err="failed to get container status \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": rpc error: code = NotFound desc = could not find container \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": container with ID starting with c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56 not found: ID does not exist"
Jul 24 15:48:16.207063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207020    2600 scope.go:117] "RemoveContainer" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"
Jul 24 15:48:16.207222 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207202    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"} err="failed to get container status \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": rpc error: code = NotFound desc = could not find container \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": container with ID starting with dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752 not found: ID does not exist"
Jul 24 15:48:16.207292 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207223    2600 scope.go:117] "RemoveContainer" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"
Jul 24 15:48:16.207422 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207406    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"} err="failed to get container status \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": rpc error: code = NotFound desc = could not find container \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": container with ID starting with 584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917 not found: ID does not exist"
Jul 24 15:48:16.207486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207423    2600 scope.go:117] "RemoveContainer" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"
Jul 24 15:48:16.207678 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207662    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"} err="failed to get container status \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": rpc error: code = NotFound desc = could not find container \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": container with ID starting with 84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3 not found: ID does not exist"
Jul 24 15:48:16.207740 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207679    2600 scope.go:117] "RemoveContainer" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"
Jul 24 15:48:16.207868 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207849    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"} err="failed to get container status \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": rpc error: code = NotFound desc = could not find container \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": container with ID starting with 5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968 not found: ID does not exist"
Jul 24 15:48:16.207930 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.207870    2600 scope.go:117] "RemoveContainer" containerID="753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"
Jul 24 15:48:16.208060 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208044    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540"} err="failed to get container status \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": rpc error: code = NotFound desc = could not find container \"753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540\": container with ID starting with 753a2a78dbb4bf1c37a14b0aae7cc45640de92755315d95dda8ed79458092540 not found: ID does not exist"
Jul 24 15:48:16.208101 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208061    2600 scope.go:117] "RemoveContainer" containerID="a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"
Jul 24 15:48:16.208231 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208207    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b"} err="failed to get container status \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": rpc error: code = NotFound desc = could not find container \"a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b\": container with ID starting with a3b5ad464b31a2caee25185b52aa9aa7186df17430fc2ec04a50b74d68f27c2b not found: ID does not exist"
Jul 24 15:48:16.208231 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208226    2600 scope.go:117] "RemoveContainer" containerID="c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"
Jul 24 15:48:16.208411 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208391    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56"} err="failed to get container status \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": rpc error: code = NotFound desc = could not find container \"c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56\": container with ID starting with c0c0a33c5d112921ee445ef31b08f73864174880ae6af6c800cdd3943e036f56 not found: ID does not exist"
Jul 24 15:48:16.208476 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208412    2600 scope.go:117] "RemoveContainer" containerID="dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"
Jul 24 15:48:16.208673 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208654    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752"} err="failed to get container status \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": rpc error: code = NotFound desc = could not find container \"dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752\": container with ID starting with dfe3eff4b878954fed74457122369db609b05b667791aad6b61ef7b76ab45752 not found: ID does not exist"
Jul 24 15:48:16.208725 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208674    2600 scope.go:117] "RemoveContainer" containerID="584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"
Jul 24 15:48:16.208725 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208709    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.209094 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208898    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917"} err="failed to get container status \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": rpc error: code = NotFound desc = could not find container \"584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917\": container with ID starting with 584eac13276df038f2ef20a8430cff734f71a2a361e02d8eca280bb185d54917 not found: ID does not exist"
Jul 24 15:48:16.209094 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.208927    2600 scope.go:117] "RemoveContainer" containerID="84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"
Jul 24 15:48:16.209379 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.209359    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3"} err="failed to get container status \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": rpc error: code = NotFound desc = could not find container \"84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3\": container with ID starting with 84dc3bd1d3409e309766c1c8d839daa774c0fa91fbe159f9c083b9ca484c6de3 not found: ID does not exist"
Jul 24 15:48:16.209431 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.209381    2600 scope.go:117] "RemoveContainer" containerID="5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"
Jul 24 15:48:16.209681 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.209663    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968"} err="failed to get container status \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": rpc error: code = NotFound desc = could not find container \"5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968\": container with ID starting with 5db3217fbc9b540c18ee24c75d200350ad947d946c25b955e75b9b63cf07b968 not found: ID does not exist"
Jul 24 15:48:16.211892 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.211875    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 15:48:16.212173 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.212152    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 15:48:16.212255 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.212177    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 15:48:16.212255 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.212189    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 15:48:16.212349 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.212256    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 15:48:16.212638 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.212624    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 15:48:16.212982 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.212966    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 15:48:16.212982 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.212975    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 15:48:16.213119 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.212975    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 15:48:16.213196 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.213182    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 15:48:16.213255 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.213238    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 15:48:16.213330 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.213312    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7s8fp\""
Jul 24 15:48:16.213423 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.213409    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 15:48:16.213547 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.213531    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-55keft5ocbi27\""
Jul 24 15:48:16.214518 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.214470    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 15:48:16.218353 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.218328    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 15:48:16.227763 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.227739    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:48:16.349959 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.349929    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de901c5b-d08f-4ecf-89f5-9a7975a72066-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350103 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.349969    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkpkt\" (UniqueName: \"kubernetes.io/projected/de901c5b-d08f-4ecf-89f5-9a7975a72066-kube-api-access-vkpkt\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350103 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350024    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350103 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350070    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350275 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350103    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350275 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350179    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350275 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350200    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-web-config\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350275 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350235    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350275 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350259    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350472 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350284    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350472 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350311    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350472 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350345    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350472 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350377    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350472 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350405    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350472 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350430    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350472 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350454    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350778 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350487    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-config\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350778 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350516    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de901c5b-d08f-4ecf-89f5-9a7975a72066-config-out\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350778 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350547    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.350778 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.350583    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.401569 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.401536    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b294db4-0d3a-47e5-9c15-75c067e8d7f6" path="/var/lib/kubelet/pods/4b294db4-0d3a-47e5-9c15-75c067e8d7f6/volumes"
Jul 24 15:48:16.451627 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451583    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.451725 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451650    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.451725 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451679    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de901c5b-d08f-4ecf-89f5-9a7975a72066-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.451725 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451703    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkpkt\" (UniqueName: \"kubernetes.io/projected/de901c5b-d08f-4ecf-89f5-9a7975a72066-kube-api-access-vkpkt\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.451895 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451731    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.451895 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451760    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.451895 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451785    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.451895 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451840    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.451895 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451863    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-web-config\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451901    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451926    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451952    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.451980    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452006    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452041    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452073    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452097    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452129 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452120    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452561 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452155    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-config\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452561 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452185    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de901c5b-d08f-4ecf-89f5-9a7975a72066-config-out\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452561 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452537    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452737 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452588    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.452737 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.452597    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.453985 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.453957    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.454088 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.454055    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.454935 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.454909    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.455084 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.455060    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.455147 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.455100    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de901c5b-d08f-4ecf-89f5-9a7975a72066-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.455194 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.455179    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.455293 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.455272    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de901c5b-d08f-4ecf-89f5-9a7975a72066-config-out\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.455777 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.455730    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.455878 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.455862    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-web-config\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.455938 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.455884    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.456698 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.456675    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.457457 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.457438    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.457594 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.457578    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.457836 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.457815    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de901c5b-d08f-4ecf-89f5-9a7975a72066-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.457873 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.457857    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-config\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.457947 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.457931    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de901c5b-d08f-4ecf-89f5-9a7975a72066-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.460823 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.460806    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkpkt\" (UniqueName: \"kubernetes.io/projected/de901c5b-d08f-4ecf-89f5-9a7975a72066-kube-api-access-vkpkt\") pod \"prometheus-k8s-0\" (UID: \"de901c5b-d08f-4ecf-89f5-9a7975a72066\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.518390 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.518329    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:16.654137 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:16.654107    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:48:16.658119 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:48:16.658094    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde901c5b_d08f_4ecf_89f5_9a7975a72066.slice/crio-eefa657d937dc6e4f69ea20fee4b9a5a3deef12ecdc6efd2b7295542a1bac07c WatchSource:0}: Error finding container eefa657d937dc6e4f69ea20fee4b9a5a3deef12ecdc6efd2b7295542a1bac07c: Status 404 returned error can't find the container with id eefa657d937dc6e4f69ea20fee4b9a5a3deef12ecdc6efd2b7295542a1bac07c
Jul 24 15:48:17.154688 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:17.154601    2600 generic.go:356] "Generic (PLEG): container finished" podID="de901c5b-d08f-4ecf-89f5-9a7975a72066" containerID="8f41ce62415bc5957bc1f3f8903729241b858ca8f02df0f199323831ca188759" exitCode=0
Jul 24 15:48:17.154688 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:17.154634    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de901c5b-d08f-4ecf-89f5-9a7975a72066","Type":"ContainerDied","Data":"8f41ce62415bc5957bc1f3f8903729241b858ca8f02df0f199323831ca188759"}
Jul 24 15:48:17.155167 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:17.154700    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de901c5b-d08f-4ecf-89f5-9a7975a72066","Type":"ContainerStarted","Data":"eefa657d937dc6e4f69ea20fee4b9a5a3deef12ecdc6efd2b7295542a1bac07c"}
Jul 24 15:48:18.164645 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:18.164592    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de901c5b-d08f-4ecf-89f5-9a7975a72066","Type":"ContainerStarted","Data":"a3b41afe96f03c89c6c929beb1e14a037c60a8810857531205e786f753b295a8"}
Jul 24 15:48:18.165023 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:18.164681    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de901c5b-d08f-4ecf-89f5-9a7975a72066","Type":"ContainerStarted","Data":"54ae892e9e3dbb1c02529f254a963000143d4af9d813d93ea02599a803e186a9"}
Jul 24 15:48:18.165023 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:18.164713    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de901c5b-d08f-4ecf-89f5-9a7975a72066","Type":"ContainerStarted","Data":"49514b880af62720cf1281e30137f234383e5b838a789aa0c445ac75e4cbc7d9"}
Jul 24 15:48:18.165023 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:18.164739    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de901c5b-d08f-4ecf-89f5-9a7975a72066","Type":"ContainerStarted","Data":"881b0547b2d6ddf084cf7af0f634a1f5ff3f3b512ec3643b739aa1865b8e6828"}
Jul 24 15:48:18.165023 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:18.164769    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de901c5b-d08f-4ecf-89f5-9a7975a72066","Type":"ContainerStarted","Data":"0b756b1e3c5d4ad6634a001ee234f535e3739bf8adb8eafa48bec9155402e33d"}
Jul 24 15:48:18.165023 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:18.164803    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de901c5b-d08f-4ecf-89f5-9a7975a72066","Type":"ContainerStarted","Data":"217ecd0a9c824537f58095e0d21552675db441c606462125f0ba9f3304954064"}
Jul 24 15:48:18.193477 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:18.193412    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.176041179 podStartE2EDuration="2.193396683s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.355504ms" isStatefulPod=false podCreationTimestamp="2026-07-24 15:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:18.191926325 +0000 UTC m=+172.349793054" watchObservedRunningTime="2026-07-24 15:48:18.193396683 +0000 UTC m=+172.351263380"
Jul 24 15:48:19.437150 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:19.437116    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:19.502253 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:19.502222    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:19.583291 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:19.583248    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:19.683912 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:19.683881    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:20.199436 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:20.199407    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:20.262872 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:20.262843    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:21.519026 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:21.518993    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:48:30.272040 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:30.272006    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:30.329263 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:30.329229    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:30.386958 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:30.386931    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:47.123541 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:47.123511    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:47.224259 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:47.224220    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:51.251404 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:51.251367    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:51.306621 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:51.306586    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:48:52.738643 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:48:52.738584    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:16.518548 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:16.518511    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:16.534240 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:16.534216    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:17.385330 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:17.385305    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:25.635096 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:25.635059    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:25.685938 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:25.685908    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:30.337651 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:30.337598    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:31.364649 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:31.364592    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:31.420543 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:31.420516    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:31.510469 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:31.510441    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:31.611363 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:31.611316    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:32.110459 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:32.110431    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:32.165314 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:32.165292    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:37.642170 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:37.642140    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:37.713887 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:37.713861    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:42.061879 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:42.061842    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:42.164897 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:42.164862    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:42.221008 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:42.220979    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:42.624894 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:42.624867    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:42.724438 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:42.724411    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:42.824891 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:42.824867    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:49:42.926095 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:49:42.926033    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:00.424422 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:00.424344    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:26.215151 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:26.215127    2600 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 15:50:27.003528 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:27.003496    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:28.439992 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:28.439965    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:53.758886 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:53.758850    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:54.559762 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:54.559735    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:57.369344 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:57.369310    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:57.476278 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:57.476242    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:58.654731 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:58.654700    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:58.765391 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:58.765364    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:59.632168 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:59.632129    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:50:59.734574 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:50:59.734542    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:01.646806 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:01.646781    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:02.049876 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:02.049850    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:04.162030 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:04.161995    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:04.262044 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:04.262016    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:09.177075 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:09.177046    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:09.277182 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:09.277153    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:10.180083 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:10.180050    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:10.274846 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:10.274818    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:10.340564 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:10.340539    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:17.167352 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:17.167274    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:17.267811 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:17.267783    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:19.031242 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:19.031215    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:31.581124 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:31.581097    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:31.685215 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:31.685191    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:32.236161 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.236127    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:32.464736 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.464700    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:32.569895 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.569819    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:32.620026 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.619990    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"]
Jul 24 15:51:32.622324 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.622308    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.626734 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.626711    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 15:51:32.627078 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.627051    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 15:51:32.627170 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.627087    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 15:51:32.627170 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.627143    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 15:51:32.627382 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.627366    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8dkpp\""
Jul 24 15:51:32.645137 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.645104    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"]
Jul 24 15:51:32.775459 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.775426    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/158a1b97-1248-4d5b-9d7d-e615605045bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.775663 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.775466    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zhm9\" (UniqueName: \"kubernetes.io/projected/158a1b97-1248-4d5b-9d7d-e615605045bd-kube-api-access-4zhm9\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.775663 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.775519    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/158a1b97-1248-4d5b-9d7d-e615605045bd-manifests\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.775663 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.775552    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/158a1b97-1248-4d5b-9d7d-e615605045bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.775663 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.775631    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158a1b97-1248-4d5b-9d7d-e615605045bd-tmp\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.784972 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.784945    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:32.876096 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.876019    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/158a1b97-1248-4d5b-9d7d-e615605045bd-manifests\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.876096 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.876050    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/158a1b97-1248-4d5b-9d7d-e615605045bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.876096 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.876076    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158a1b97-1248-4d5b-9d7d-e615605045bd-tmp\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.876354 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.876120    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/158a1b97-1248-4d5b-9d7d-e615605045bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.876354 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.876140    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zhm9\" (UniqueName: \"kubernetes.io/projected/158a1b97-1248-4d5b-9d7d-e615605045bd-kube-api-access-4zhm9\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.876474 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.876450    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/158a1b97-1248-4d5b-9d7d-e615605045bd-manifests\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.878522 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.878496    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158a1b97-1248-4d5b-9d7d-e615605045bd-tmp\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.878657 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.878643    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/158a1b97-1248-4d5b-9d7d-e615605045bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.878746 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.878727    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/158a1b97-1248-4d5b-9d7d-e615605045bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.888778 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.888759    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:32.892495 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.892472    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zhm9\" (UniqueName: \"kubernetes.io/projected/158a1b97-1248-4d5b-9d7d-e615605045bd-kube-api-access-4zhm9\") pod \"opendatahub-operator-controller-manager-5d995667b8-bdgnv\" (UID: \"158a1b97-1248-4d5b-9d7d-e615605045bd\") " pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.932470 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.932437    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:32.985145 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:32.985097    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:33.062134 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:33.062106    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:33.068819 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:33.068800    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"]
Jul 24 15:51:33.071533 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:51:33.071507    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158a1b97_1248_4d5b_9d7d_e615605045bd.slice/crio-6000c87795c9131cfc006b9c410a2fe54de126d69e0ef40ace86b9df74b23aef WatchSource:0}: Error finding container 6000c87795c9131cfc006b9c410a2fe54de126d69e0ef40ace86b9df74b23aef: Status 404 returned error can't find the container with id 6000c87795c9131cfc006b9c410a2fe54de126d69e0ef40ace86b9df74b23aef
Jul 24 15:51:33.073235 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:33.073219    2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:51:33.135924 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:33.135835    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:33.833259 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:33.833216    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv" event={"ID":"158a1b97-1248-4d5b-9d7d-e615605045bd","Type":"ContainerStarted","Data":"6000c87795c9131cfc006b9c410a2fe54de126d69e0ef40ace86b9df74b23aef"}
Jul 24 15:51:36.848185 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:36.848149    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv" event={"ID":"158a1b97-1248-4d5b-9d7d-e615605045bd","Type":"ContainerStarted","Data":"41a5138abcff3d3011dda3201c9f30bb24352ad1e4d300165c44ec850cca158d"}
Jul 24 15:51:37.853139 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:37.853103    2600 generic.go:356] "Generic (PLEG): container finished" podID="158a1b97-1248-4d5b-9d7d-e615605045bd" containerID="41a5138abcff3d3011dda3201c9f30bb24352ad1e4d300165c44ec850cca158d" exitCode=0
Jul 24 15:51:37.853667 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:37.853179    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv" event={"ID":"158a1b97-1248-4d5b-9d7d-e615605045bd","Type":"ContainerDied","Data":"41a5138abcff3d3011dda3201c9f30bb24352ad1e4d300165c44ec850cca158d"}
Jul 24 15:51:38.858385 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:38.858347    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv" event={"ID":"158a1b97-1248-4d5b-9d7d-e615605045bd","Type":"ContainerStarted","Data":"9e1121f9aa035db749760ebc36ae3887677b06ab05df1e53c65426392e0a0c62"}
Jul 24 15:51:38.858807 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:38.858464    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:38.881923 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:38.881876    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv" podStartSLOduration=2.476741575 podStartE2EDuration="6.881863496s" totalImagesPullingTime="3.355726252s" totalInitContainerRuntime="1.049395669s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:51:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:51:38.880824085 +0000 UTC m=+373.038690785" watchObservedRunningTime="2026-07-24 15:51:38.881863496 +0000 UTC m=+373.039730194"
Jul 24 15:51:41.038525 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:41.038499    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:41.140164 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:41.140134    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:49.863338 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:49.863304    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d995667b8-bdgnv"
Jul 24 15:51:51.511295 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:51.511263    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:51.624743 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:51.624712    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:51.853555 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:51.853476    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:51.995530 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:51.995500    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:52.375845 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:52.375808    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:52.475338 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:52.475312    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:52.800932 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:52.800901    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:53.013794 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:53.013761    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:53.129821 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:53.129733    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:53.333309 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:53.333270    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:53.401351 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:53.401225    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:54.245783 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:54.245740    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:58.679016 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:58.678986    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:58.781866 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:58.781831    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:59.288800 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:59.288763    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:59.446408 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:59.446375    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:51:59.547357 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:51:59.547284    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:01.465326 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.465293    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"]
Jul 24 15:52:01.471928 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.471909    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.474715 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.474689    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 15:52:01.474807 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.474727    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 15:52:01.476048 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.476025    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hp7zx\""
Jul 24 15:52:01.476140 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.476094    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 15:52:01.476202 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.476095    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 15:52:01.476202 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.476132    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 15:52:01.481679 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.481660    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"]
Jul 24 15:52:01.495875 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.495853    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-metrics-cert\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.495963 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.495896    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-manager-config\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.495963 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.495923    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6zcn\" (UniqueName: \"kubernetes.io/projected/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-kube-api-access-q6zcn\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.496047 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.496031    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-cert\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.596987 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.596957    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6zcn\" (UniqueName: \"kubernetes.io/projected/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-kube-api-access-q6zcn\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.597187 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.597013    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-cert\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.597187 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.597042    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-metrics-cert\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.597187 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.597064    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-manager-config\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.597651 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.597630    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-manager-config\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.599566 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.599546    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-cert\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.599760 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.599740    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-metrics-cert\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.605106 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.605085    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6zcn\" (UniqueName: \"kubernetes.io/projected/93ee9026-cef2-46a4-9c8f-2e8f372afbc2-kube-api-access-q6zcn\") pod \"lws-controller-manager-57bd9ccdc-lg2v7\" (UID: \"93ee9026-cef2-46a4-9c8f-2e8f372afbc2\") " pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.781177 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.781099    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:01.928800 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.928692    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"]
Jul 24 15:52:01.931229 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:52:01.931192    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ee9026_cef2_46a4_9c8f_2e8f372afbc2.slice/crio-22b48fedec4eaf3797fe5a70bcc81c2ed0a88f0bb75c4ca251cc5665baaaec3c WatchSource:0}: Error finding container 22b48fedec4eaf3797fe5a70bcc81c2ed0a88f0bb75c4ca251cc5665baaaec3c: Status 404 returned error can't find the container with id 22b48fedec4eaf3797fe5a70bcc81c2ed0a88f0bb75c4ca251cc5665baaaec3c
Jul 24 15:52:01.941257 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:01.941235    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7" event={"ID":"93ee9026-cef2-46a4-9c8f-2e8f372afbc2","Type":"ContainerStarted","Data":"22b48fedec4eaf3797fe5a70bcc81c2ed0a88f0bb75c4ca251cc5665baaaec3c"}
Jul 24 15:52:02.234243 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.234210    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"]
Jul 24 15:52:02.237035 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.237016    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.239900 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.239877    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 15:52:02.240495 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.240162    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 15:52:02.240495 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.240177    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 15:52:02.240495 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.240192    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 15:52:02.240495 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.240181    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 15:52:02.240495 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.240181    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sbx6j\""
Jul 24 15:52:02.240495 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.240197    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 15:52:02.251009 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.250987    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"]
Jul 24 15:52:02.301915 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.301896    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.302083 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.301921    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hc9\" (UniqueName: \"kubernetes.io/projected/16075471-127b-49d3-9cf0-f5310b19be34-kube-api-access-m5hc9\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.302083 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.301943    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16075471-127b-49d3-9cf0-f5310b19be34-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.302083 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.301979    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16075471-127b-49d3-9cf0-f5310b19be34-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.302083 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.302055    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.302240 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.302100    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.302240 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.302119    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16075471-127b-49d3-9cf0-f5310b19be34-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.402458 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.402438    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.402600 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.402475    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.402600 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.402497    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16075471-127b-49d3-9cf0-f5310b19be34-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.402600 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.402520    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.402600 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.402540    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hc9\" (UniqueName: \"kubernetes.io/projected/16075471-127b-49d3-9cf0-f5310b19be34-kube-api-access-m5hc9\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.402600 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.402558    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16075471-127b-49d3-9cf0-f5310b19be34-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.402600 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.402588    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16075471-127b-49d3-9cf0-f5310b19be34-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.403489 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.403461    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16075471-127b-49d3-9cf0-f5310b19be34-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.404869 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.404841    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.404960 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.404877    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.404960 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.404899    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16075471-127b-49d3-9cf0-f5310b19be34-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.404960 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.404882    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16075471-127b-49d3-9cf0-f5310b19be34-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.415822 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.415803    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16075471-127b-49d3-9cf0-f5310b19be34-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.418706 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.418685    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hc9\" (UniqueName: \"kubernetes.io/projected/16075471-127b-49d3-9cf0-f5310b19be34-kube-api-access-m5hc9\") pod \"istiod-openshift-gateway-5677ccb49b-g64v4\" (UID: \"16075471-127b-49d3-9cf0-f5310b19be34\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.546460 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.546411    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:02.680282 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.680233    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"]
Jul 24 15:52:02.682412 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:52:02.682385    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16075471_127b_49d3_9cf0_f5310b19be34.slice/crio-e9b25df506e3914f6f2b176d8df001118716e8e232a85bfe45c9ce57d69229ba WatchSource:0}: Error finding container e9b25df506e3914f6f2b176d8df001118716e8e232a85bfe45c9ce57d69229ba: Status 404 returned error can't find the container with id e9b25df506e3914f6f2b176d8df001118716e8e232a85bfe45c9ce57d69229ba
Jul 24 15:52:02.949310 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:02.949270    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4" event={"ID":"16075471-127b-49d3-9cf0-f5310b19be34","Type":"ContainerStarted","Data":"e9b25df506e3914f6f2b176d8df001118716e8e232a85bfe45c9ce57d69229ba"}
Jul 24 15:52:03.533359 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:03.533050    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:03.636229 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:03.636164    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:04.241765 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:04.241733    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:04.303003 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:04.302963    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:04.805292 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:04.805259    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:04.907222 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:04.907161    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:05.644299 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:05.644247    2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 15:52:05.644426 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:05.644317    2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 15:52:05.964169 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:05.964135    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7" event={"ID":"93ee9026-cef2-46a4-9c8f-2e8f372afbc2","Type":"ContainerStarted","Data":"19e7dab4ab22ef928c89e688b778bd3e0beb425abb135a588303b7f6dcdaa5ce"}
Jul 24 15:52:05.964638 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:05.964233    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:05.965802 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:05.965781    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4" event={"ID":"16075471-127b-49d3-9cf0-f5310b19be34","Type":"ContainerStarted","Data":"0792a81c45377abffaf564d3a6df5663d9b6f337116e6bbcf5619131c68ef394"}
Jul 24 15:52:05.965923 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:05.965825    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:05.985382 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:05.985323    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7" podStartSLOduration=1.274756038 podStartE2EDuration="4.985308966s" totalImagesPullingTime="3.710552928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:52:05.983746878 +0000 UTC m=+400.141613615" watchObservedRunningTime="2026-07-24 15:52:05.985308966 +0000 UTC m=+400.143175725"
Jul 24 15:52:06.011463 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:06.010389    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4" podStartSLOduration=1.050991799 podStartE2EDuration="4.010368181s" totalImagesPullingTime="2.959376382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:52:06.008904085 +0000 UTC m=+400.166770785" watchObservedRunningTime="2026-07-24 15:52:06.010368181 +0000 UTC m=+400.168234882"
Jul 24 15:52:06.971325 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:06.971297    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-g64v4"
Jul 24 15:52:16.971969 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:16.971940    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57bd9ccdc-lg2v7"
Jul 24 15:52:53.166319 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:53.166232    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:53.252867 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:53.252832    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:53.351063 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:53.351027    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:54.079707 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:54.079677    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:52:54.285165 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:52:54.285135    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:10.449793 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:10.449757    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:22.959454 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:22.959422    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:26.381666 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:26.381630    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:26.559106 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:26.559077    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:26.660301 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:26.660236    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:26.787657 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:26.787627    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:26.955176 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:26.955147    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:27.254280 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:27.254205    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:27.354141 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:27.354113    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:28.584860 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:28.584822    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:28.686119 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:28.686088    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:30.592293 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:30.592262    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:30.751875 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:30.751841    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:31.811445 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:31.811404    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:34.762501 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:34.762468    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:35.809957 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:35.809927    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:37.407469 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:37.407437    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:37.507270 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:37.507235    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:37.609194 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:37.609166    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:37.772371 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:37.772337    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:37.874322 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:37.874293    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:42.087211 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:42.087180    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:42.470754 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:42.470724    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:43.349954 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:43.349914    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:43.402106 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:43.402076    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:43.760977 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:43.760947    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:43.860644 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:43.860594    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:47.354497 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:47.354466    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:47.623116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:47.623043    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:52.953337 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:52.953299    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"]
Jul 24 15:53:52.955749 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:52.955734    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:52.959004 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:52.958983    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6l4rd\""
Jul 24 15:53:52.959121 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:52.959010    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 15:53:52.959121 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:52.958989    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 15:53:52.972123 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:52.972092    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"]
Jul 24 15:53:53.067967 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.067932    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e652848-576c-47d7-a1f2-f1a4a72768ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" (UID: \"3e652848-576c-47d7-a1f2-f1a4a72768ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.068153 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.067991    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqbxm\" (UniqueName: \"kubernetes.io/projected/3e652848-576c-47d7-a1f2-f1a4a72768ab-kube-api-access-kqbxm\") pod \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" (UID: \"3e652848-576c-47d7-a1f2-f1a4a72768ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.169249 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.169211    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e652848-576c-47d7-a1f2-f1a4a72768ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" (UID: \"3e652848-576c-47d7-a1f2-f1a4a72768ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.169406 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.169267    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqbxm\" (UniqueName: \"kubernetes.io/projected/3e652848-576c-47d7-a1f2-f1a4a72768ab-kube-api-access-kqbxm\") pod \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" (UID: \"3e652848-576c-47d7-a1f2-f1a4a72768ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.169586 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.169565    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e652848-576c-47d7-a1f2-f1a4a72768ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" (UID: \"3e652848-576c-47d7-a1f2-f1a4a72768ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.183218 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.183188    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"]
Jul 24 15:53:53.183448 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:53:53.183431    2600 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kqbxm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz" podUID="3e652848-576c-47d7-a1f2-f1a4a72768ab"
Jul 24 15:53:53.194216 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.194174    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqbxm\" (UniqueName: \"kubernetes.io/projected/3e652848-576c-47d7-a1f2-f1a4a72768ab-kube-api-access-kqbxm\") pod \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" (UID: \"3e652848-576c-47d7-a1f2-f1a4a72768ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.202523 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.202498    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"]
Jul 24 15:53:53.349883 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.349802    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.352990 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:53:53.352960    2600 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" is forbidden: User \"system:node:ip-10-0-134-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-8.ec2.internal' and this object" podUID="3e652848-576c-47d7-a1f2-f1a4a72768ab" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.356070 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.356052    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.358465 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:53:53.358434    2600 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" is forbidden: User \"system:node:ip-10-0-134-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-8.ec2.internal' and this object" podUID="3e652848-576c-47d7-a1f2-f1a4a72768ab" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:53.471260 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.471228    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e652848-576c-47d7-a1f2-f1a4a72768ab-extensions-socket-volume\") pod \"3e652848-576c-47d7-a1f2-f1a4a72768ab\" (UID: \"3e652848-576c-47d7-a1f2-f1a4a72768ab\") "
Jul 24 15:53:53.471465 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.471344    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqbxm\" (UniqueName: \"kubernetes.io/projected/3e652848-576c-47d7-a1f2-f1a4a72768ab-kube-api-access-kqbxm\") pod \"3e652848-576c-47d7-a1f2-f1a4a72768ab\" (UID: \"3e652848-576c-47d7-a1f2-f1a4a72768ab\") "
Jul 24 15:53:53.471531 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.471486    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e652848-576c-47d7-a1f2-f1a4a72768ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3e652848-576c-47d7-a1f2-f1a4a72768ab" (UID: "3e652848-576c-47d7-a1f2-f1a4a72768ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:53:53.471597 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.471585    2600 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e652848-576c-47d7-a1f2-f1a4a72768ab-extensions-socket-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:53:53.473477 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.473449    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e652848-576c-47d7-a1f2-f1a4a72768ab-kube-api-access-kqbxm" (OuterVolumeSpecName: "kube-api-access-kqbxm") pod "3e652848-576c-47d7-a1f2-f1a4a72768ab" (UID: "3e652848-576c-47d7-a1f2-f1a4a72768ab"). InnerVolumeSpecName "kube-api-access-kqbxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:53:53.572004 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.571972    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqbxm\" (UniqueName: \"kubernetes.io/projected/3e652848-576c-47d7-a1f2-f1a4a72768ab-kube-api-access-kqbxm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 15:53:53.840163 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.840128    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:53.996556 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:53.996525    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:54.085256 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:54.085231    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:54.353894 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:54.353866    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:54.357503 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:53:54.357459    2600 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" is forbidden: User \"system:node:ip-10-0-134-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-8.ec2.internal' and this object" podUID="3e652848-576c-47d7-a1f2-f1a4a72768ab" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:54.362091 ip-10-0-134-8 kubenswrapper[2600]: E0724 15:53:54.362061    2600 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kfcgz\" is forbidden: User \"system:node:ip-10-0-134-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-8.ec2.internal' and this object" podUID="3e652848-576c-47d7-a1f2-f1a4a72768ab" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfcgz"
Jul 24 15:53:54.402284 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:54.402252    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e652848-576c-47d7-a1f2-f1a4a72768ab" path="/var/lib/kubelet/pods/3e652848-576c-47d7-a1f2-f1a4a72768ab/volumes"
Jul 24 15:53:56.435554 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:56.435524    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:53:56.545717 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:53:56.545683    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:01.814783 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:01.814752    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:01.872732 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:01.872694    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:02.417300 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:02.417272    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:02.517636 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:02.517591    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:06.028386 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:06.028352    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:06.086625 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:06.086585    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:10.270201 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:10.270163    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:10.370511 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:10.370485    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:14.019224 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:14.019191    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:14.140053 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:14.140024    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:25.350278 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:25.350196    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:25.452032 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:25.452006    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:31.874797 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:31.874764    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:32.069524 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:32.069488    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:33.527156 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.527127    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:33.651340 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.651312    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:33.706267 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.706238    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:33.924451 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.924376    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:54:33.926759 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.926744    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:33.929871 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.929847    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bd4wh\""
Jul 24 15:54:33.929871 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.929857    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 15:54:33.930026 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.929877    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 15:54:33.930749 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.930728    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 15:54:33.936334 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.936312    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:54:33.949744 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.949718    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:54:33.975619 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.975580    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc51cf1f-8a3c-4bb8-ad3a-c35a75399049-config-file\") pod \"limitador-limitador-54d6d988d5-5rwjv\" (UID: \"dc51cf1f-8a3c-4bb8-ad3a-c35a75399049\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:33.975717 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:33.975657    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fhqx\" (UniqueName: \"kubernetes.io/projected/dc51cf1f-8a3c-4bb8-ad3a-c35a75399049-kube-api-access-8fhqx\") pod \"limitador-limitador-54d6d988d5-5rwjv\" (UID: \"dc51cf1f-8a3c-4bb8-ad3a-c35a75399049\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:34.076483 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.076455    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fhqx\" (UniqueName: \"kubernetes.io/projected/dc51cf1f-8a3c-4bb8-ad3a-c35a75399049-kube-api-access-8fhqx\") pod \"limitador-limitador-54d6d988d5-5rwjv\" (UID: \"dc51cf1f-8a3c-4bb8-ad3a-c35a75399049\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:34.076631 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.076518    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc51cf1f-8a3c-4bb8-ad3a-c35a75399049-config-file\") pod \"limitador-limitador-54d6d988d5-5rwjv\" (UID: \"dc51cf1f-8a3c-4bb8-ad3a-c35a75399049\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:34.077160 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.077142    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc51cf1f-8a3c-4bb8-ad3a-c35a75399049-config-file\") pod \"limitador-limitador-54d6d988d5-5rwjv\" (UID: \"dc51cf1f-8a3c-4bb8-ad3a-c35a75399049\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:34.084928 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.084901    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fhqx\" (UniqueName: \"kubernetes.io/projected/dc51cf1f-8a3c-4bb8-ad3a-c35a75399049-kube-api-access-8fhqx\") pod \"limitador-limitador-54d6d988d5-5rwjv\" (UID: \"dc51cf1f-8a3c-4bb8-ad3a-c35a75399049\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:34.237487 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.237454    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:34.369279 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.369259    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:54:34.371426 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:54:34.371401    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51cf1f_8a3c_4bb8_ad3a_c35a75399049.slice/crio-fba31c38ea88abcfff0f3655cdde16a778e4458dd918f69e1663032d444bddef WatchSource:0}: Error finding container fba31c38ea88abcfff0f3655cdde16a778e4458dd918f69e1663032d444bddef: Status 404 returned error can't find the container with id fba31c38ea88abcfff0f3655cdde16a778e4458dd918f69e1663032d444bddef
Jul 24 15:54:34.389727 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.389689    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:34.490405 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.490291    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:34.503177 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:34.503145    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv" event={"ID":"dc51cf1f-8a3c-4bb8-ad3a-c35a75399049","Type":"ContainerStarted","Data":"fba31c38ea88abcfff0f3655cdde16a778e4458dd918f69e1663032d444bddef"}
Jul 24 15:54:37.516306 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:37.516271    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv" event={"ID":"dc51cf1f-8a3c-4bb8-ad3a-c35a75399049","Type":"ContainerStarted","Data":"c6ff7103eebfce2e200d5123bdc367cc0f460609252d7f8de782a7e37f830392"}
Jul 24 15:54:37.516727 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:37.516390    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:37.533003 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:37.532942    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv" podStartSLOduration=2.190788723 podStartE2EDuration="4.532921391s" totalImagesPullingTime="2.342132668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:54:37.532392168 +0000 UTC m=+551.690258888" watchObservedRunningTime="2026-07-24 15:54:37.532921391 +0000 UTC m=+551.690788092"
Jul 24 15:54:48.520951 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:48.520921    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"
Jul 24 15:54:49.714961 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:49.714928    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:49.777483 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:49.777458    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:54:50.165452 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:54:50.165360    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:02.181552 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:02.181495    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:02.424052 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:02.424018    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:11.600338 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:11.600304    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:11.692999 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:11.692965    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:11.754186 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:11.754150    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:14.985206 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:14.985172    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:15.101554 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:15.101497    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:34.649072 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:34.649043    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:46.509689 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:46.509657    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:46.634207 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:46.634162    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:47.015917 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:47.015807    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:47.260028 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:47.259995    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:47.906394 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:47.906366    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:48.011770 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.011741    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:48.059257 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.059230    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"]
Jul 24 15:55:48.061499 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.061483    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:48.065214 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.065194    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 15:55:48.065330 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.065253    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fmtws\""
Jul 24 15:55:48.075880 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.075860    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:55:48.092327 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.092307    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"]
Jul 24 15:55:48.179765 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.179735    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7bh4\" (UniqueName: \"kubernetes.io/projected/563709b3-f8ea-4ded-ba70-5b747361af15-kube-api-access-f7bh4\") pod \"payload-pre-processing-687dbb6cf6-nw6k6\" (UID: \"563709b3-f8ea-4ded-ba70-5b747361af15\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:48.179877 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.179783    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/563709b3-f8ea-4ded-ba70-5b747361af15-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-nw6k6\" (UID: \"563709b3-f8ea-4ded-ba70-5b747361af15\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:48.280665 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.280628    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7bh4\" (UniqueName: \"kubernetes.io/projected/563709b3-f8ea-4ded-ba70-5b747361af15-kube-api-access-f7bh4\") pod \"payload-pre-processing-687dbb6cf6-nw6k6\" (UID: \"563709b3-f8ea-4ded-ba70-5b747361af15\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:48.280820 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.280675    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/563709b3-f8ea-4ded-ba70-5b747361af15-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-nw6k6\" (UID: \"563709b3-f8ea-4ded-ba70-5b747361af15\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:48.281337 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.281313    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/563709b3-f8ea-4ded-ba70-5b747361af15-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-nw6k6\" (UID: \"563709b3-f8ea-4ded-ba70-5b747361af15\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:48.306860 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.306828    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7bh4\" (UniqueName: \"kubernetes.io/projected/563709b3-f8ea-4ded-ba70-5b747361af15-kube-api-access-f7bh4\") pod \"payload-pre-processing-687dbb6cf6-nw6k6\" (UID: \"563709b3-f8ea-4ded-ba70-5b747361af15\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:48.371767 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.371741    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:48.506884 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.506836    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"]
Jul 24 15:55:48.509357 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:55:48.509326    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563709b3_f8ea_4ded_ba70_5b747361af15.slice/crio-6c2ba1367182e32a9188b01abe2bf6f2c434063180417b5031b07976ea45abc8 WatchSource:0}: Error finding container 6c2ba1367182e32a9188b01abe2bf6f2c434063180417b5031b07976ea45abc8: Status 404 returned error can't find the container with id 6c2ba1367182e32a9188b01abe2bf6f2c434063180417b5031b07976ea45abc8
Jul 24 15:55:48.774728 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:48.774642    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6" event={"ID":"563709b3-f8ea-4ded-ba70-5b747361af15","Type":"ContainerStarted","Data":"6c2ba1367182e32a9188b01abe2bf6f2c434063180417b5031b07976ea45abc8"}
Jul 24 15:55:51.789881 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:51.789846    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6" event={"ID":"563709b3-f8ea-4ded-ba70-5b747361af15","Type":"ContainerStarted","Data":"39ecf1462263596683d4d59ea7aa904f62088d916966020ad2a199ce03af78e7"}
Jul 24 15:55:51.790349 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:51.789917    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:55:51.808763 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:51.808709    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6" podStartSLOduration=1.151199143 podStartE2EDuration="3.80869498s" totalImagesPullingTime="2.657495837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:55:51.807460919 +0000 UTC m=+625.965327641" watchObservedRunningTime="2026-07-24 15:55:51.80869498 +0000 UTC m=+625.966561679"
Jul 24 15:55:57.760568 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:57.760532    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:55:57.861426 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:55:57.861401    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:01.674909 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:01.674879    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:02.797675 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:02.797638    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-nw6k6"
Jul 24 15:56:07.392377 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.392343    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"]
Jul 24 15:56:07.398823 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.398799    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.402634 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.402589    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 15:56:07.402775 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.402687    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 15:56:07.402775 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.402720    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 15:56:07.403055 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.403039    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ngjlc\""
Jul 24 15:56:07.405439 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.405421    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"]
Jul 24 15:56:07.427841 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.427813    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:07.433914 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.433895    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.433989 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.433930    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.433989 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.433949    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.433989 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.433964    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bqqm\" (UniqueName: \"kubernetes.io/projected/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-kube-api-access-8bqqm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.434152 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.434057    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.434152 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.434138    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.534759 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.534727    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.534759 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.534767    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.534993 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.534784    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.534993 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.534906    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bqqm\" (UniqueName: \"kubernetes.io/projected/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-kube-api-access-8bqqm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.534993 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.534963    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.535116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.535035    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.535116 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.535079    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.535287 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.535263    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.535423 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.535393    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.537213 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.537193    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.537750 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.537730    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.543336 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.543310    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bqqm\" (UniqueName: \"kubernetes.io/projected/8c03b3da-6711-4f53-92ec-4fba4db7ad5a-kube-api-access-8bqqm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8\" (UID: \"8c03b3da-6711-4f53-92ec-4fba4db7ad5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.710755 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.710711    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:07.850759 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.850732    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"]
Jul 24 15:56:07.853143 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:56:07.853119    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c03b3da_6711_4f53_92ec_4fba4db7ad5a.slice/crio-f611c069cc9e84e1957556225e7ab00e21438eab8ddf1b44b770c693f39310f2 WatchSource:0}: Error finding container f611c069cc9e84e1957556225e7ab00e21438eab8ddf1b44b770c693f39310f2: Status 404 returned error can't find the container with id f611c069cc9e84e1957556225e7ab00e21438eab8ddf1b44b770c693f39310f2
Jul 24 15:56:07.861257 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.861230    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8" event={"ID":"8c03b3da-6711-4f53-92ec-4fba4db7ad5a","Type":"ContainerStarted","Data":"f611c069cc9e84e1957556225e7ab00e21438eab8ddf1b44b770c693f39310f2"}
Jul 24 15:56:07.910436 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:07.910400    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:56:09.872122 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:09.872079    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8" event={"ID":"8c03b3da-6711-4f53-92ec-4fba4db7ad5a","Type":"ContainerStarted","Data":"16a494da9d6947fec69c845453e9dc833704a1de875541a01d4c6508642d37fc"}
Jul 24 15:56:09.891942 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:09.891890    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8" podStartSLOduration=1.68556294 podStartE2EDuration="2.891868412s" totalImagesPullingTime="1.206305472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:56:09.891813719 +0000 UTC m=+644.049680430" watchObservedRunningTime="2026-07-24 15:56:09.891868412 +0000 UTC m=+644.049735114"
Jul 24 15:56:15.415766 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:15.415736    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:15.890596 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:15.890565    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:56:17.711487 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:17.711456    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:17.711881 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:17.711509    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:17.723717 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:17.723697    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:17.915428 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:17.915404    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8"
Jul 24 15:56:24.107932 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:24.107898    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:25.282795 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:25.282758    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:56:39.725575 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:39.725541    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:41.378521 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:41.378486    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:56:48.431905 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:48.431871    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:48.494486 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:48.494458    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:49.382057 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.382024    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"]
Jul 24 15:56:49.385214 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.385192    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.387919 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.387899    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 15:56:49.396596 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.396573    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"]
Jul 24 15:56:49.406265 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.406231    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:56:49.571732 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.571699    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.571732 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.571732    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4763a2cd-8bb9-4799-aced-6e03e192cc43-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.572235 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.571758    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.572235 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.571781    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.572235 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.571874    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.572235 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.571925    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpqhr\" (UniqueName: \"kubernetes.io/projected/4763a2cd-8bb9-4799-aced-6e03e192cc43-kube-api-access-hpqhr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.672918 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.672841    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqhr\" (UniqueName: \"kubernetes.io/projected/4763a2cd-8bb9-4799-aced-6e03e192cc43-kube-api-access-hpqhr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.672918 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.672890    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.672918 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.672910    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4763a2cd-8bb9-4799-aced-6e03e192cc43-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.673138 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.672931    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.673138 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.672959    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.673138 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.672999    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.673325 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.673303    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.673389 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.673356    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.673389 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.673378    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.675513 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.675487    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4763a2cd-8bb9-4799-aced-6e03e192cc43-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.675775 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.675758    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4763a2cd-8bb9-4799-aced-6e03e192cc43-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.680823 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.680803    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpqhr\" (UniqueName: \"kubernetes.io/projected/4763a2cd-8bb9-4799-aced-6e03e192cc43-kube-api-access-hpqhr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x7gd9\" (UID: \"4763a2cd-8bb9-4799-aced-6e03e192cc43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.695251 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.695228    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:49.817644 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.817595    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"]
Jul 24 15:56:49.820829 ip-10-0-134-8 kubenswrapper[2600]: W0724 15:56:49.820803    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4763a2cd_8bb9_4799_aced_6e03e192cc43.slice/crio-150b292f90276db94ba1699b74373379156fe503121a2e7d72a1d4bc4af08906 WatchSource:0}: Error finding container 150b292f90276db94ba1699b74373379156fe503121a2e7d72a1d4bc4af08906: Status 404 returned error can't find the container with id 150b292f90276db94ba1699b74373379156fe503121a2e7d72a1d4bc4af08906
Jul 24 15:56:49.822393 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:49.822373    2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:56:50.032867 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:50.032835    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9" event={"ID":"4763a2cd-8bb9-4799-aced-6e03e192cc43","Type":"ContainerStarted","Data":"150b292f90276db94ba1699b74373379156fe503121a2e7d72a1d4bc4af08906"}
Jul 24 15:56:51.039254 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:51.039222    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9" event={"ID":"4763a2cd-8bb9-4799-aced-6e03e192cc43","Type":"ContainerStarted","Data":"bbb6f22805a9846bc7578ca136e0b61dbd0e0e83016443e019116e4b9d1a4078"}
Jul 24 15:56:51.057235 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:51.057193    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9" podStartSLOduration=0.98408155 podStartE2EDuration="2.05717869s" totalImagesPullingTime="1.07309714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:56:51.05536451 +0000 UTC m=+685.213231234" watchObservedRunningTime="2026-07-24 15:56:51.05717869 +0000 UTC m=+685.215045388"
Jul 24 15:56:52.086199 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:52.086159    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:56:59.696084 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:59.696040    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:59.696682 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:59.696115    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:56:59.708434 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:56:59.708412    2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:57:00.090134 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:57:00.090046    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x7gd9"
Jul 24 15:57:05.021589 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:57:05.021542    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:57:07.390165 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:57:07.390134    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:57:22.268654 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:57:22.268526    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:58:01.887889 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:58:01.887831    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:58:01.993156 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:58:01.993124    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:58:03.157181 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:58:03.157144    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:58:03.290310 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:58:03.290279    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:58:31.191179 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:58:31.191140    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:58:40.886060 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:58:40.886021    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:58:52.571884 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:58:52.571795    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:58:52.587421 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:58:52.587394    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 15:59:20.570763 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:59:20.570713    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 15:59:20.624709 ip-10-0-134-8 kubenswrapper[2600]: I0724 15:59:20.624684    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:05.654980 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:05.654886    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:06.088260 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:06.088224    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:07.255000 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:07.254968    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:08.489078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:08.489047    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:33.986140 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:33.986060    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:00:46.117183 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:46.117146    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:48.338896 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:48.338861    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:52.128625 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:52.128577    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:52.197191 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:52.197162    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:52.288153 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:52.288125    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:52.489516 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:52.489490    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:58.132267 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:58.132235    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:00:58.195397 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:00:58.195370    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:01:13.982261 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:01:13.982228    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:01:23.186987 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:01:23.186952    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:01:30.875651 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:01:30.875616    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:01:38.481171 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:01:38.481142    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:01:49.583722 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:01:49.583637    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:01:59.595119 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:01:59.595082    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:02:05.585057 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:02:05.585023    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:02:11.580281 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:02:11.580246    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:02:21.157838 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:02:21.157804    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:02:21.895964 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:02:21.895930    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:02:44.180043 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:02:44.180014    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:02:53.584143 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:02:53.584103    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:03:16.603193 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:03:16.602030    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:03:26.696544 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:03:26.696457    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:03:43.978931 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:03:43.978898    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:03:53.483392 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:03:53.483352    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:04:03.388208 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:04:03.388169    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:04:13.075513 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:04:13.075474    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:04:22.178504 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:04:22.178469    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:04:31.833663 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:04:31.833631    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:13.190617 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:06:13.190568    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:06:24.585565 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:06:24.585494    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:06:33.602207 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:06:33.602178    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:06:45.899998 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:06:45.899965    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:06:57.290112 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:06:57.290078    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:07:08.293138 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:07:08.293104    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:07:16.401969 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:07:16.401942    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:07:27.692277 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:07:27.692244    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:07:38.696200 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:07:38.696161    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:07:47.884728 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:07:47.884652    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:08:01.685897 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:08:01.685862    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:08:23.714081 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:08:23.714045    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:08:31.489350 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:08:31.489313    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:08:43.336303 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:08:43.336270    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:08:46.191955 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:08:46.191921    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:08:59.485815 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:08:59.485778    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:09:03.894380 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:09:03.894345    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:09:14.784779 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:09:14.784741    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:09:24.211028 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:09:24.210952    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:09:25.298526 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:09:25.298494    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:09:28.289883 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:09:28.289852    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:09:42.387270 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:09:42.387241    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:09:49.187016 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:09:49.186982    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:10:05.892812 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:10:05.892778    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:10:15.593430 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:10:15.593399    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:10:25.084815 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:10:25.084780    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:10:34.392889 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:10:34.392854    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:10:45.880625 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:10:45.880565    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:10:55.384325 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:10:55.384250    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:11:09.292324 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:11:09.292293    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:11:18.340509 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:11:18.340464    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:11:25.487245 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:11:25.487205    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:11:37.595475 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:11:37.595440    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:11:50.692677 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:11:50.692621    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:11:58.998932 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:11:58.998890    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:12:11.808094 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:12:11.808052    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:12:24.094262 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:12:24.094187    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:12:36.794101 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:12:36.794061    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:12:39.898177 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:12:39.898143    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:12:45.992992 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:12:45.992962    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:13:03.631005 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:03.630968    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:06.738590 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:06.738553    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:06.832050 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:06.832020    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:07.223173 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:07.223137    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:07.791283 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:07.791250    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:13:09.824520 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:09.824476    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:12.901530 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:12.901501    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:12.972321 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:12.972285    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:13.163975 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:13.163896    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:13.481081 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:13.481033    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:13.710653 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:13.710622    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:15.736304 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:15.736269    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:15.836210 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:15.836168    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:15.937317 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:15.937288    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:16.198639 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.198578    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:16.561823 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.561730    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:16.711304 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.711250    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:16.906904 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.906828    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"]
Jul 24 16:13:16.910338 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.910318    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:16.911218 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.911194    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ddb7\" (UniqueName: \"kubernetes.io/projected/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-kube-api-access-9ddb7\") pod \"payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn\" (UID: \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\") " pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:16.911327 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.911305    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-plugins-config-volume\") pod \"payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn\" (UID: \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\") " pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:16.914427 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.914409    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c3420287\""
Jul 24 16:13:16.914793 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.914773    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c3420287-dockercfg-cc6ks\""
Jul 24 16:13:16.938836 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.938811    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"]
Jul 24 16:13:16.964913 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.964888    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"]
Jul 24 16:13:16.968037 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.968023    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:16.998199 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:16.998179    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"]
Jul 24 16:13:17.011591 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.011555    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ddb7\" (UniqueName: \"kubernetes.io/projected/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-kube-api-access-9ddb7\") pod \"payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn\" (UID: \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\") " pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:17.011591 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.011590    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp\" (UID: \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:17.011774 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.011654    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-plugins-config-volume\") pod \"payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn\" (UID: \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\") " pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:17.011774 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.011691    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svndn\" (UniqueName: \"kubernetes.io/projected/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-kube-api-access-svndn\") pod \"payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp\" (UID: \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:17.012328 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.012308    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-plugins-config-volume\") pod \"payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn\" (UID: \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\") " pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:17.035322 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.035295    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ddb7\" (UniqueName: \"kubernetes.io/projected/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-kube-api-access-9ddb7\") pod \"payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn\" (UID: \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\") " pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:17.112182 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.112159    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svndn\" (UniqueName: \"kubernetes.io/projected/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-kube-api-access-svndn\") pod \"payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp\" (UID: \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:17.112337 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.112197    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp\" (UID: \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:17.112803 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.112788    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp\" (UID: \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:17.141203 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.141183    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svndn\" (UniqueName: \"kubernetes.io/projected/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-kube-api-access-svndn\") pod \"payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp\" (UID: \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:17.223686 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.223660    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:17.277176 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.277151    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:17.372440 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.372398    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"]
Jul 24 16:13:17.373122 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:13:17.373094    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a22edd_9882_4ae1_bb43_d6cbcd54dcb3.slice/crio-bf59b5047d80b7accafb8f5bdf789230225472eae9f04f9421cf906b84519bef WatchSource:0}: Error finding container bf59b5047d80b7accafb8f5bdf789230225472eae9f04f9421cf906b84519bef: Status 404 returned error can't find the container with id bf59b5047d80b7accafb8f5bdf789230225472eae9f04f9421cf906b84519bef
Jul 24 16:13:17.455470 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:17.455445    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"]
Jul 24 16:13:17.458393 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:13:17.458368    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1d4321_38ff_4ca0_89e5_c52cb01d7fb8.slice/crio-4f6993c3d366eec08fd7b0c87b8cbf52f9de60f37b895527f9fa729e59c50813 WatchSource:0}: Error finding container 4f6993c3d366eec08fd7b0c87b8cbf52f9de60f37b895527f9fa729e59c50813: Status 404 returned error can't find the container with id 4f6993c3d366eec08fd7b0c87b8cbf52f9de60f37b895527f9fa729e59c50813
Jul 24 16:13:18.107012 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.106978    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn" event={"ID":"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3","Type":"ContainerStarted","Data":"76bd203ecf8f43b615c46ba3207afb39266b9efb5580b68e1649abfc9e5d3580"}
Jul 24 16:13:18.107476 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.107047    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn" event={"ID":"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3","Type":"ContainerStarted","Data":"bf59b5047d80b7accafb8f5bdf789230225472eae9f04f9421cf906b84519bef"}
Jul 24 16:13:18.107476 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.107079    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:18.108542 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.108511    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp" event={"ID":"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8","Type":"ContainerStarted","Data":"8c319dd4208e905d2960095c79fb918f147bc9283d32659bdd9f881ba1699c42"}
Jul 24 16:13:18.108751 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.108558    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp" event={"ID":"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8","Type":"ContainerStarted","Data":"4f6993c3d366eec08fd7b0c87b8cbf52f9de60f37b895527f9fa729e59c50813"}
Jul 24 16:13:18.108751 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.108629    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:18.130878 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.130839    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn" podStartSLOduration=2.130824766 podStartE2EDuration="2.130824766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:18.129892021 +0000 UTC m=+1672.287758718" watchObservedRunningTime="2026-07-24 16:13:18.130824766 +0000 UTC m=+1672.288691466"
Jul 24 16:13:18.164464 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.164415    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp" podStartSLOduration=2.164401131 podStartE2EDuration="2.164401131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:18.163488526 +0000 UTC m=+1672.321355227" watchObservedRunningTime="2026-07-24 16:13:18.164401131 +0000 UTC m=+1672.322267857"
Jul 24 16:13:18.749362 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:18.749334    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:13:29.115032 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:29.115000    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:29.115427 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:29.115074    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:41.341660 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.341622    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"]
Jul 24 16:13:41.344812 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.344795    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"
Jul 24 16:13:41.347885 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.347863    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:13:41.348503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.348485    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:13:41.358917 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.358893    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"]
Jul 24 16:13:41.409200 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.409173    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37539928-f47f-475f-aa23-97d29695a816-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c3420287-56jsk\" (UID: \"37539928-f47f-475f-aa23-97d29695a816\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"
Jul 24 16:13:41.509881 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.509853    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37539928-f47f-475f-aa23-97d29695a816-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c3420287-56jsk\" (UID: \"37539928-f47f-475f-aa23-97d29695a816\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"
Jul 24 16:13:41.510428 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.510410    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37539928-f47f-475f-aa23-97d29695a816-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c3420287-56jsk\" (UID: \"37539928-f47f-475f-aa23-97d29695a816\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"
Jul 24 16:13:41.654964 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.654895    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"
Jul 24 16:13:41.815074 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.815038    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"]
Jul 24 16:13:41.817894 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:13:41.817864    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37539928_f47f_475f_aa23_97d29695a816.slice/crio-880b897923b0ba3806f7f6b08c2eb0daa2a2a3b4d6e1770b15510cf21f9d71de WatchSource:0}: Error finding container 880b897923b0ba3806f7f6b08c2eb0daa2a2a3b4d6e1770b15510cf21f9d71de: Status 404 returned error can't find the container with id 880b897923b0ba3806f7f6b08c2eb0daa2a2a3b4d6e1770b15510cf21f9d71de
Jul 24 16:13:41.819879 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:41.819861    2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:13:42.212640 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:42.212595    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk" event={"ID":"37539928-f47f-475f-aa23-97d29695a816","Type":"ContainerStarted","Data":"880b897923b0ba3806f7f6b08c2eb0daa2a2a3b4d6e1770b15510cf21f9d71de"}
Jul 24 16:13:45.228324 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:45.228280    2600 generic.go:356] "Generic (PLEG): container finished" podID="37539928-f47f-475f-aa23-97d29695a816" containerID="01a644ef40f1acac5b9ece1b183e6aa5c7e44810760ee3c57e519e5120ffc8e0" exitCode=0
Jul 24 16:13:45.228324 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:45.228315    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk" event={"ID":"37539928-f47f-475f-aa23-97d29695a816","Type":"ContainerDied","Data":"01a644ef40f1acac5b9ece1b183e6aa5c7e44810760ee3c57e519e5120ffc8e0"}
Jul 24 16:13:46.362197 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:46.362170    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"
Jul 24 16:13:46.451071 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:46.451037    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37539928-f47f-475f-aa23-97d29695a816-maas-api-service-ca\") pod \"37539928-f47f-475f-aa23-97d29695a816\" (UID: \"37539928-f47f-475f-aa23-97d29695a816\") "
Jul 24 16:13:46.451386 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:46.451360    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37539928-f47f-475f-aa23-97d29695a816-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "37539928-f47f-475f-aa23-97d29695a816" (UID: "37539928-f47f-475f-aa23-97d29695a816"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:13:46.552413 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:46.552340    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37539928-f47f-475f-aa23-97d29695a816-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:13:47.237997 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:47.237921    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk" event={"ID":"37539928-f47f-475f-aa23-97d29695a816","Type":"ContainerDied","Data":"880b897923b0ba3806f7f6b08c2eb0daa2a2a3b4d6e1770b15510cf21f9d71de"}
Jul 24 16:13:47.237997 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:47.237960    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"
Jul 24 16:13:47.237997 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:47.237968    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="880b897923b0ba3806f7f6b08c2eb0daa2a2a3b4d6e1770b15510cf21f9d71de"
Jul 24 16:13:51.975026 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:51.974996    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:52.000952 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.000921    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"]
Jul 24 16:13:52.001167 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.001144    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn" podUID="d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3" containerName="payload-processing" containerID="cri-o://76bd203ecf8f43b615c46ba3207afb39266b9efb5580b68e1649abfc9e5d3580" gracePeriod=30
Jul 24 16:13:52.010762 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.010738    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"]
Jul 24 16:13:52.011020 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.010971    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp" podUID="1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8" containerName="payload-pre-processing" containerID="cri-o://8c319dd4208e905d2960095c79fb918f147bc9283d32659bdd9f881ba1699c42" gracePeriod=30
Jul 24 16:13:52.261438 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.261412    2600 generic.go:356] "Generic (PLEG): container finished" podID="d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3" containerID="76bd203ecf8f43b615c46ba3207afb39266b9efb5580b68e1649abfc9e5d3580" exitCode=0
Jul 24 16:13:52.261564 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.261483    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn" event={"ID":"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3","Type":"ContainerDied","Data":"76bd203ecf8f43b615c46ba3207afb39266b9efb5580b68e1649abfc9e5d3580"}
Jul 24 16:13:52.263255 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.263234    2600 generic.go:356] "Generic (PLEG): container finished" podID="1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8" containerID="8c319dd4208e905d2960095c79fb918f147bc9283d32659bdd9f881ba1699c42" exitCode=0
Jul 24 16:13:52.263352 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.263277    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp" event={"ID":"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8","Type":"ContainerDied","Data":"8c319dd4208e905d2960095c79fb918f147bc9283d32659bdd9f881ba1699c42"}
Jul 24 16:13:52.282891 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.282876    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:52.285828 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.285812    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:52.403571 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.403547    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svndn\" (UniqueName: \"kubernetes.io/projected/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-kube-api-access-svndn\") pod \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\" (UID: \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\") "
Jul 24 16:13:52.403748 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.403582    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-plugins-config-volume\") pod \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\" (UID: \"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8\") "
Jul 24 16:13:52.403748 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.403644    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-plugins-config-volume\") pod \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\" (UID: \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\") "
Jul 24 16:13:52.403748 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.403724    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ddb7\" (UniqueName: \"kubernetes.io/projected/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-kube-api-access-9ddb7\") pod \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\" (UID: \"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3\") "
Jul 24 16:13:52.404067 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.404017    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8" (UID: "1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:13:52.404160 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.404087    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3" (UID: "d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:13:52.405854 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.405826    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-kube-api-access-svndn" (OuterVolumeSpecName: "kube-api-access-svndn") pod "1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8" (UID: "1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8"). InnerVolumeSpecName "kube-api-access-svndn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:13:52.405969 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.405896    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-kube-api-access-9ddb7" (OuterVolumeSpecName: "kube-api-access-9ddb7") pod "d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3" (UID: "d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3"). InnerVolumeSpecName "kube-api-access-9ddb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:13:52.504270 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.504246    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ddb7\" (UniqueName: \"kubernetes.io/projected/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-kube-api-access-9ddb7\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:13:52.504270 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.504267    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svndn\" (UniqueName: \"kubernetes.io/projected/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-kube-api-access-svndn\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:13:52.504407 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.504276    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:13:52.504407 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:52.504288    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:13:53.249877 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.249847    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:53.269004 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.268977    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"
Jul 24 16:13:53.269149 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.269012    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp" event={"ID":"1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8","Type":"ContainerDied","Data":"4f6993c3d366eec08fd7b0c87b8cbf52f9de60f37b895527f9fa729e59c50813"}
Jul 24 16:13:53.269149 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.269067    2600 scope.go:117] "RemoveContainer" containerID="8c319dd4208e905d2960095c79fb918f147bc9283d32659bdd9f881ba1699c42"
Jul 24 16:13:53.270448 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.270426    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn" event={"ID":"d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3","Type":"ContainerDied","Data":"bf59b5047d80b7accafb8f5bdf789230225472eae9f04f9421cf906b84519bef"}
Jul 24 16:13:53.270539 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.270451    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"
Jul 24 16:13:53.278729 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.278708    2600 scope.go:117] "RemoveContainer" containerID="76bd203ecf8f43b615c46ba3207afb39266b9efb5580b68e1649abfc9e5d3580"
Jul 24 16:13:53.315006 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.314981    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"]
Jul 24 16:13:53.317450 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.317422    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c3420287-ddcc75fd8-7xglp"]
Jul 24 16:13:53.337695 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.337665    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"]
Jul 24 16:13:53.343254 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:53.343226    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c3420287-fdf59566b-nvvwn"]
Jul 24 16:13:54.402968 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:54.402931    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8" path="/var/lib/kubelet/pods/1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8/volumes"
Jul 24 16:13:54.403460 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:54.403429    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3" path="/var/lib/kubelet/pods/d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3/volumes"
Jul 24 16:13:55.026097 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:55.026064    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:13:56.440980 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:56.440946    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"]
Jul 24 16:13:56.441373 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:56.440996    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:56.445338 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:56.445315    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c3420287-56jsk"]
Jul 24 16:13:56.608221 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:56.608189    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:56.835041 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:56.834948    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:57.081094 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:57.081058    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:57.184255 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:57.184228    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:57.296458 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:57.296433    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:57.657629 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:57.657530    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:57.904550 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:57.904518    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:13:58.402573 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:13:58.402541    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37539928-f47f-475f-aa23-97d29695a816" path="/var/lib/kubelet/pods/37539928-f47f-475f-aa23-97d29695a816/volumes"
Jul 24 16:14:00.059378 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.059350    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.369799    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"]
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370451    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3" containerName="payload-processing"
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370474    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3" containerName="payload-processing"
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370484    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8" containerName="payload-pre-processing"
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370492    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8" containerName="payload-pre-processing"
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370519    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37539928-f47f-475f-aa23-97d29695a816" containerName="revoke-keys"
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370526    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="37539928-f47f-475f-aa23-97d29695a816" containerName="revoke-keys"
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370718    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3a22edd-9882-4ae1-bb43-d6cbcd54dcb3" containerName="payload-processing"
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370741    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e1d4321-38ff-4ca0-89e5-c52cb01d7fb8" containerName="payload-pre-processing"
Jul 24 16:14:00.372290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.370748    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="37539928-f47f-475f-aa23-97d29695a816" containerName="revoke-keys"
Jul 24 16:14:00.376625 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.376575    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.380440 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.380419    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c7a36573-serving-cert\""
Jul 24 16:14:00.381078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.381064    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:14:00.382038 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.382018    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w4m8q\""
Jul 24 16:14:00.382038 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.382030    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:14:00.385209 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.385185    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"]
Jul 24 16:14:00.408734 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.408710    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:00.473915 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.473883    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5bc8\" (UniqueName: \"kubernetes.io/projected/c14a2e52-ef7e-41c5-adb6-2868d7364a53-kube-api-access-p5bc8\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.474085 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.473936    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14a2e52-ef7e-41c5-adb6-2868d7364a53-maas-api-tls\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.474085 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.474031    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14a2e52-ef7e-41c5-adb6-2868d7364a53-openshift-service-ca\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.575396 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.575363    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5bc8\" (UniqueName: \"kubernetes.io/projected/c14a2e52-ef7e-41c5-adb6-2868d7364a53-kube-api-access-p5bc8\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.575512 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.575414    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14a2e52-ef7e-41c5-adb6-2868d7364a53-maas-api-tls\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.575512 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.575457    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14a2e52-ef7e-41c5-adb6-2868d7364a53-openshift-service-ca\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.576101 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.576084    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14a2e52-ef7e-41c5-adb6-2868d7364a53-openshift-service-ca\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.577950 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.577922    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14a2e52-ef7e-41c5-adb6-2868d7364a53-maas-api-tls\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.586576 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.586554    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5bc8\" (UniqueName: \"kubernetes.io/projected/c14a2e52-ef7e-41c5-adb6-2868d7364a53-kube-api-access-p5bc8\") pod \"maas-api-e2e-migrate-c7a36573-5598655465-lvqq6\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.631183 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.631094    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:00.688341 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.688315    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:00.821521 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:00.821500    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"]
Jul 24 16:14:00.823621 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:14:00.823579    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14a2e52_ef7e_41c5_adb6_2868d7364a53.slice/crio-6bf5b1c5e63868c220f55eddeaaf76cbbd79800358c3e78b6ce04ea798ebf13b WatchSource:0}: Error finding container 6bf5b1c5e63868c220f55eddeaaf76cbbd79800358c3e78b6ce04ea798ebf13b: Status 404 returned error can't find the container with id 6bf5b1c5e63868c220f55eddeaaf76cbbd79800358c3e78b6ce04ea798ebf13b
Jul 24 16:14:01.144075 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.144045    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:01.238781 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.238742    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:01.311206 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.311169    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6" event={"ID":"c14a2e52-ef7e-41c5-adb6-2868d7364a53","Type":"ContainerStarted","Data":"6bf5b1c5e63868c220f55eddeaaf76cbbd79800358c3e78b6ce04ea798ebf13b"}
Jul 24 16:14:01.322462 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.322435    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"]
Jul 24 16:14:01.326251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.326228    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:01.329800 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.329776    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-c7a36573-dockercfg-p4844\""
Jul 24 16:14:01.330344 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.330324    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-c7a36573\""
Jul 24 16:14:01.342648 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.342382    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"]
Jul 24 16:14:01.391685 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.391657    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"]
Jul 24 16:14:01.396532 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.396467    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:01.406857 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.405622    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"]
Jul 24 16:14:01.484783 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.484751    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe510033-d349-48d6-a9c1-b9674512422e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c\" (UID: \"fe510033-d349-48d6-a9c1-b9674512422e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:01.484951 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.484863    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hclww\" (UniqueName: \"kubernetes.io/projected/ee343ac1-44f4-4c33-b501-203e09c5fd0f-kube-api-access-hclww\") pod \"payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t\" (UID: \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:01.484951 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.484883    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v7h9\" (UniqueName: \"kubernetes.io/projected/fe510033-d349-48d6-a9c1-b9674512422e-kube-api-access-7v7h9\") pod \"payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c\" (UID: \"fe510033-d349-48d6-a9c1-b9674512422e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:01.484951 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.484911    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee343ac1-44f4-4c33-b501-203e09c5fd0f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t\" (UID: \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:01.586399 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.586362    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hclww\" (UniqueName: \"kubernetes.io/projected/ee343ac1-44f4-4c33-b501-203e09c5fd0f-kube-api-access-hclww\") pod \"payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t\" (UID: \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:01.586399 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.586410    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v7h9\" (UniqueName: \"kubernetes.io/projected/fe510033-d349-48d6-a9c1-b9674512422e-kube-api-access-7v7h9\") pod \"payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c\" (UID: \"fe510033-d349-48d6-a9c1-b9674512422e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:01.586653 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.586441    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee343ac1-44f4-4c33-b501-203e09c5fd0f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t\" (UID: \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:01.586653 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.586510    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe510033-d349-48d6-a9c1-b9674512422e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c\" (UID: \"fe510033-d349-48d6-a9c1-b9674512422e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:01.587473 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.587418    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe510033-d349-48d6-a9c1-b9674512422e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c\" (UID: \"fe510033-d349-48d6-a9c1-b9674512422e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:01.587729 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.587706    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee343ac1-44f4-4c33-b501-203e09c5fd0f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t\" (UID: \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:01.597087 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.597062    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hclww\" (UniqueName: \"kubernetes.io/projected/ee343ac1-44f4-4c33-b501-203e09c5fd0f-kube-api-access-hclww\") pod \"payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t\" (UID: \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:01.597208 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.597061    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v7h9\" (UniqueName: \"kubernetes.io/projected/fe510033-d349-48d6-a9c1-b9674512422e-kube-api-access-7v7h9\") pod \"payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c\" (UID: \"fe510033-d349-48d6-a9c1-b9674512422e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:01.642019 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.641993    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:01.711311 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.711283    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:01.846555 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.846168    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"]
Jul 24 16:14:01.852448 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:14:01.852417    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe510033_d349_48d6_a9c1_b9674512422e.slice/crio-b773c8510279c36ac2f4c5c001a99b9fcd7b6b7787586343b6def76881f91835 WatchSource:0}: Error finding container b773c8510279c36ac2f4c5c001a99b9fcd7b6b7787586343b6def76881f91835: Status 404 returned error can't find the container with id b773c8510279c36ac2f4c5c001a99b9fcd7b6b7787586343b6def76881f91835
Jul 24 16:14:01.923386 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:01.923358    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"]
Jul 24 16:14:01.925128 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:14:01.925098    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee343ac1_44f4_4c33_b501_203e09c5fd0f.slice/crio-875698b7564d3edb357196d586256db2b3ef035b408987d162451adab27b0e05 WatchSource:0}: Error finding container 875698b7564d3edb357196d586256db2b3ef035b408987d162451adab27b0e05: Status 404 returned error can't find the container with id 875698b7564d3edb357196d586256db2b3ef035b408987d162451adab27b0e05
Jul 24 16:14:02.319306 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:02.319207    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t" event={"ID":"ee343ac1-44f4-4c33-b501-203e09c5fd0f","Type":"ContainerStarted","Data":"412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194"}
Jul 24 16:14:02.319306 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:02.319272    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t" event={"ID":"ee343ac1-44f4-4c33-b501-203e09c5fd0f","Type":"ContainerStarted","Data":"875698b7564d3edb357196d586256db2b3ef035b408987d162451adab27b0e05"}
Jul 24 16:14:02.319833 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:02.319396    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:02.321338 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:02.321316    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c" event={"ID":"fe510033-d349-48d6-a9c1-b9674512422e","Type":"ContainerStarted","Data":"70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce"}
Jul 24 16:14:02.321466 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:02.321351    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c" event={"ID":"fe510033-d349-48d6-a9c1-b9674512422e","Type":"ContainerStarted","Data":"b773c8510279c36ac2f4c5c001a99b9fcd7b6b7787586343b6def76881f91835"}
Jul 24 16:14:02.321466 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:02.321458    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:02.405497 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:02.405450    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c" podStartSLOduration=1.405433685 podStartE2EDuration="1.405433685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:02.403702921 +0000 UTC m=+1716.561569626" watchObservedRunningTime="2026-07-24 16:14:02.405433685 +0000 UTC m=+1716.563300383"
Jul 24 16:14:02.405694 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:02.405527    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t" podStartSLOduration=1.405522422 podStartE2EDuration="1.405522422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:02.358963025 +0000 UTC m=+1716.516829759" watchObservedRunningTime="2026-07-24 16:14:02.405522422 +0000 UTC m=+1716.563389121"
Jul 24 16:14:03.329562 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:03.329528    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6" event={"ID":"c14a2e52-ef7e-41c5-adb6-2868d7364a53","Type":"ContainerStarted","Data":"424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb"}
Jul 24 16:14:03.330044 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:03.329793    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:03.356788 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:03.356703    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6" podStartSLOduration=1.085466947 podStartE2EDuration="3.356690454s" totalImagesPullingTime="2.271223507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:03.355424783 +0000 UTC m=+1717.513291482" watchObservedRunningTime="2026-07-24 16:14:03.356690454 +0000 UTC m=+1717.514557152"
Jul 24 16:14:07.689942 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:07.689912    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:14:09.344774 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:09.344747    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:13.332132 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:13.332098    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:13.332554 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:13.332254    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:23.626074 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:23.626028    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:25.076126 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.076095    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"]
Jul 24 16:14:25.079719 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.079699    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"
Jul 24 16:14:25.082281 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.082257    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:14:25.086891 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.086549    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"]
Jul 24 16:14:25.176508 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.176479    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48d58b28-0a05-4c27-9b99-7658306eb2b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl\" (UID: \"48d58b28-0a05-4c27-9b99-7658306eb2b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"
Jul 24 16:14:25.277424 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.277402    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48d58b28-0a05-4c27-9b99-7658306eb2b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl\" (UID: \"48d58b28-0a05-4c27-9b99-7658306eb2b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"
Jul 24 16:14:25.277971 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.277953    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48d58b28-0a05-4c27-9b99-7658306eb2b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl\" (UID: \"48d58b28-0a05-4c27-9b99-7658306eb2b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"
Jul 24 16:14:25.392095 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.392041    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"
Jul 24 16:14:25.519631 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:25.519582    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"]
Jul 24 16:14:25.523367 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:14:25.523343    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d58b28_0a05_4c27_9b99_7658306eb2b2.slice/crio-d578ab6aef56bdcf558a2dfe97cfc4ab5d932012c0ad86a3b14b075eaaa0b4b7 WatchSource:0}: Error finding container d578ab6aef56bdcf558a2dfe97cfc4ab5d932012c0ad86a3b14b075eaaa0b4b7: Status 404 returned error can't find the container with id d578ab6aef56bdcf558a2dfe97cfc4ab5d932012c0ad86a3b14b075eaaa0b4b7
Jul 24 16:14:26.439426 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:26.439395    2600 generic.go:356] "Generic (PLEG): container finished" podID="48d58b28-0a05-4c27-9b99-7658306eb2b2" containerID="36cd1fdde2be6cf30d396082357614b2745b436d1e8f0db936f878e2eb6a52c4" exitCode=0
Jul 24 16:14:26.439765 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:26.439449    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl" event={"ID":"48d58b28-0a05-4c27-9b99-7658306eb2b2","Type":"ContainerDied","Data":"36cd1fdde2be6cf30d396082357614b2745b436d1e8f0db936f878e2eb6a52c4"}
Jul 24 16:14:26.439765 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:26.439493    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl" event={"ID":"48d58b28-0a05-4c27-9b99-7658306eb2b2","Type":"ContainerStarted","Data":"d578ab6aef56bdcf558a2dfe97cfc4ab5d932012c0ad86a3b14b075eaaa0b4b7"}
Jul 24 16:14:27.572857 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:27.572831    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"
Jul 24 16:14:27.696167 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:27.696092    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48d58b28-0a05-4c27-9b99-7658306eb2b2-maas-api-service-ca\") pod \"48d58b28-0a05-4c27-9b99-7658306eb2b2\" (UID: \"48d58b28-0a05-4c27-9b99-7658306eb2b2\") "
Jul 24 16:14:27.696471 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:27.696447    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48d58b28-0a05-4c27-9b99-7658306eb2b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "48d58b28-0a05-4c27-9b99-7658306eb2b2" (UID: "48d58b28-0a05-4c27-9b99-7658306eb2b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:14:27.797101 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:27.797077    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48d58b28-0a05-4c27-9b99-7658306eb2b2-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:14:28.448207 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:28.448179    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl" event={"ID":"48d58b28-0a05-4c27-9b99-7658306eb2b2","Type":"ContainerDied","Data":"d578ab6aef56bdcf558a2dfe97cfc4ab5d932012c0ad86a3b14b075eaaa0b4b7"}
Jul 24 16:14:28.448207 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:28.448205    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"
Jul 24 16:14:28.448376 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:28.448232    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d578ab6aef56bdcf558a2dfe97cfc4ab5d932012c0ad86a3b14b075eaaa0b4b7"
Jul 24 16:14:35.574987 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.574952    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"]
Jul 24 16:14:35.575363 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.575144    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6" podUID="c14a2e52-ef7e-41c5-adb6-2868d7364a53" containerName="maas-api" containerID="cri-o://424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb" gracePeriod=30
Jul 24 16:14:35.642747 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.642718    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:35.682778 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.682753    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"]
Jul 24 16:14:35.682954 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.682935    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t" podUID="ee343ac1-44f4-4c33-b501-203e09c5fd0f" containerName="payload-processing" containerID="cri-o://412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194" gracePeriod=30
Jul 24 16:14:35.685528 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.685505    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"]
Jul 24 16:14:35.685784 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.685738    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c" podUID="fe510033-d349-48d6-a9c1-b9674512422e" containerName="payload-pre-processing" containerID="cri-o://70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce" gracePeriod=30
Jul 24 16:14:35.735070 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.735021    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:35.832226 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.832193    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:35.856141 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.855995    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:35.945407 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.945388    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:35.949188 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.949160    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:35.959156 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.959139    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14a2e52-ef7e-41c5-adb6-2868d7364a53-openshift-service-ca\") pod \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") "
Jul 24 16:14:35.959231 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.959183    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5bc8\" (UniqueName: \"kubernetes.io/projected/c14a2e52-ef7e-41c5-adb6-2868d7364a53-kube-api-access-p5bc8\") pod \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") "
Jul 24 16:14:35.959269 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.959238    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14a2e52-ef7e-41c5-adb6-2868d7364a53-maas-api-tls\") pod \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\" (UID: \"c14a2e52-ef7e-41c5-adb6-2868d7364a53\") "
Jul 24 16:14:35.959427 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.959408    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14a2e52-ef7e-41c5-adb6-2868d7364a53-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c14a2e52-ef7e-41c5-adb6-2868d7364a53" (UID: "c14a2e52-ef7e-41c5-adb6-2868d7364a53"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:14:35.959567 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.959549    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14a2e52-ef7e-41c5-adb6-2868d7364a53-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:14:35.961404 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.961382    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14a2e52-ef7e-41c5-adb6-2868d7364a53-kube-api-access-p5bc8" (OuterVolumeSpecName: "kube-api-access-p5bc8") pod "c14a2e52-ef7e-41c5-adb6-2868d7364a53" (UID: "c14a2e52-ef7e-41c5-adb6-2868d7364a53"). InnerVolumeSpecName "kube-api-access-p5bc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:35.961472 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:35.961427    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14a2e52-ef7e-41c5-adb6-2868d7364a53-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c14a2e52-ef7e-41c5-adb6-2868d7364a53" (UID: "c14a2e52-ef7e-41c5-adb6-2868d7364a53"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:14:36.060136 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.060112    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v7h9\" (UniqueName: \"kubernetes.io/projected/fe510033-d349-48d6-a9c1-b9674512422e-kube-api-access-7v7h9\") pod \"fe510033-d349-48d6-a9c1-b9674512422e\" (UID: \"fe510033-d349-48d6-a9c1-b9674512422e\") "
Jul 24 16:14:36.060294 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.060162    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe510033-d349-48d6-a9c1-b9674512422e-plugins-config-volume\") pod \"fe510033-d349-48d6-a9c1-b9674512422e\" (UID: \"fe510033-d349-48d6-a9c1-b9674512422e\") "
Jul 24 16:14:36.060294 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.060181    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee343ac1-44f4-4c33-b501-203e09c5fd0f-plugins-config-volume\") pod \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\" (UID: \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\") "
Jul 24 16:14:36.060294 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.060223    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hclww\" (UniqueName: \"kubernetes.io/projected/ee343ac1-44f4-4c33-b501-203e09c5fd0f-kube-api-access-hclww\") pod \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\" (UID: \"ee343ac1-44f4-4c33-b501-203e09c5fd0f\") "
Jul 24 16:14:36.060472 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.060410    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5bc8\" (UniqueName: \"kubernetes.io/projected/c14a2e52-ef7e-41c5-adb6-2868d7364a53-kube-api-access-p5bc8\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:14:36.060472 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.060430    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14a2e52-ef7e-41c5-adb6-2868d7364a53-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:14:36.060569 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.060525    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe510033-d349-48d6-a9c1-b9674512422e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe510033-d349-48d6-a9c1-b9674512422e" (UID: "fe510033-d349-48d6-a9c1-b9674512422e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:14:36.060643 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.060571    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee343ac1-44f4-4c33-b501-203e09c5fd0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee343ac1-44f4-4c33-b501-203e09c5fd0f" (UID: "ee343ac1-44f4-4c33-b501-203e09c5fd0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:14:36.062355 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.062333    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe510033-d349-48d6-a9c1-b9674512422e-kube-api-access-7v7h9" (OuterVolumeSpecName: "kube-api-access-7v7h9") pod "fe510033-d349-48d6-a9c1-b9674512422e" (UID: "fe510033-d349-48d6-a9c1-b9674512422e"). InnerVolumeSpecName "kube-api-access-7v7h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:36.062438 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.062419    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee343ac1-44f4-4c33-b501-203e09c5fd0f-kube-api-access-hclww" (OuterVolumeSpecName: "kube-api-access-hclww") pod "ee343ac1-44f4-4c33-b501-203e09c5fd0f" (UID: "ee343ac1-44f4-4c33-b501-203e09c5fd0f"). InnerVolumeSpecName "kube-api-access-hclww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:36.161864 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.161810    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe510033-d349-48d6-a9c1-b9674512422e-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:14:36.161864 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.161830    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee343ac1-44f4-4c33-b501-203e09c5fd0f-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:14:36.161864 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.161839    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hclww\" (UniqueName: \"kubernetes.io/projected/ee343ac1-44f4-4c33-b501-203e09c5fd0f-kube-api-access-hclww\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:14:36.161864 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.161850    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v7h9\" (UniqueName: \"kubernetes.io/projected/fe510033-d349-48d6-a9c1-b9674512422e-kube-api-access-7v7h9\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:14:36.486282 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.486245    2600 generic.go:356] "Generic (PLEG): container finished" podID="ee343ac1-44f4-4c33-b501-203e09c5fd0f" containerID="412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194" exitCode=0
Jul 24 16:14:36.486403 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.486297    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"
Jul 24 16:14:36.486403 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.486330    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t" event={"ID":"ee343ac1-44f4-4c33-b501-203e09c5fd0f","Type":"ContainerDied","Data":"412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194"}
Jul 24 16:14:36.486514 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.486405    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t" event={"ID":"ee343ac1-44f4-4c33-b501-203e09c5fd0f","Type":"ContainerDied","Data":"875698b7564d3edb357196d586256db2b3ef035b408987d162451adab27b0e05"}
Jul 24 16:14:36.486514 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.486429    2600 scope.go:117] "RemoveContainer" containerID="412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194"
Jul 24 16:14:36.487760 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.487738    2600 generic.go:356] "Generic (PLEG): container finished" podID="c14a2e52-ef7e-41c5-adb6-2868d7364a53" containerID="424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb" exitCode=0
Jul 24 16:14:36.487871 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.487790    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"
Jul 24 16:14:36.487871 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.487827    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6" event={"ID":"c14a2e52-ef7e-41c5-adb6-2868d7364a53","Type":"ContainerDied","Data":"424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb"}
Jul 24 16:14:36.488136 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.487876    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6" event={"ID":"c14a2e52-ef7e-41c5-adb6-2868d7364a53","Type":"ContainerDied","Data":"6bf5b1c5e63868c220f55eddeaaf76cbbd79800358c3e78b6ce04ea798ebf13b"}
Jul 24 16:14:36.489661 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.489594    2600 generic.go:356] "Generic (PLEG): container finished" podID="fe510033-d349-48d6-a9c1-b9674512422e" containerID="70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce" exitCode=0
Jul 24 16:14:36.489661 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.489649    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c" event={"ID":"fe510033-d349-48d6-a9c1-b9674512422e","Type":"ContainerDied","Data":"70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce"}
Jul 24 16:14:36.489793 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.489698    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c" event={"ID":"fe510033-d349-48d6-a9c1-b9674512422e","Type":"ContainerDied","Data":"b773c8510279c36ac2f4c5c001a99b9fcd7b6b7787586343b6def76881f91835"}
Jul 24 16:14:36.489793 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.489663    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"
Jul 24 16:14:36.496214 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.496198    2600 scope.go:117] "RemoveContainer" containerID="412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194"
Jul 24 16:14:36.496493 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:14:36.496467    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194\": container with ID starting with 412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194 not found: ID does not exist" containerID="412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194"
Jul 24 16:14:36.496573 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.496489    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194"} err="failed to get container status \"412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194\": rpc error: code = NotFound desc = could not find container \"412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194\": container with ID starting with 412a8f76cfb10daa590bc9d825a5cfa842fee04dab6d5e15101174223a07e194 not found: ID does not exist"
Jul 24 16:14:36.496573 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.496503    2600 scope.go:117] "RemoveContainer" containerID="424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb"
Jul 24 16:14:36.503869 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.503853    2600 scope.go:117] "RemoveContainer" containerID="424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb"
Jul 24 16:14:36.504106 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:14:36.504091    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb\": container with ID starting with 424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb not found: ID does not exist" containerID="424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb"
Jul 24 16:14:36.504165 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.504111    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb"} err="failed to get container status \"424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb\": rpc error: code = NotFound desc = could not find container \"424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb\": container with ID starting with 424e30aacaa91c82f9ad25079451ea13c6cd4a841f75a38e11ec7d9d202c9abb not found: ID does not exist"
Jul 24 16:14:36.504165 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.504126    2600 scope.go:117] "RemoveContainer" containerID="70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce"
Jul 24 16:14:36.511230 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.511209    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"]
Jul 24 16:14:36.512414 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.512399    2600 scope.go:117] "RemoveContainer" containerID="70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce"
Jul 24 16:14:36.512659 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:14:36.512640    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce\": container with ID starting with 70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce not found: ID does not exist" containerID="70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce"
Jul 24 16:14:36.512711 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.512663    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce"} err="failed to get container status \"70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce\": rpc error: code = NotFound desc = could not find container \"70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce\": container with ID starting with 70d57d485dcd10f6c47e3f456825d73c2c98d8a6a01c27201577a2ffb1a579ce not found: ID does not exist"
Jul 24 16:14:36.515947 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.515927    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7a36573-d7578479c-hdg2t"]
Jul 24 16:14:36.526147 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.526127    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"]
Jul 24 16:14:36.529712 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.529693    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7a36573-5598655465-lvqq6"]
Jul 24 16:14:36.539948 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.539928    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"]
Jul 24 16:14:36.544343 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:36.544324    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7a36573-7799745976-wnk2c"]
Jul 24 16:14:38.186252 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:38.186210    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:14:38.403263 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:38.403232    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14a2e52-ef7e-41c5-adb6-2868d7364a53" path="/var/lib/kubelet/pods/c14a2e52-ef7e-41c5-adb6-2868d7364a53/volumes"
Jul 24 16:14:38.403566 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:38.403554    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee343ac1-44f4-4c33-b501-203e09c5fd0f" path="/var/lib/kubelet/pods/ee343ac1-44f4-4c33-b501-203e09c5fd0f/volumes"
Jul 24 16:14:38.403886 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:38.403873    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe510033-d349-48d6-a9c1-b9674512422e" path="/var/lib/kubelet/pods/fe510033-d349-48d6-a9c1-b9674512422e/volumes"
Jul 24 16:14:40.148287 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:40.148257    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"]
Jul 24 16:14:40.150600 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:40.150576    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7a36573-gs9kl"]
Jul 24 16:14:40.152705 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:40.152678    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:40.306546 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:40.306516    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:40.402818 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:40.402733    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48d58b28-0a05-4c27-9b99-7658306eb2b2" path="/var/lib/kubelet/pods/48d58b28-0a05-4c27-9b99-7658306eb2b2/volumes"
Jul 24 16:14:40.550803 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:40.550768    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:40.782985 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:40.782948    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:41.110479 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:41.110398    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:41.283350 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:41.283314    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:43.109018 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.108984    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:43.204860 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.204832    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"]
Jul 24 16:14:43.205145 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205132    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d58b28-0a05-4c27-9b99-7658306eb2b2" containerName="revoke-keys"
Jul 24 16:14:43.205191 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205147    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d58b28-0a05-4c27-9b99-7658306eb2b2" containerName="revoke-keys"
Jul 24 16:14:43.205191 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205159    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee343ac1-44f4-4c33-b501-203e09c5fd0f" containerName="payload-processing"
Jul 24 16:14:43.205191 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205165    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee343ac1-44f4-4c33-b501-203e09c5fd0f" containerName="payload-processing"
Jul 24 16:14:43.205191 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205173    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe510033-d349-48d6-a9c1-b9674512422e" containerName="payload-pre-processing"
Jul 24 16:14:43.205191 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205181    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe510033-d349-48d6-a9c1-b9674512422e" containerName="payload-pre-processing"
Jul 24 16:14:43.205191 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205187    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14a2e52-ef7e-41c5-adb6-2868d7364a53" containerName="maas-api"
Jul 24 16:14:43.205191 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205192    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14a2e52-ef7e-41c5-adb6-2868d7364a53" containerName="maas-api"
Jul 24 16:14:43.205413 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205270    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe510033-d349-48d6-a9c1-b9674512422e" containerName="payload-pre-processing"
Jul 24 16:14:43.205413 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205279    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="48d58b28-0a05-4c27-9b99-7658306eb2b2" containerName="revoke-keys"
Jul 24 16:14:43.205413 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205287    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee343ac1-44f4-4c33-b501-203e09c5fd0f" containerName="payload-processing"
Jul 24 16:14:43.205413 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.205293    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14a2e52-ef7e-41c5-adb6-2868d7364a53" containerName="maas-api"
Jul 24 16:14:43.207754 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.207730    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:43.208343 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.208327    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.211246 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.211224    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:14:43.212299 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.212279    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:14:43.212398 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.212297    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w4m8q\""
Jul 24 16:14:43.212517 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.212500    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-518181e2-serving-cert\""
Jul 24 16:14:43.218844 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.218823    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"]
Jul 24 16:14:43.282320 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.282296    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:43.314448 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.314423    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mvh\" (UniqueName: \"kubernetes.io/projected/466fe048-552a-4eae-87f3-ce0ac09ae2e1-kube-api-access-65mvh\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.314574 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.314473    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/466fe048-552a-4eae-87f3-ce0ac09ae2e1-openshift-service-ca\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.314574 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.314531    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/466fe048-552a-4eae-87f3-ce0ac09ae2e1-maas-api-tls\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.381165 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.381094    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:43.415083 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.415060    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mvh\" (UniqueName: \"kubernetes.io/projected/466fe048-552a-4eae-87f3-ce0ac09ae2e1-kube-api-access-65mvh\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.415179 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.415116    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/466fe048-552a-4eae-87f3-ce0ac09ae2e1-openshift-service-ca\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.415179 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.415137    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/466fe048-552a-4eae-87f3-ce0ac09ae2e1-maas-api-tls\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.415823 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.415795    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/466fe048-552a-4eae-87f3-ce0ac09ae2e1-openshift-service-ca\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.417573 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.417552    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/466fe048-552a-4eae-87f3-ce0ac09ae2e1-maas-api-tls\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.424826 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.424804    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mvh\" (UniqueName: \"kubernetes.io/projected/466fe048-552a-4eae-87f3-ce0ac09ae2e1-kube-api-access-65mvh\") pod \"maas-api-e2e-ait-518181e2-6955c96f44-r88fw\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.519196 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.519175    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:43.649422 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.649401    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"]
Jul 24 16:14:43.653725 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:14:43.653694    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466fe048_552a_4eae_87f3_ce0ac09ae2e1.slice/crio-60d73a5b990a2f3ad718b1189155053b3b77a7e8e2daa650a364718c2e7c2e11 WatchSource:0}: Error finding container 60d73a5b990a2f3ad718b1189155053b3b77a7e8e2daa650a364718c2e7c2e11: Status 404 returned error can't find the container with id 60d73a5b990a2f3ad718b1189155053b3b77a7e8e2daa650a364718c2e7c2e11
Jul 24 16:14:43.773132 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.773089    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:43.873216 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.873191    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:43.879976 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.879954    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"]
Jul 24 16:14:43.882862 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.882845    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:43.885769 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.885752    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-518181e2-dockercfg-99nwt\""
Jul 24 16:14:43.885853 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.885787    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-518181e2\""
Jul 24 16:14:43.894643 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.894621    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"]
Jul 24 16:14:43.916697 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.916630    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"]
Jul 24 16:14:43.918914 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.918894    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:43.930392 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:43.930362    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"]
Jul 24 16:14:44.020194 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.020165    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbs24\" (UniqueName: \"kubernetes.io/projected/ba78ae85-2268-4afc-9706-9023430b8d25-kube-api-access-qbs24\") pod \"payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5\" (UID: \"ba78ae85-2268-4afc-9706-9023430b8d25\") " pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:44.020367 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.020287    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba78ae85-2268-4afc-9706-9023430b8d25-plugins-config-volume\") pod \"payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5\" (UID: \"ba78ae85-2268-4afc-9706-9023430b8d25\") " pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:44.020367 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.020323    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f57d897-6884-4eab-a020-8c472464def6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l\" (UID: \"2f57d897-6884-4eab-a020-8c472464def6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:44.020367 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.020349    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8fcb\" (UniqueName: \"kubernetes.io/projected/2f57d897-6884-4eab-a020-8c472464def6-kube-api-access-g8fcb\") pod \"payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l\" (UID: \"2f57d897-6884-4eab-a020-8c472464def6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:44.120754 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.120733    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba78ae85-2268-4afc-9706-9023430b8d25-plugins-config-volume\") pod \"payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5\" (UID: \"ba78ae85-2268-4afc-9706-9023430b8d25\") " pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:44.121064 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.120762    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f57d897-6884-4eab-a020-8c472464def6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l\" (UID: \"2f57d897-6884-4eab-a020-8c472464def6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:44.121064 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.120784    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8fcb\" (UniqueName: \"kubernetes.io/projected/2f57d897-6884-4eab-a020-8c472464def6-kube-api-access-g8fcb\") pod \"payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l\" (UID: \"2f57d897-6884-4eab-a020-8c472464def6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:44.121064 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.120812    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbs24\" (UniqueName: \"kubernetes.io/projected/ba78ae85-2268-4afc-9706-9023430b8d25-kube-api-access-qbs24\") pod \"payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5\" (UID: \"ba78ae85-2268-4afc-9706-9023430b8d25\") " pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:44.121509 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.121491    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba78ae85-2268-4afc-9706-9023430b8d25-plugins-config-volume\") pod \"payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5\" (UID: \"ba78ae85-2268-4afc-9706-9023430b8d25\") " pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:44.121672 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.121653    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f57d897-6884-4eab-a020-8c472464def6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l\" (UID: \"2f57d897-6884-4eab-a020-8c472464def6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:44.131344 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.131319    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbs24\" (UniqueName: \"kubernetes.io/projected/ba78ae85-2268-4afc-9706-9023430b8d25-kube-api-access-qbs24\") pod \"payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5\" (UID: \"ba78ae85-2268-4afc-9706-9023430b8d25\") " pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:44.132144 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.132124    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8fcb\" (UniqueName: \"kubernetes.io/projected/2f57d897-6884-4eab-a020-8c472464def6-kube-api-access-g8fcb\") pod \"payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l\" (UID: \"2f57d897-6884-4eab-a020-8c472464def6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:44.193275 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.193242    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:44.228567 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.228538    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:44.335777 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.335737    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"]
Jul 24 16:14:44.338381 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:14:44.338351    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f57d897_6884_4eab_a020_8c472464def6.slice/crio-bd92961688a54bf587a915a83ee82a589329e62d604666372f6b27c7dc9a555a WatchSource:0}: Error finding container bd92961688a54bf587a915a83ee82a589329e62d604666372f6b27c7dc9a555a: Status 404 returned error can't find the container with id bd92961688a54bf587a915a83ee82a589329e62d604666372f6b27c7dc9a555a
Jul 24 16:14:44.371052 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.371029    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"]
Jul 24 16:14:44.373734 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:14:44.373707    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba78ae85_2268_4afc_9706_9023430b8d25.slice/crio-e0f9720ab5b776fb59c9d84be291cd7ec2094dcdcaca9ce09c3c30e54831e652 WatchSource:0}: Error finding container e0f9720ab5b776fb59c9d84be291cd7ec2094dcdcaca9ce09c3c30e54831e652: Status 404 returned error can't find the container with id e0f9720ab5b776fb59c9d84be291cd7ec2094dcdcaca9ce09c3c30e54831e652
Jul 24 16:14:44.529903 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.529806    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw" event={"ID":"466fe048-552a-4eae-87f3-ce0ac09ae2e1","Type":"ContainerStarted","Data":"809babb14aa237c746ff2a827ee14c120c71d5f2f8d620a9fd6e5b42fbbd0fd6"}
Jul 24 16:14:44.529903 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.529870    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw" event={"ID":"466fe048-552a-4eae-87f3-ce0ac09ae2e1","Type":"ContainerStarted","Data":"60d73a5b990a2f3ad718b1189155053b3b77a7e8e2daa650a364718c2e7c2e11"}
Jul 24 16:14:44.529903 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.529899    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:44.531426 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.531401    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l" event={"ID":"2f57d897-6884-4eab-a020-8c472464def6","Type":"ContainerStarted","Data":"88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50"}
Jul 24 16:14:44.531540 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.531448    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l" event={"ID":"2f57d897-6884-4eab-a020-8c472464def6","Type":"ContainerStarted","Data":"bd92961688a54bf587a915a83ee82a589329e62d604666372f6b27c7dc9a555a"}
Jul 24 16:14:44.531540 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.531512    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:44.533105 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.533078    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5" event={"ID":"ba78ae85-2268-4afc-9706-9023430b8d25","Type":"ContainerStarted","Data":"a012fff62ce68978b2488345602686a482a7361bf6b4a40eabcd18518fbf55fe"}
Jul 24 16:14:44.533213 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.533116    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5" event={"ID":"ba78ae85-2268-4afc-9706-9023430b8d25","Type":"ContainerStarted","Data":"e0f9720ab5b776fb59c9d84be291cd7ec2094dcdcaca9ce09c3c30e54831e652"}
Jul 24 16:14:44.533275 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.533230    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:44.547303 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.547263    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw" podStartSLOduration=1.136510651 podStartE2EDuration="1.547250276s" totalImagesPullingTime="410.739625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:44.545900575 +0000 UTC m=+1758.703767316" watchObservedRunningTime="2026-07-24 16:14:44.547250276 +0000 UTC m=+1758.705116975"
Jul 24 16:14:44.562670 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.562629    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5" podStartSLOduration=1.562590316 podStartE2EDuration="1.562590316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:44.561550135 +0000 UTC m=+1758.719416834" watchObservedRunningTime="2026-07-24 16:14:44.562590316 +0000 UTC m=+1758.720457034"
Jul 24 16:14:44.577189 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:44.577147    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l" podStartSLOduration=1.577135613 podStartE2EDuration="1.577135613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:44.575568809 +0000 UTC m=+1758.733435509" watchObservedRunningTime="2026-07-24 16:14:44.577135613 +0000 UTC m=+1758.735002312"
Jul 24 16:14:50.543532 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:50.543501    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:14:50.683243 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:50.683212    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:14:55.540114 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:55.540087    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:14:55.540685 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:55.540389    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:14:56.953127 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:56.953083    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:14:57.039867 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:14:57.039843    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:00.142688 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.142655    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"]
Jul 24 16:15:00.145719 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.145703    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"
Jul 24 16:15:00.149116 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.149094    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:15:00.152281 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.152262    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl"]
Jul 24 16:15:00.155289 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.155272    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl"
Jul 24 16:15:00.155941 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.155919    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"
Jul 24 16:15:00.165318 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.165302    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl"
Jul 24 16:15:00.171547 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.171490    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"]
Jul 24 16:15:00.175937 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.175912    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl"]
Jul 24 16:15:00.328063 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.328038    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl"]
Jul 24 16:15:00.329729 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:15:00.329705    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c83b28_b7b4_4563_8c30_eb7eb72c7eae.slice/crio-2510a5eecf5e0c738a2b85823769db3a613781e5611471d764528a2365a0d8c5 WatchSource:0}: Error finding container 2510a5eecf5e0c738a2b85823769db3a613781e5611471d764528a2365a0d8c5: Status 404 returned error can't find the container with id 2510a5eecf5e0c738a2b85823769db3a613781e5611471d764528a2365a0d8c5
Jul 24 16:15:00.504939 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.504914    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"]
Jul 24 16:15:00.513580 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:15:00.513553    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326b8598_9200_46b8_bc48_fffde774634d.slice/crio-4c5eaf6c4919af33cdaf82c5be93f5fe58a0d6181eeb2c8a92dc7091f783f5eb WatchSource:0}: Error finding container 4c5eaf6c4919af33cdaf82c5be93f5fe58a0d6181eeb2c8a92dc7091f783f5eb: Status 404 returned error can't find the container with id 4c5eaf6c4919af33cdaf82c5be93f5fe58a0d6181eeb2c8a92dc7091f783f5eb
Jul 24 16:15:00.605878 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.605842    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl" event={"ID":"98c83b28-b7b4-4563-8c30-eb7eb72c7eae","Type":"ContainerStarted","Data":"2510a5eecf5e0c738a2b85823769db3a613781e5611471d764528a2365a0d8c5"}
Jul 24 16:15:00.607234 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:00.607209    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r" event={"ID":"326b8598-9200-46b8-bc48-fffde774634d","Type":"ContainerStarted","Data":"4c5eaf6c4919af33cdaf82c5be93f5fe58a0d6181eeb2c8a92dc7091f783f5eb"}
Jul 24 16:15:01.612710 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:01.612621    2600 generic.go:356] "Generic (PLEG): container finished" podID="326b8598-9200-46b8-bc48-fffde774634d" containerID="b34ce4b9d543ce333d87211db6b668b3e7f7cb19efc9e0e4444e7c5bfc5a1a97" exitCode=0
Jul 24 16:15:01.613065 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:01.612708    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r" event={"ID":"326b8598-9200-46b8-bc48-fffde774634d","Type":"ContainerDied","Data":"b34ce4b9d543ce333d87211db6b668b3e7f7cb19efc9e0e4444e7c5bfc5a1a97"}
Jul 24 16:15:01.614157 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:01.614138    2600 generic.go:356] "Generic (PLEG): container finished" podID="98c83b28-b7b4-4563-8c30-eb7eb72c7eae" containerID="b919a99da7314313ea37bf2f5a9ad93babb38fa57bcb1d4d8e1c6ab0b3053db9" exitCode=0
Jul 24 16:15:01.614251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:01.614170    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl" event={"ID":"98c83b28-b7b4-4563-8c30-eb7eb72c7eae","Type":"ContainerDied","Data":"b919a99da7314313ea37bf2f5a9ad93babb38fa57bcb1d4d8e1c6ab0b3053db9"}
Jul 24 16:15:02.773091 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:02.773071    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl"
Jul 24 16:15:02.776639 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:02.776594    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"
Jul 24 16:15:03.623354 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:03.623327    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"
Jul 24 16:15:03.623548 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:03.623358    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r" event={"ID":"326b8598-9200-46b8-bc48-fffde774634d","Type":"ContainerDied","Data":"4c5eaf6c4919af33cdaf82c5be93f5fe58a0d6181eeb2c8a92dc7091f783f5eb"}
Jul 24 16:15:03.623548 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:03.623400    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c5eaf6c4919af33cdaf82c5be93f5fe58a0d6181eeb2c8a92dc7091f783f5eb"
Jul 24 16:15:03.624558 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:03.624539    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl" event={"ID":"98c83b28-b7b4-4563-8c30-eb7eb72c7eae","Type":"ContainerDied","Data":"2510a5eecf5e0c738a2b85823769db3a613781e5611471d764528a2365a0d8c5"}
Jul 24 16:15:03.624684 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:03.624567    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748495-zgqgl"
Jul 24 16:15:03.624684 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:03.624576    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2510a5eecf5e0c738a2b85823769db3a613781e5611471d764528a2365a0d8c5"
Jul 24 16:15:08.988553 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.988515    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"]
Jul 24 16:15:08.988943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.988840    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="326b8598-9200-46b8-bc48-fffde774634d" containerName="cleanup"
Jul 24 16:15:08.988943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.988850    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="326b8598-9200-46b8-bc48-fffde774634d" containerName="cleanup"
Jul 24 16:15:08.988943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.988859    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98c83b28-b7b4-4563-8c30-eb7eb72c7eae" containerName="cleanup"
Jul 24 16:15:08.988943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.988864    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="98c83b28-b7b4-4563-8c30-eb7eb72c7eae" containerName="cleanup"
Jul 24 16:15:08.988943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.988921    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="326b8598-9200-46b8-bc48-fffde774634d" containerName="cleanup"
Jul 24 16:15:08.988943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.988929    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="98c83b28-b7b4-4563-8c30-eb7eb72c7eae" containerName="cleanup"
Jul 24 16:15:08.991961 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.991944    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"
Jul 24 16:15:08.994909 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:08.994892    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:15:09.003179 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.003155    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"]
Jul 24 16:15:09.014520 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.014495    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac28f42-9ffd-4beb-84b4-ae894dc50a0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-518181e2-pcwp5\" (UID: \"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"
Jul 24 16:15:09.115710 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.115678    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac28f42-9ffd-4beb-84b4-ae894dc50a0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-518181e2-pcwp5\" (UID: \"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"
Jul 24 16:15:09.116254 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.116236    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac28f42-9ffd-4beb-84b4-ae894dc50a0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-518181e2-pcwp5\" (UID: \"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"
Jul 24 16:15:09.302109 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.302010    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"
Jul 24 16:15:09.456395 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.456375    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"]
Jul 24 16:15:09.459052 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:15:09.459023    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac28f42_9ffd_4beb_84b4_ae894dc50a0e.slice/crio-afc9713f6caf91cfb6e9fa38eb174801ce3abd4c3ea36e3dce008c425854ba6f WatchSource:0}: Error finding container afc9713f6caf91cfb6e9fa38eb174801ce3abd4c3ea36e3dce008c425854ba6f: Status 404 returned error can't find the container with id afc9713f6caf91cfb6e9fa38eb174801ce3abd4c3ea36e3dce008c425854ba6f
Jul 24 16:15:09.650936 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.650914    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5" event={"ID":"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e","Type":"ContainerStarted","Data":"75b55d471b2f838aa35c98680d80e803b5b05a49f2d5f476df89451110a24bb8"}
Jul 24 16:15:09.651040 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.650962    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5" event={"ID":"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e","Type":"ContainerStarted","Data":"afc9713f6caf91cfb6e9fa38eb174801ce3abd4c3ea36e3dce008c425854ba6f"}
Jul 24 16:15:09.668111 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:09.668066    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5" podStartSLOduration=1.668051729 podStartE2EDuration="1.668051729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:09.666342011 +0000 UTC m=+1783.824208710" watchObservedRunningTime="2026-07-24 16:15:09.668051729 +0000 UTC m=+1783.825918425"
Jul 24 16:15:10.656850 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:10.656825    2600 generic.go:356] "Generic (PLEG): container finished" podID="9ac28f42-9ffd-4beb-84b4-ae894dc50a0e" containerID="75b55d471b2f838aa35c98680d80e803b5b05a49f2d5f476df89451110a24bb8" exitCode=0
Jul 24 16:15:10.657182 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:10.656910    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5" event={"ID":"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e","Type":"ContainerDied","Data":"75b55d471b2f838aa35c98680d80e803b5b05a49f2d5f476df89451110a24bb8"}
Jul 24 16:15:11.792962 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:11.792940    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"
Jul 24 16:15:11.836266 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:11.836247    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac28f42-9ffd-4beb-84b4-ae894dc50a0e-maas-api-service-ca\") pod \"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e\" (UID: \"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e\") "
Jul 24 16:15:11.836567 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:11.836546    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ac28f42-9ffd-4beb-84b4-ae894dc50a0e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ac28f42-9ffd-4beb-84b4-ae894dc50a0e" (UID: "9ac28f42-9ffd-4beb-84b4-ae894dc50a0e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:11.936979 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:11.936956    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac28f42-9ffd-4beb-84b4-ae894dc50a0e-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:12.665787 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:12.665724    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5" event={"ID":"9ac28f42-9ffd-4beb-84b4-ae894dc50a0e","Type":"ContainerDied","Data":"afc9713f6caf91cfb6e9fa38eb174801ce3abd4c3ea36e3dce008c425854ba6f"}
Jul 24 16:15:12.665787 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:12.665758    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"
Jul 24 16:15:12.665787 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:12.665769    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afc9713f6caf91cfb6e9fa38eb174801ce3abd4c3ea36e3dce008c425854ba6f"
Jul 24 16:15:19.486710 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.486633    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"]
Jul 24 16:15:19.487156 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.486838    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw" podUID="466fe048-552a-4eae-87f3-ce0ac09ae2e1" containerName="maas-api" containerID="cri-o://809babb14aa237c746ff2a827ee14c120c71d5f2f8d620a9fd6e5b42fbbd0fd6" gracePeriod=30
Jul 24 16:15:19.515819 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.515793    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:19.525584 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.525563    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"]
Jul 24 16:15:19.528845 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.528825    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-518181e2-29748495-58g8r"]
Jul 24 16:15:19.570052 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.570026    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"]
Jul 24 16:15:19.570441 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.570416    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5" podUID="ba78ae85-2268-4afc-9706-9023430b8d25" containerName="payload-processing" containerID="cri-o://a012fff62ce68978b2488345602686a482a7361bf6b4a40eabcd18518fbf55fe" gracePeriod=30
Jul 24 16:15:19.583147 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.583120    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"]
Jul 24 16:15:19.583473 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.583450    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l" podUID="2f57d897-6884-4eab-a020-8c472464def6" containerName="payload-pre-processing" containerID="cri-o://88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50" gracePeriod=30
Jul 24 16:15:19.616515 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.616481    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:19.701010 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.700985    2600 generic.go:356] "Generic (PLEG): container finished" podID="ba78ae85-2268-4afc-9706-9023430b8d25" containerID="a012fff62ce68978b2488345602686a482a7361bf6b4a40eabcd18518fbf55fe" exitCode=0
Jul 24 16:15:19.701146 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.701074    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5" event={"ID":"ba78ae85-2268-4afc-9706-9023430b8d25","Type":"ContainerDied","Data":"a012fff62ce68978b2488345602686a482a7361bf6b4a40eabcd18518fbf55fe"}
Jul 24 16:15:19.703334 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.703305    2600 generic.go:356] "Generic (PLEG): container finished" podID="466fe048-552a-4eae-87f3-ce0ac09ae2e1" containerID="809babb14aa237c746ff2a827ee14c120c71d5f2f8d620a9fd6e5b42fbbd0fd6" exitCode=0
Jul 24 16:15:19.703437 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.703364    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw" event={"ID":"466fe048-552a-4eae-87f3-ce0ac09ae2e1","Type":"ContainerDied","Data":"809babb14aa237c746ff2a827ee14c120c71d5f2f8d620a9fd6e5b42fbbd0fd6"}
Jul 24 16:15:19.749681 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.749658    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:15:19.792690 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.792649    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65mvh\" (UniqueName: \"kubernetes.io/projected/466fe048-552a-4eae-87f3-ce0ac09ae2e1-kube-api-access-65mvh\") pod \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") "
Jul 24 16:15:19.792690 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.792689    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/466fe048-552a-4eae-87f3-ce0ac09ae2e1-openshift-service-ca\") pod \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") "
Jul 24 16:15:19.792892 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.792854    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/466fe048-552a-4eae-87f3-ce0ac09ae2e1-maas-api-tls\") pod \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\" (UID: \"466fe048-552a-4eae-87f3-ce0ac09ae2e1\") "
Jul 24 16:15:19.794068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.794032    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/466fe048-552a-4eae-87f3-ce0ac09ae2e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "466fe048-552a-4eae-87f3-ce0ac09ae2e1" (UID: "466fe048-552a-4eae-87f3-ce0ac09ae2e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:19.796554 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.796524    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/466fe048-552a-4eae-87f3-ce0ac09ae2e1-kube-api-access-65mvh" (OuterVolumeSpecName: "kube-api-access-65mvh") pod "466fe048-552a-4eae-87f3-ce0ac09ae2e1" (UID: "466fe048-552a-4eae-87f3-ce0ac09ae2e1"). InnerVolumeSpecName "kube-api-access-65mvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:19.796919 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.796897    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/466fe048-552a-4eae-87f3-ce0ac09ae2e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "466fe048-552a-4eae-87f3-ce0ac09ae2e1" (UID: "466fe048-552a-4eae-87f3-ce0ac09ae2e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:15:19.853778 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.853752    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:15:19.861894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.861874    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:15:19.893473 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.893439    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba78ae85-2268-4afc-9706-9023430b8d25-plugins-config-volume\") pod \"ba78ae85-2268-4afc-9706-9023430b8d25\" (UID: \"ba78ae85-2268-4afc-9706-9023430b8d25\") "
Jul 24 16:15:19.893590 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.893526    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8fcb\" (UniqueName: \"kubernetes.io/projected/2f57d897-6884-4eab-a020-8c472464def6-kube-api-access-g8fcb\") pod \"2f57d897-6884-4eab-a020-8c472464def6\" (UID: \"2f57d897-6884-4eab-a020-8c472464def6\") "
Jul 24 16:15:19.893590 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.893549    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbs24\" (UniqueName: \"kubernetes.io/projected/ba78ae85-2268-4afc-9706-9023430b8d25-kube-api-access-qbs24\") pod \"ba78ae85-2268-4afc-9706-9023430b8d25\" (UID: \"ba78ae85-2268-4afc-9706-9023430b8d25\") "
Jul 24 16:15:19.893590 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.893580    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f57d897-6884-4eab-a020-8c472464def6-plugins-config-volume\") pod \"2f57d897-6884-4eab-a020-8c472464def6\" (UID: \"2f57d897-6884-4eab-a020-8c472464def6\") "
Jul 24 16:15:19.893799 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.893748    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65mvh\" (UniqueName: \"kubernetes.io/projected/466fe048-552a-4eae-87f3-ce0ac09ae2e1-kube-api-access-65mvh\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:19.893799 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.893768    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/466fe048-552a-4eae-87f3-ce0ac09ae2e1-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:19.893799 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.893781    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/466fe048-552a-4eae-87f3-ce0ac09ae2e1-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:19.893954 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.893805    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba78ae85-2268-4afc-9706-9023430b8d25-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba78ae85-2268-4afc-9706-9023430b8d25" (UID: "ba78ae85-2268-4afc-9706-9023430b8d25"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:19.894265 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.894238    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f57d897-6884-4eab-a020-8c472464def6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f57d897-6884-4eab-a020-8c472464def6" (UID: "2f57d897-6884-4eab-a020-8c472464def6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:19.895877 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.895844    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f57d897-6884-4eab-a020-8c472464def6-kube-api-access-g8fcb" (OuterVolumeSpecName: "kube-api-access-g8fcb") pod "2f57d897-6884-4eab-a020-8c472464def6" (UID: "2f57d897-6884-4eab-a020-8c472464def6"). InnerVolumeSpecName "kube-api-access-g8fcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:19.895982 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.895912    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba78ae85-2268-4afc-9706-9023430b8d25-kube-api-access-qbs24" (OuterVolumeSpecName: "kube-api-access-qbs24") pod "ba78ae85-2268-4afc-9706-9023430b8d25" (UID: "ba78ae85-2268-4afc-9706-9023430b8d25"). InnerVolumeSpecName "kube-api-access-qbs24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:19.995016 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.994948    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8fcb\" (UniqueName: \"kubernetes.io/projected/2f57d897-6884-4eab-a020-8c472464def6-kube-api-access-g8fcb\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:19.995016 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.994971    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbs24\" (UniqueName: \"kubernetes.io/projected/ba78ae85-2268-4afc-9706-9023430b8d25-kube-api-access-qbs24\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:19.995016 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.994981    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f57d897-6884-4eab-a020-8c472464def6-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:19.995016 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:19.994991    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba78ae85-2268-4afc-9706-9023430b8d25-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:20.057844 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.057810    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:20.402361 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.402299    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="326b8598-9200-46b8-bc48-fffde774634d" path="/var/lib/kubelet/pods/326b8598-9200-46b8-bc48-fffde774634d/volumes"
Jul 24 16:15:20.708893 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.708862    2600 generic.go:356] "Generic (PLEG): container finished" podID="2f57d897-6884-4eab-a020-8c472464def6" containerID="88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50" exitCode=0
Jul 24 16:15:20.709238 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.708908    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"
Jul 24 16:15:20.709238 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.708916    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l" event={"ID":"2f57d897-6884-4eab-a020-8c472464def6","Type":"ContainerDied","Data":"88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50"}
Jul 24 16:15:20.709238 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.708966    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l" event={"ID":"2f57d897-6884-4eab-a020-8c472464def6","Type":"ContainerDied","Data":"bd92961688a54bf587a915a83ee82a589329e62d604666372f6b27c7dc9a555a"}
Jul 24 16:15:20.709238 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.708979    2600 scope.go:117] "RemoveContainer" containerID="88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50"
Jul 24 16:15:20.710440 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.710414    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5" event={"ID":"ba78ae85-2268-4afc-9706-9023430b8d25","Type":"ContainerDied","Data":"e0f9720ab5b776fb59c9d84be291cd7ec2094dcdcaca9ce09c3c30e54831e652"}
Jul 24 16:15:20.710596 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.710572    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"
Jul 24 16:15:20.711926 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.711911    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"
Jul 24 16:15:20.712028 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.711935    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw" event={"ID":"466fe048-552a-4eae-87f3-ce0ac09ae2e1","Type":"ContainerDied","Data":"60d73a5b990a2f3ad718b1189155053b3b77a7e8e2daa650a364718c2e7c2e11"}
Jul 24 16:15:20.717847 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.717834    2600 scope.go:117] "RemoveContainer" containerID="88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50"
Jul 24 16:15:20.718137 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:15:20.718120    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50\": container with ID starting with 88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50 not found: ID does not exist" containerID="88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50"
Jul 24 16:15:20.718200 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.718144    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50"} err="failed to get container status \"88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50\": rpc error: code = NotFound desc = could not find container \"88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50\": container with ID starting with 88626063a37a623df54f83fde7e754727d374b79e13bfae1b2d679bbd6ddda50 not found: ID does not exist"
Jul 24 16:15:20.718200 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.718162    2600 scope.go:117] "RemoveContainer" containerID="a012fff62ce68978b2488345602686a482a7361bf6b4a40eabcd18518fbf55fe"
Jul 24 16:15:20.725242 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.725227    2600 scope.go:117] "RemoveContainer" containerID="809babb14aa237c746ff2a827ee14c120c71d5f2f8d620a9fd6e5b42fbbd0fd6"
Jul 24 16:15:20.735858 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.735839    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"]
Jul 24 16:15:20.739519 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.739497    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-518181e2-6955c96f44-r88fw"]
Jul 24 16:15:20.752035 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.752017    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"]
Jul 24 16:15:20.760838 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.760815    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-518181e2-65f74bb5c6-mql8l"]
Jul 24 16:15:20.773786 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.773766    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"]
Jul 24 16:15:20.776533 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:20.776514    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-518181e2-84c79bdc4b-fqpk5"]
Jul 24 16:15:22.389125 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:22.389100    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:15:22.402392 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:22.402369    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f57d897-6884-4eab-a020-8c472464def6" path="/var/lib/kubelet/pods/2f57d897-6884-4eab-a020-8c472464def6/volumes"
Jul 24 16:15:22.402729 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:22.402716    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="466fe048-552a-4eae-87f3-ce0ac09ae2e1" path="/var/lib/kubelet/pods/466fe048-552a-4eae-87f3-ce0ac09ae2e1/volumes"
Jul 24 16:15:22.403018 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:22.403007    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba78ae85-2268-4afc-9706-9023430b8d25" path="/var/lib/kubelet/pods/ba78ae85-2268-4afc-9706-9023430b8d25/volumes"
Jul 24 16:15:24.070246 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:24.069995    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"]
Jul 24 16:15:24.071475 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:24.071126    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-518181e2-pcwp5"]
Jul 24 16:15:24.071475 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:24.071375    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:24.402556 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:24.402526    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ac28f42-9ffd-4beb-84b4-ae894dc50a0e" path="/var/lib/kubelet/pods/9ac28f42-9ffd-4beb-84b4-ae894dc50a0e/volumes"
Jul 24 16:15:25.259339 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:25.259305    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:25.488087 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:25.488056    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:25.708164 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:25.708128    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:26.034250 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:26.034166    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:26.184277 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:26.184239    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:28.560667 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.560635    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:28.651524 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.651488    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:28.795998 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.795965    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"]
Jul 24 16:15:28.796426 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796400    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f57d897-6884-4eab-a020-8c472464def6" containerName="payload-pre-processing"
Jul 24 16:15:28.796426 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796425    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f57d897-6884-4eab-a020-8c472464def6" containerName="payload-pre-processing"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796443    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ac28f42-9ffd-4beb-84b4-ae894dc50a0e" containerName="revoke-keys"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796452    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ac28f42-9ffd-4beb-84b4-ae894dc50a0e" containerName="revoke-keys"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796467    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba78ae85-2268-4afc-9706-9023430b8d25" containerName="payload-processing"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796476    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba78ae85-2268-4afc-9706-9023430b8d25" containerName="payload-processing"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796495    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="466fe048-552a-4eae-87f3-ce0ac09ae2e1" containerName="maas-api"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796505    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="466fe048-552a-4eae-87f3-ce0ac09ae2e1" containerName="maas-api"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796566    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba78ae85-2268-4afc-9706-9023430b8d25" containerName="payload-processing"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796575    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ac28f42-9ffd-4beb-84b4-ae894dc50a0e" containerName="revoke-keys"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796582    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f57d897-6884-4eab-a020-8c472464def6" containerName="payload-pre-processing"
Jul 24 16:15:28.796649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.796587    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="466fe048-552a-4eae-87f3-ce0ac09ae2e1" containerName="maas-api"
Jul 24 16:15:28.799449 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.799432    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:28.802293 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.802270    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:15:28.802293 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.802287    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-188903f5-serving-cert\""
Jul 24 16:15:28.802478 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.802376    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:15:28.803488 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.803466    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w4m8q\""
Jul 24 16:15:28.811117 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.811056    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"]
Jul 24 16:15:28.857894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.857869    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:28.858007 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.857928    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42j7m\" (UniqueName: \"kubernetes.io/projected/3d2ee758-ab82-485d-8154-71b26977bd7a-kube-api-access-42j7m\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:28.858007 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.857969    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ee758-ab82-485d-8154-71b26977bd7a-openshift-service-ca\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:28.878572 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.878535    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:28.958842 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.958815    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ee758-ab82-485d-8154-71b26977bd7a-openshift-service-ca\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:28.958967 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.958874    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:28.958967 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.958942    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42j7m\" (UniqueName: \"kubernetes.io/projected/3d2ee758-ab82-485d-8154-71b26977bd7a-kube-api-access-42j7m\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:28.959054 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:15:28.959037    2600 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-serving-cert: secret "maas-api-e2e-derive-188903f5-serving-cert" not found
Jul 24 16:15:28.959119 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:15:28.959109    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls podName:3d2ee758-ab82-485d-8154-71b26977bd7a nodeName:}" failed. No retries permitted until 2026-07-24 16:15:29.459091506 +0000 UTC m=+1803.616958183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls") pod "maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w" (UID: "3d2ee758-ab82-485d-8154-71b26977bd7a") : secret "maas-api-e2e-derive-188903f5-serving-cert" not found
Jul 24 16:15:28.959520 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.959504    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ee758-ab82-485d-8154-71b26977bd7a-openshift-service-ca\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:28.969961 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:28.969942    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42j7m\" (UniqueName: \"kubernetes.io/projected/3d2ee758-ab82-485d-8154-71b26977bd7a-kube-api-access-42j7m\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:29.169305 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.169217    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:29.425213 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.425124    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:29.463078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.463044    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:29.465454 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.465432    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls\") pod \"maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:29.515167 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.515143    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:29.518854 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.518834    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"]
Jul 24 16:15:29.522274 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.522260    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:29.525223 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.525204    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-188903f5\""
Jul 24 16:15:29.525294 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.525248    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-188903f5-dockercfg-cb46c\""
Jul 24 16:15:29.532966 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.532944    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"]
Jul 24 16:15:29.563916 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.563889    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs\" (UID: \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:29.564209 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.563939    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6d4q\" (UniqueName: \"kubernetes.io/projected/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-kube-api-access-z6d4q\") pod \"payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs\" (UID: \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:29.567116 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.567096    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"]
Jul 24 16:15:29.570217 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.570203    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:29.582248 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.582224    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"]
Jul 24 16:15:29.665182 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.665152    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsl2f\" (UniqueName: \"kubernetes.io/projected/7a4c93e6-1221-40bc-8454-37c0697af5e1-kube-api-access-dsl2f\") pod \"payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b\" (UID: \"7a4c93e6-1221-40bc-8454-37c0697af5e1\") " pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:29.665337 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.665194    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6d4q\" (UniqueName: \"kubernetes.io/projected/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-kube-api-access-z6d4q\") pod \"payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs\" (UID: \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:29.665337 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.665271    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4c93e6-1221-40bc-8454-37c0697af5e1-plugins-config-volume\") pod \"payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b\" (UID: \"7a4c93e6-1221-40bc-8454-37c0697af5e1\") " pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:29.665337 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.665329    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs\" (UID: \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:29.665976 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.665961    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs\" (UID: \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:29.688433 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.688409    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6d4q\" (UniqueName: \"kubernetes.io/projected/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-kube-api-access-z6d4q\") pod \"payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs\" (UID: \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:29.710358 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.710333    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:29.766532 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.766496    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4c93e6-1221-40bc-8454-37c0697af5e1-plugins-config-volume\") pod \"payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b\" (UID: \"7a4c93e6-1221-40bc-8454-37c0697af5e1\") " pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:29.766692 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.766600    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsl2f\" (UniqueName: \"kubernetes.io/projected/7a4c93e6-1221-40bc-8454-37c0697af5e1-kube-api-access-dsl2f\") pod \"payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b\" (UID: \"7a4c93e6-1221-40bc-8454-37c0697af5e1\") " pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:29.767256 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.767237    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4c93e6-1221-40bc-8454-37c0697af5e1-plugins-config-volume\") pod \"payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b\" (UID: \"7a4c93e6-1221-40bc-8454-37c0697af5e1\") " pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:29.780536 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.780506    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsl2f\" (UniqueName: \"kubernetes.io/projected/7a4c93e6-1221-40bc-8454-37c0697af5e1-kube-api-access-dsl2f\") pod \"payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b\" (UID: \"7a4c93e6-1221-40bc-8454-37c0697af5e1\") " pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:29.832969 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.832928    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:29.859921 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.859900    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"]
Jul 24 16:15:29.861548 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:15:29.861522    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2ee758_ab82_485d_8154_71b26977bd7a.slice/crio-adbe94f93be4eb2071ef6a6747e5693a11395c72477f2c6a6de31c80786874a7 WatchSource:0}: Error finding container adbe94f93be4eb2071ef6a6747e5693a11395c72477f2c6a6de31c80786874a7: Status 404 returned error can't find the container with id adbe94f93be4eb2071ef6a6747e5693a11395c72477f2c6a6de31c80786874a7
Jul 24 16:15:29.879728 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.879705    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:29.977970 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:29.977937    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"]
Jul 24 16:15:29.979670 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:15:29.979646    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e225fa9_440e_4921_bf64_bfeb8ea6a55d.slice/crio-ba6805f7592f502060c11fe0b3c6592e5ef11a094050d7989a1a25255daa4d99 WatchSource:0}: Error finding container ba6805f7592f502060c11fe0b3c6592e5ef11a094050d7989a1a25255daa4d99: Status 404 returned error can't find the container with id ba6805f7592f502060c11fe0b3c6592e5ef11a094050d7989a1a25255daa4d99
Jul 24 16:15:30.025682 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.025653    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"]
Jul 24 16:15:30.029730 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:15:30.029698    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4c93e6_1221_40bc_8454_37c0697af5e1.slice/crio-6411b01668c1f813cc0821d3dabc3adace9ea07c78fa682bf5f2e91be386dbb1 WatchSource:0}: Error finding container 6411b01668c1f813cc0821d3dabc3adace9ea07c78fa682bf5f2e91be386dbb1: Status 404 returned error can't find the container with id 6411b01668c1f813cc0821d3dabc3adace9ea07c78fa682bf5f2e91be386dbb1
Jul 24 16:15:30.760658 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.760565    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w" event={"ID":"3d2ee758-ab82-485d-8154-71b26977bd7a","Type":"ContainerStarted","Data":"9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d"}
Jul 24 16:15:30.760658 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.760630    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w" event={"ID":"3d2ee758-ab82-485d-8154-71b26977bd7a","Type":"ContainerStarted","Data":"adbe94f93be4eb2071ef6a6747e5693a11395c72477f2c6a6de31c80786874a7"}
Jul 24 16:15:30.760658 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.760651    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:30.762151 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.762121    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b" event={"ID":"7a4c93e6-1221-40bc-8454-37c0697af5e1","Type":"ContainerStarted","Data":"0fded24e341d57e79fdb2e35e6441dd1ea2788c83f0bd3ba2db4f3fdf6a4214b"}
Jul 24 16:15:30.762270 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.762172    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b" event={"ID":"7a4c93e6-1221-40bc-8454-37c0697af5e1","Type":"ContainerStarted","Data":"6411b01668c1f813cc0821d3dabc3adace9ea07c78fa682bf5f2e91be386dbb1"}
Jul 24 16:15:30.762270 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.762200    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:30.763470 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.763446    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs" event={"ID":"2e225fa9-440e-4921-bf64-bfeb8ea6a55d","Type":"ContainerStarted","Data":"1a6b31d3fa5afa1ab5f858acd8df2fd67ab4ec06873cc0197bf2ee5a0682620c"}
Jul 24 16:15:30.763558 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.763485    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:30.763558 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.763500    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs" event={"ID":"2e225fa9-440e-4921-bf64-bfeb8ea6a55d","Type":"ContainerStarted","Data":"ba6805f7592f502060c11fe0b3c6592e5ef11a094050d7989a1a25255daa4d99"}
Jul 24 16:15:30.780418 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.780374    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w" podStartSLOduration=2.181290846 podStartE2EDuration="2.780360333s" totalImagesPullingTime="599.069487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:30.778839025 +0000 UTC m=+1804.936705738" watchObservedRunningTime="2026-07-24 16:15:30.780360333 +0000 UTC m=+1804.938227031"
Jul 24 16:15:30.813157 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.813109    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs" podStartSLOduration=1.813091548 podStartE2EDuration="1.813091548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:30.810944489 +0000 UTC m=+1804.968811188" watchObservedRunningTime="2026-07-24 16:15:30.813091548 +0000 UTC m=+1804.970958247"
Jul 24 16:15:30.814197 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:30.814153    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b" podStartSLOduration=1.814137382 podStartE2EDuration="1.814137382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:30.795148808 +0000 UTC m=+1804.953015508" watchObservedRunningTime="2026-07-24 16:15:30.814137382 +0000 UTC m=+1804.972004082"
Jul 24 16:15:35.386749 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:35.386711    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:15:36.774896 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:36.774869    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:38.073304 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.073274    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"]
Jul 24 16:15:38.077872 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.077856    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"
Jul 24 16:15:38.080341 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.080321    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:15:38.084047 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.084020    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"]
Jul 24 16:15:38.136796 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.136768    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e57395f-cf4b-47ad-a753-d0f44427e442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-188903f5-vmv5t\" (UID: \"1e57395f-cf4b-47ad-a753-d0f44427e442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"
Jul 24 16:15:38.237985 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.237956    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e57395f-cf4b-47ad-a753-d0f44427e442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-188903f5-vmv5t\" (UID: \"1e57395f-cf4b-47ad-a753-d0f44427e442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"
Jul 24 16:15:38.238517 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.238498    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e57395f-cf4b-47ad-a753-d0f44427e442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-188903f5-vmv5t\" (UID: \"1e57395f-cf4b-47ad-a753-d0f44427e442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"
Jul 24 16:15:38.389951 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.389887    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"
Jul 24 16:15:38.517528 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.517375    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"]
Jul 24 16:15:38.520418 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:15:38.520392    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e57395f_cf4b_47ad_a753_d0f44427e442.slice/crio-face9f5f54c66e4efa415095790d33adaa308437d9144237a8c8ee879449a8a4 WatchSource:0}: Error finding container face9f5f54c66e4efa415095790d33adaa308437d9144237a8c8ee879449a8a4: Status 404 returned error can't find the container with id face9f5f54c66e4efa415095790d33adaa308437d9144237a8c8ee879449a8a4
Jul 24 16:15:38.800113 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:38.800087    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t" event={"ID":"1e57395f-cf4b-47ad-a753-d0f44427e442","Type":"ContainerStarted","Data":"face9f5f54c66e4efa415095790d33adaa308437d9144237a8c8ee879449a8a4"}
Jul 24 16:15:39.806218 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:39.806182    2600 generic.go:356] "Generic (PLEG): container finished" podID="1e57395f-cf4b-47ad-a753-d0f44427e442" containerID="d10827bde1ff8f01580e5bfc186835b0741cd99c880b8430088c3103124d50c8" exitCode=0
Jul 24 16:15:39.806637 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:39.806272    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t" event={"ID":"1e57395f-cf4b-47ad-a753-d0f44427e442","Type":"ContainerDied","Data":"d10827bde1ff8f01580e5bfc186835b0741cd99c880b8430088c3103124d50c8"}
Jul 24 16:15:40.935558 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:40.935536    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"
Jul 24 16:15:41.061738 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:41.061658    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e57395f-cf4b-47ad-a753-d0f44427e442-maas-api-service-ca\") pod \"1e57395f-cf4b-47ad-a753-d0f44427e442\" (UID: \"1e57395f-cf4b-47ad-a753-d0f44427e442\") "
Jul 24 16:15:41.062026 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:41.062006    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e57395f-cf4b-47ad-a753-d0f44427e442-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e57395f-cf4b-47ad-a753-d0f44427e442" (UID: "1e57395f-cf4b-47ad-a753-d0f44427e442"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:41.162315 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:41.162290    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e57395f-cf4b-47ad-a753-d0f44427e442-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:41.771255 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:41.771227    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:41.771433 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:41.771304    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:41.817256 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:41.817226    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"
Jul 24 16:15:41.817415 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:41.817251    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t" event={"ID":"1e57395f-cf4b-47ad-a753-d0f44427e442","Type":"ContainerDied","Data":"face9f5f54c66e4efa415095790d33adaa308437d9144237a8c8ee879449a8a4"}
Jul 24 16:15:41.817415 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:41.817301    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="face9f5f54c66e4efa415095790d33adaa308437d9144237a8c8ee879449a8a4"
Jul 24 16:15:48.536090 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.536055    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"]
Jul 24 16:15:48.536552 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.536287    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w" podUID="3d2ee758-ab82-485d-8154-71b26977bd7a" containerName="maas-api" containerID="cri-o://9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d" gracePeriod=30
Jul 24 16:15:48.568053 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.568028    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:48.591281 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.591257    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"]
Jul 24 16:15:48.591528 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.591504    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b" podUID="7a4c93e6-1221-40bc-8454-37c0697af5e1" containerName="payload-processing" containerID="cri-o://0fded24e341d57e79fdb2e35e6441dd1ea2788c83f0bd3ba2db4f3fdf6a4214b" gracePeriod=30
Jul 24 16:15:48.595819 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.595687    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"]
Jul 24 16:15:48.595942 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.595867    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs" podUID="2e225fa9-440e-4921-bf64-bfeb8ea6a55d" containerName="payload-pre-processing" containerID="cri-o://1a6b31d3fa5afa1ab5f858acd8df2fd67ab4ec06873cc0197bf2ee5a0682620c" gracePeriod=30
Jul 24 16:15:48.638662 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.638633    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:48.705251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.705201    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:48.842823 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.842798    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:48.850115 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.850088    2600 generic.go:356] "Generic (PLEG): container finished" podID="3d2ee758-ab82-485d-8154-71b26977bd7a" containerID="9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d" exitCode=0
Jul 24 16:15:48.850238 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.850125    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"
Jul 24 16:15:48.850238 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.850177    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w" event={"ID":"3d2ee758-ab82-485d-8154-71b26977bd7a","Type":"ContainerDied","Data":"9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d"}
Jul 24 16:15:48.850341 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.850259    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w" event={"ID":"3d2ee758-ab82-485d-8154-71b26977bd7a","Type":"ContainerDied","Data":"adbe94f93be4eb2071ef6a6747e5693a11395c72477f2c6a6de31c80786874a7"}
Jul 24 16:15:48.850341 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.850288    2600 scope.go:117] "RemoveContainer" containerID="9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d"
Jul 24 16:15:48.852138 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.852118    2600 generic.go:356] "Generic (PLEG): container finished" podID="7a4c93e6-1221-40bc-8454-37c0697af5e1" containerID="0fded24e341d57e79fdb2e35e6441dd1ea2788c83f0bd3ba2db4f3fdf6a4214b" exitCode=0
Jul 24 16:15:48.852236 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.852191    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b" event={"ID":"7a4c93e6-1221-40bc-8454-37c0697af5e1","Type":"ContainerDied","Data":"0fded24e341d57e79fdb2e35e6441dd1ea2788c83f0bd3ba2db4f3fdf6a4214b"}
Jul 24 16:15:48.853926 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.853907    2600 generic.go:356] "Generic (PLEG): container finished" podID="2e225fa9-440e-4921-bf64-bfeb8ea6a55d" containerID="1a6b31d3fa5afa1ab5f858acd8df2fd67ab4ec06873cc0197bf2ee5a0682620c" exitCode=0
Jul 24 16:15:48.854015 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.853941    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs" event={"ID":"2e225fa9-440e-4921-bf64-bfeb8ea6a55d","Type":"ContainerDied","Data":"1a6b31d3fa5afa1ab5f858acd8df2fd67ab4ec06873cc0197bf2ee5a0682620c"}
Jul 24 16:15:48.858999 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.858982    2600 scope.go:117] "RemoveContainer" containerID="9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d"
Jul 24 16:15:48.859403 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:15:48.859378    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d\": container with ID starting with 9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d not found: ID does not exist" containerID="9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d"
Jul 24 16:15:48.859508 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.859415    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d"} err="failed to get container status \"9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d\": rpc error: code = NotFound desc = could not find container \"9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d\": container with ID starting with 9e9a02b07fed61967517a224b45f38ec55f19a97525498657f399e1a833d3b7d not found: ID does not exist"
Jul 24 16:15:48.875363 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.875346    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:48.882569 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.882550    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:48.926576 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.926556    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6d4q\" (UniqueName: \"kubernetes.io/projected/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-kube-api-access-z6d4q\") pod \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\" (UID: \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\") "
Jul 24 16:15:48.926691 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.926620    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ee758-ab82-485d-8154-71b26977bd7a-openshift-service-ca\") pod \"3d2ee758-ab82-485d-8154-71b26977bd7a\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") "
Jul 24 16:15:48.926691 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.926656    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42j7m\" (UniqueName: \"kubernetes.io/projected/3d2ee758-ab82-485d-8154-71b26977bd7a-kube-api-access-42j7m\") pod \"3d2ee758-ab82-485d-8154-71b26977bd7a\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") "
Jul 24 16:15:48.926691 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.926686    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4c93e6-1221-40bc-8454-37c0697af5e1-plugins-config-volume\") pod \"7a4c93e6-1221-40bc-8454-37c0697af5e1\" (UID: \"7a4c93e6-1221-40bc-8454-37c0697af5e1\") "
Jul 24 16:15:48.926840 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.926719    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-plugins-config-volume\") pod \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\" (UID: \"2e225fa9-440e-4921-bf64-bfeb8ea6a55d\") "
Jul 24 16:15:48.926840 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.926740    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsl2f\" (UniqueName: \"kubernetes.io/projected/7a4c93e6-1221-40bc-8454-37c0697af5e1-kube-api-access-dsl2f\") pod \"7a4c93e6-1221-40bc-8454-37c0697af5e1\" (UID: \"7a4c93e6-1221-40bc-8454-37c0697af5e1\") "
Jul 24 16:15:48.926840 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.926772    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls\") pod \"3d2ee758-ab82-485d-8154-71b26977bd7a\" (UID: \"3d2ee758-ab82-485d-8154-71b26977bd7a\") "
Jul 24 16:15:48.927213 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.927022    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d2ee758-ab82-485d-8154-71b26977bd7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d2ee758-ab82-485d-8154-71b26977bd7a" (UID: "3d2ee758-ab82-485d-8154-71b26977bd7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:48.927213 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.927117    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e225fa9-440e-4921-bf64-bfeb8ea6a55d" (UID: "2e225fa9-440e-4921-bf64-bfeb8ea6a55d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:48.927213 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.927132    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4c93e6-1221-40bc-8454-37c0697af5e1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a4c93e6-1221-40bc-8454-37c0697af5e1" (UID: "7a4c93e6-1221-40bc-8454-37c0697af5e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:48.929047 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.929023    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-kube-api-access-z6d4q" (OuterVolumeSpecName: "kube-api-access-z6d4q") pod "2e225fa9-440e-4921-bf64-bfeb8ea6a55d" (UID: "2e225fa9-440e-4921-bf64-bfeb8ea6a55d"). InnerVolumeSpecName "kube-api-access-z6d4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:48.929120 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.929055    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4c93e6-1221-40bc-8454-37c0697af5e1-kube-api-access-dsl2f" (OuterVolumeSpecName: "kube-api-access-dsl2f") pod "7a4c93e6-1221-40bc-8454-37c0697af5e1" (UID: "7a4c93e6-1221-40bc-8454-37c0697af5e1"). InnerVolumeSpecName "kube-api-access-dsl2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:48.929120 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.929067    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d2ee758-ab82-485d-8154-71b26977bd7a-kube-api-access-42j7m" (OuterVolumeSpecName: "kube-api-access-42j7m") pod "3d2ee758-ab82-485d-8154-71b26977bd7a" (UID: "3d2ee758-ab82-485d-8154-71b26977bd7a"). InnerVolumeSpecName "kube-api-access-42j7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:48.929501 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:48.929484    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d2ee758-ab82-485d-8154-71b26977bd7a" (UID: "3d2ee758-ab82-485d-8154-71b26977bd7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:15:49.027894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.027857    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsl2f\" (UniqueName: \"kubernetes.io/projected/7a4c93e6-1221-40bc-8454-37c0697af5e1-kube-api-access-dsl2f\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:49.027894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.027895    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d2ee758-ab82-485d-8154-71b26977bd7a-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:49.028044 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.027910    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6d4q\" (UniqueName: \"kubernetes.io/projected/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-kube-api-access-z6d4q\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:49.028044 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.027933    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ee758-ab82-485d-8154-71b26977bd7a-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:49.028044 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.027946    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42j7m\" (UniqueName: \"kubernetes.io/projected/3d2ee758-ab82-485d-8154-71b26977bd7a-kube-api-access-42j7m\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:49.028044 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.027958    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a4c93e6-1221-40bc-8454-37c0697af5e1-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:49.028044 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.027971    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e225fa9-440e-4921-bf64-bfeb8ea6a55d-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:15:49.171306 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.171285    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"]
Jul 24 16:15:49.175513 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.175492    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-188903f5-57cc6c76c6-r4l5w"]
Jul 24 16:15:49.859733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.859655    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"
Jul 24 16:15:49.859733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.859675    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs" event={"ID":"2e225fa9-440e-4921-bf64-bfeb8ea6a55d","Type":"ContainerDied","Data":"ba6805f7592f502060c11fe0b3c6592e5ef11a094050d7989a1a25255daa4d99"}
Jul 24 16:15:49.859733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.859739    2600 scope.go:117] "RemoveContainer" containerID="1a6b31d3fa5afa1ab5f858acd8df2fd67ab4ec06873cc0197bf2ee5a0682620c"
Jul 24 16:15:49.862265 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.862242    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b" event={"ID":"7a4c93e6-1221-40bc-8454-37c0697af5e1","Type":"ContainerDied","Data":"6411b01668c1f813cc0821d3dabc3adace9ea07c78fa682bf5f2e91be386dbb1"}
Jul 24 16:15:49.862375 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.862299    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"
Jul 24 16:15:49.870736 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.870715    2600 scope.go:117] "RemoveContainer" containerID="0fded24e341d57e79fdb2e35e6441dd1ea2788c83f0bd3ba2db4f3fdf6a4214b"
Jul 24 16:15:49.891273 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.891224    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"]
Jul 24 16:15:49.894465 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.894444    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-188903f5-569d4c7cc6-54xzs"]
Jul 24 16:15:49.917431 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.917410    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"]
Jul 24 16:15:49.920465 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:49.920447    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-188903f5-5c886b7454-bpj7b"]
Jul 24 16:15:50.402648 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:50.402622    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e225fa9-440e-4921-bf64-bfeb8ea6a55d" path="/var/lib/kubelet/pods/2e225fa9-440e-4921-bf64-bfeb8ea6a55d/volumes"
Jul 24 16:15:50.402978 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:50.402966    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d2ee758-ab82-485d-8154-71b26977bd7a" path="/var/lib/kubelet/pods/3d2ee758-ab82-485d-8154-71b26977bd7a/volumes"
Jul 24 16:15:50.403264 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:50.403252    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a4c93e6-1221-40bc-8454-37c0697af5e1" path="/var/lib/kubelet/pods/7a4c93e6-1221-40bc-8454-37c0697af5e1/volumes"
Jul 24 16:15:51.391124 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:51.391092    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:15:53.142719 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:53.142682    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"]
Jul 24 16:15:53.145385 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:53.145355    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-188903f5-vmv5t"]
Jul 24 16:15:53.230650 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:53.230585    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:53.327269 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:53.327228    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:53.549543 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:53.549513    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:54.017471 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:54.017442    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:54.119829 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:54.119791    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:54.220730 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:54.220704    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:54.403105 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:54.403018    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e57395f-cf4b-47ad-a753-d0f44427e442" path="/var/lib/kubelet/pods/1e57395f-cf4b-47ad-a753-d0f44427e442/volumes"
Jul 24 16:15:55.146208 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:55.146159    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:15:55.649959 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:15:55.649924    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:02.032275 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:02.032242    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:02.139960 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:02.139926    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:02.260360 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:02.260331    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:02.356510 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:02.356423    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:02.799643 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:02.799593    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:16.758813 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:16.758777    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:28.808384 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:28.808354    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:34.995917 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:34.995876    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:35.101932 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:35.101899    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:35.199823 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:35.199792    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:51.123447 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:51.123369    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:56.875274 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:56.875235    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:56.986135 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:56.986106    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:16:57.128337 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:16:57.128248    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:07.644873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:07.644840    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:08.439135 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:08.439106    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:15.246879 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:15.246843    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:15.348364 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:15.348307    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:15.444659 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:15.444624    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:15.541255 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:15.541182    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:16.316634 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:16.316581    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:16.415882 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:16.415849    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:16.519045 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:16.519012    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:18.105208 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:18.105164    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:18.984227 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:18.984192    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:17:24.747010 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:24.746962    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:24.848206 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:24.848166    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:25.452153 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:25.452113    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:28.887860 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:28.887823    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:17:32.201033 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:32.201000    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:32.300249 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:32.300215    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:32.480589 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:32.480479    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:32.844577 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:32.844483    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:33.198859 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:33.198827    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:35.669567 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.669535    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:35.781957 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.781931    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"]
Jul 24 16:17:35.782237 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782225    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d2ee758-ab82-485d-8154-71b26977bd7a" containerName="maas-api"
Jul 24 16:17:35.782282 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782239    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d2ee758-ab82-485d-8154-71b26977bd7a" containerName="maas-api"
Jul 24 16:17:35.782282 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782253    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e57395f-cf4b-47ad-a753-d0f44427e442" containerName="revoke-keys"
Jul 24 16:17:35.782282 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782258    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e57395f-cf4b-47ad-a753-d0f44427e442" containerName="revoke-keys"
Jul 24 16:17:35.782282 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782268    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4c93e6-1221-40bc-8454-37c0697af5e1" containerName="payload-processing"
Jul 24 16:17:35.782282 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782274    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4c93e6-1221-40bc-8454-37c0697af5e1" containerName="payload-processing"
Jul 24 16:17:35.782282 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782283    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e225fa9-440e-4921-bf64-bfeb8ea6a55d" containerName="payload-pre-processing"
Jul 24 16:17:35.782461 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782288    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e225fa9-440e-4921-bf64-bfeb8ea6a55d" containerName="payload-pre-processing"
Jul 24 16:17:35.782461 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782339    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e57395f-cf4b-47ad-a753-d0f44427e442" containerName="revoke-keys"
Jul 24 16:17:35.782461 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782347    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e225fa9-440e-4921-bf64-bfeb8ea6a55d" containerName="payload-pre-processing"
Jul 24 16:17:35.782461 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782354    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d2ee758-ab82-485d-8154-71b26977bd7a" containerName="maas-api"
Jul 24 16:17:35.782461 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.782360    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4c93e6-1221-40bc-8454-37c0697af5e1" containerName="payload-processing"
Jul 24 16:17:35.785200 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.785184    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:35.787728 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.787705    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-383dbbf6-serving-cert\""
Jul 24 16:17:35.787854 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.787751    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:17:35.789125 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.789107    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w4m8q\""
Jul 24 16:17:35.789125 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.789116    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:17:35.798310 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.798287    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:35.805373 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.805351    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"]
Jul 24 16:17:35.901208 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.901181    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:35.956707 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.956684    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6967a9-d020-47d6-aa11-25a5915b75d3-openshift-service-ca\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:35.956816 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.956715    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pncbm\" (UniqueName: \"kubernetes.io/projected/9a6967a9-d020-47d6-aa11-25a5915b75d3-kube-api-access-pncbm\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:35.956816 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:35.956737    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a6967a9-d020-47d6-aa11-25a5915b75d3-maas-api-tls\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:36.024387 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.024355    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:36.057452 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.057427    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6967a9-d020-47d6-aa11-25a5915b75d3-openshift-service-ca\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:36.057557 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.057458    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pncbm\" (UniqueName: \"kubernetes.io/projected/9a6967a9-d020-47d6-aa11-25a5915b75d3-kube-api-access-pncbm\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:36.057557 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.057482    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a6967a9-d020-47d6-aa11-25a5915b75d3-maas-api-tls\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:36.063872 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.058575    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6967a9-d020-47d6-aa11-25a5915b75d3-openshift-service-ca\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:36.064489 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.064473    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a6967a9-d020-47d6-aa11-25a5915b75d3-maas-api-tls\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:36.067406 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.067386    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pncbm\" (UniqueName: \"kubernetes.io/projected/9a6967a9-d020-47d6-aa11-25a5915b75d3-kube-api-access-pncbm\") pod \"maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:36.096245 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.096220    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:36.226540 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.226511    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"]
Jul 24 16:17:36.229104 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:17:36.229075    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6967a9_d020_47d6_aa11_25a5915b75d3.slice/crio-52f26b09a1d2b2d500dc6783a17d7f98e57ddd9c794c9793e5d5559358367a8d WatchSource:0}: Error finding container 52f26b09a1d2b2d500dc6783a17d7f98e57ddd9c794c9793e5d5559358367a8d: Status 404 returned error can't find the container with id 52f26b09a1d2b2d500dc6783a17d7f98e57ddd9c794c9793e5d5559358367a8d
Jul 24 16:17:36.333927 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.333897    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t" event={"ID":"9a6967a9-d020-47d6-aa11-25a5915b75d3","Type":"ContainerStarted","Data":"52f26b09a1d2b2d500dc6783a17d7f98e57ddd9c794c9793e5d5559358367a8d"}
Jul 24 16:17:36.653999 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.653909    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:36.795159 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.795129    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:36.910148 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.910075    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"]
Jul 24 16:17:36.913314 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.913299    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:36.915941 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.915917    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-383dbbf6\""
Jul 24 16:17:36.916121 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.916106    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-383dbbf6-dockercfg-brmjv\""
Jul 24 16:17:36.924377 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.924351    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"]
Jul 24 16:17:36.927970 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.927949    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"]
Jul 24 16:17:36.931173 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.931152    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:36.955543 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:36.955477    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"]
Jul 24 16:17:37.066427 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.066398    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11756f2-3e8e-4f31-be8b-f37ac0decf01-plugins-config-volume\") pod \"payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj\" (UID: \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\") " pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:37.066642 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.066492    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqjv\" (UniqueName: \"kubernetes.io/projected/9fed03fd-0263-410b-93f8-91351eb114b3-kube-api-access-7qqjv\") pod \"payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw\" (UID: \"9fed03fd-0263-410b-93f8-91351eb114b3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:37.066642 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.066549    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fed03fd-0263-410b-93f8-91351eb114b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw\" (UID: \"9fed03fd-0263-410b-93f8-91351eb114b3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:37.066642 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.066585    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d27w\" (UniqueName: \"kubernetes.io/projected/b11756f2-3e8e-4f31-be8b-f37ac0decf01-kube-api-access-7d27w\") pod \"payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj\" (UID: \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\") " pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:37.168001 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.167928    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11756f2-3e8e-4f31-be8b-f37ac0decf01-plugins-config-volume\") pod \"payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj\" (UID: \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\") " pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:37.168001 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.167978    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqjv\" (UniqueName: \"kubernetes.io/projected/9fed03fd-0263-410b-93f8-91351eb114b3-kube-api-access-7qqjv\") pod \"payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw\" (UID: \"9fed03fd-0263-410b-93f8-91351eb114b3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:37.168183 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.168004    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fed03fd-0263-410b-93f8-91351eb114b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw\" (UID: \"9fed03fd-0263-410b-93f8-91351eb114b3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:37.168183 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.168024    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d27w\" (UniqueName: \"kubernetes.io/projected/b11756f2-3e8e-4f31-be8b-f37ac0decf01-kube-api-access-7d27w\") pod \"payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj\" (UID: \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\") " pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:37.168683 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.168666    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fed03fd-0263-410b-93f8-91351eb114b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw\" (UID: \"9fed03fd-0263-410b-93f8-91351eb114b3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:37.168737 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.168697    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11756f2-3e8e-4f31-be8b-f37ac0decf01-plugins-config-volume\") pod \"payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj\" (UID: \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\") " pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:37.183761 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.183734    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqjv\" (UniqueName: \"kubernetes.io/projected/9fed03fd-0263-410b-93f8-91351eb114b3-kube-api-access-7qqjv\") pod \"payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw\" (UID: \"9fed03fd-0263-410b-93f8-91351eb114b3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:37.183898 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.183839    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d27w\" (UniqueName: \"kubernetes.io/projected/b11756f2-3e8e-4f31-be8b-f37ac0decf01-kube-api-access-7d27w\") pod \"payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj\" (UID: \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\") " pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:37.224712 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.224687    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:37.241903 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.241884    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:37.340987 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.340943    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t" event={"ID":"9a6967a9-d020-47d6-aa11-25a5915b75d3","Type":"ContainerStarted","Data":"f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e"}
Jul 24 16:17:37.341131 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.341068    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:37.367108 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.366899    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t" podStartSLOduration=1.909949277 podStartE2EDuration="2.366878261s" totalImagesPullingTime="456.928984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:37.366522427 +0000 UTC m=+1931.524389128" watchObservedRunningTime="2026-07-24 16:17:37.366878261 +0000 UTC m=+1931.524744964"
Jul 24 16:17:37.372346 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.372316    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"]
Jul 24 16:17:37.376152 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:17:37.376117    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fed03fd_0263_410b_93f8_91351eb114b3.slice/crio-94d4804569ce4a17fe219d85c4705ec0a1ea6bbffa4565fd4fd28a68c6be1fc9 WatchSource:0}: Error finding container 94d4804569ce4a17fe219d85c4705ec0a1ea6bbffa4565fd4fd28a68c6be1fc9: Status 404 returned error can't find the container with id 94d4804569ce4a17fe219d85c4705ec0a1ea6bbffa4565fd4fd28a68c6be1fc9
Jul 24 16:17:37.401312 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:37.401292    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"]
Jul 24 16:17:37.406680 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:17:37.406653    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11756f2_3e8e_4f31_be8b_f37ac0decf01.slice/crio-d6e5aabff8c4ae49eb6daee77760f9c925f59d8195945d82d74970ddb7c2727f WatchSource:0}: Error finding container d6e5aabff8c4ae49eb6daee77760f9c925f59d8195945d82d74970ddb7c2727f: Status 404 returned error can't find the container with id d6e5aabff8c4ae49eb6daee77760f9c925f59d8195945d82d74970ddb7c2727f
Jul 24 16:17:38.346672 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:38.346638    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj" event={"ID":"b11756f2-3e8e-4f31-be8b-f37ac0decf01","Type":"ContainerStarted","Data":"200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5"}
Jul 24 16:17:38.347118 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:38.346695    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj" event={"ID":"b11756f2-3e8e-4f31-be8b-f37ac0decf01","Type":"ContainerStarted","Data":"d6e5aabff8c4ae49eb6daee77760f9c925f59d8195945d82d74970ddb7c2727f"}
Jul 24 16:17:38.347118 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:38.346833    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:38.349408 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:38.349294    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw" event={"ID":"9fed03fd-0263-410b-93f8-91351eb114b3","Type":"ContainerStarted","Data":"1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c"}
Jul 24 16:17:38.349408 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:38.349338    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:38.349408 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:38.349359    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw" event={"ID":"9fed03fd-0263-410b-93f8-91351eb114b3","Type":"ContainerStarted","Data":"94d4804569ce4a17fe219d85c4705ec0a1ea6bbffa4565fd4fd28a68c6be1fc9"}
Jul 24 16:17:38.367567 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:38.367523    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj" podStartSLOduration=2.367509225 podStartE2EDuration="2.367509225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:38.366078874 +0000 UTC m=+1932.523945583" watchObservedRunningTime="2026-07-24 16:17:38.367509225 +0000 UTC m=+1932.525375923"
Jul 24 16:17:38.381419 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:38.381368    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw" podStartSLOduration=2.3813524 podStartE2EDuration="2.3813524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:38.380850033 +0000 UTC m=+1932.538716756" watchObservedRunningTime="2026-07-24 16:17:38.3813524 +0000 UTC m=+1932.539219099"
Jul 24 16:17:40.110949 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:40.110912    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:40.773096 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:40.773057    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:40.871849 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:40.871805    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:41.197221 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:41.197189    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:42.385901 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:42.385860    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:17:43.354629 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:43.354580    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:47.108394 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.108354    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:47.208020 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.207990    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:47.460998 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.460960    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"]
Jul 24 16:17:47.465851 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.465821    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"
Jul 24 16:17:47.468739 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.468717    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:17:47.472202 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.472175    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"]
Jul 24 16:17:47.548025 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.547996    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da441f5b-41e3-41ef-a24b-a246e26e519b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x\" (UID: \"da441f5b-41e3-41ef-a24b-a246e26e519b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"
Jul 24 16:17:47.649081 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.649048    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da441f5b-41e3-41ef-a24b-a246e26e519b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x\" (UID: \"da441f5b-41e3-41ef-a24b-a246e26e519b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"
Jul 24 16:17:47.649715 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.649697    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da441f5b-41e3-41ef-a24b-a246e26e519b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x\" (UID: \"da441f5b-41e3-41ef-a24b-a246e26e519b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"
Jul 24 16:17:47.780454 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.780373    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"
Jul 24 16:17:47.905560 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:47.905533    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"]
Jul 24 16:17:47.908586 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:17:47.908560    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda441f5b_41e3_41ef_a24b_a246e26e519b.slice/crio-79ffd58d101e3398e9b3c9a14edcc2ee12fccddfba8a3f4fb25541f2b5614d4b WatchSource:0}: Error finding container 79ffd58d101e3398e9b3c9a14edcc2ee12fccddfba8a3f4fb25541f2b5614d4b: Status 404 returned error can't find the container with id 79ffd58d101e3398e9b3c9a14edcc2ee12fccddfba8a3f4fb25541f2b5614d4b
Jul 24 16:17:48.396147 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:48.396067    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x" event={"ID":"da441f5b-41e3-41ef-a24b-a246e26e519b","Type":"ContainerStarted","Data":"a58c06ea7eee1141612b22fa8567949915bace79650de7fe92e55d686e29142b"}
Jul 24 16:17:48.396147 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:48.396121    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x" event={"ID":"da441f5b-41e3-41ef-a24b-a246e26e519b","Type":"ContainerStarted","Data":"79ffd58d101e3398e9b3c9a14edcc2ee12fccddfba8a3f4fb25541f2b5614d4b"}
Jul 24 16:17:48.414492 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:48.414409    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x" podStartSLOduration=1.414392994 podStartE2EDuration="1.414392994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:48.413968725 +0000 UTC m=+1942.571835425" watchObservedRunningTime="2026-07-24 16:17:48.414392994 +0000 UTC m=+1942.572259693"
Jul 24 16:17:49.355419 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:49.355387    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:49.355595 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:49.355467    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:49.403644 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:49.403600    2600 generic.go:356] "Generic (PLEG): container finished" podID="da441f5b-41e3-41ef-a24b-a246e26e519b" containerID="a58c06ea7eee1141612b22fa8567949915bace79650de7fe92e55d686e29142b" exitCode=0
Jul 24 16:17:49.404079 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:49.403641    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x" event={"ID":"da441f5b-41e3-41ef-a24b-a246e26e519b","Type":"ContainerDied","Data":"a58c06ea7eee1141612b22fa8567949915bace79650de7fe92e55d686e29142b"}
Jul 24 16:17:50.538281 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:50.538258    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"
Jul 24 16:17:50.574041 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:50.574018    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da441f5b-41e3-41ef-a24b-a246e26e519b-maas-api-service-ca\") pod \"da441f5b-41e3-41ef-a24b-a246e26e519b\" (UID: \"da441f5b-41e3-41ef-a24b-a246e26e519b\") "
Jul 24 16:17:50.574424 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:50.574400    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da441f5b-41e3-41ef-a24b-a246e26e519b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da441f5b-41e3-41ef-a24b-a246e26e519b" (UID: "da441f5b-41e3-41ef-a24b-a246e26e519b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:17:50.674654 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:50.674586    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da441f5b-41e3-41ef-a24b-a246e26e519b-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:17:51.420618 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:51.420581    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x" event={"ID":"da441f5b-41e3-41ef-a24b-a246e26e519b","Type":"ContainerDied","Data":"79ffd58d101e3398e9b3c9a14edcc2ee12fccddfba8a3f4fb25541f2b5614d4b"}
Jul 24 16:17:51.420794 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:51.420673    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79ffd58d101e3398e9b3c9a14edcc2ee12fccddfba8a3f4fb25541f2b5614d4b"
Jul 24 16:17:51.420794 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:51.420588    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"
Jul 24 16:17:57.798930 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.798898    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"]
Jul 24 16:17:57.799360 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.799129    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t" podUID="9a6967a9-d020-47d6-aa11-25a5915b75d3" containerName="maas-api" containerID="cri-o://f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e" gracePeriod=30
Jul 24 16:17:57.826003 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.825979    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:57.854635 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.854589    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"]
Jul 24 16:17:57.854867 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.854843    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj" podUID="b11756f2-3e8e-4f31-be8b-f37ac0decf01" containerName="payload-processing" containerID="cri-o://200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5" gracePeriod=30
Jul 24 16:17:57.860150 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.860117    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"]
Jul 24 16:17:57.860523 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.860341    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw" podUID="9fed03fd-0263-410b-93f8-91351eb114b3" containerName="payload-pre-processing" containerID="cri-o://1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c" gracePeriod=30
Jul 24 16:17:57.896621 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.896567    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:57.966276 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:57.966238    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:17:58.145300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.145275    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:58.148237 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.148211    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:58.153320 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.153300    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:58.236701 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.236674    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6967a9-d020-47d6-aa11-25a5915b75d3-openshift-service-ca\") pod \"9a6967a9-d020-47d6-aa11-25a5915b75d3\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") "
Jul 24 16:17:58.236859 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.236758    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a6967a9-d020-47d6-aa11-25a5915b75d3-maas-api-tls\") pod \"9a6967a9-d020-47d6-aa11-25a5915b75d3\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") "
Jul 24 16:17:58.236859 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.236783    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qqjv\" (UniqueName: \"kubernetes.io/projected/9fed03fd-0263-410b-93f8-91351eb114b3-kube-api-access-7qqjv\") pod \"9fed03fd-0263-410b-93f8-91351eb114b3\" (UID: \"9fed03fd-0263-410b-93f8-91351eb114b3\") "
Jul 24 16:17:58.236859 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.236800    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fed03fd-0263-410b-93f8-91351eb114b3-plugins-config-volume\") pod \"9fed03fd-0263-410b-93f8-91351eb114b3\" (UID: \"9fed03fd-0263-410b-93f8-91351eb114b3\") "
Jul 24 16:17:58.236859 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.236836    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11756f2-3e8e-4f31-be8b-f37ac0decf01-plugins-config-volume\") pod \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\" (UID: \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\") "
Jul 24 16:17:58.237111 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.236889    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pncbm\" (UniqueName: \"kubernetes.io/projected/9a6967a9-d020-47d6-aa11-25a5915b75d3-kube-api-access-pncbm\") pod \"9a6967a9-d020-47d6-aa11-25a5915b75d3\" (UID: \"9a6967a9-d020-47d6-aa11-25a5915b75d3\") "
Jul 24 16:17:58.237111 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.236923    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d27w\" (UniqueName: \"kubernetes.io/projected/b11756f2-3e8e-4f31-be8b-f37ac0decf01-kube-api-access-7d27w\") pod \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\" (UID: \"b11756f2-3e8e-4f31-be8b-f37ac0decf01\") "
Jul 24 16:17:58.237111 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.237075    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6967a9-d020-47d6-aa11-25a5915b75d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a6967a9-d020-47d6-aa11-25a5915b75d3" (UID: "9a6967a9-d020-47d6-aa11-25a5915b75d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:17:58.237266 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.237227    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fed03fd-0263-410b-93f8-91351eb114b3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9fed03fd-0263-410b-93f8-91351eb114b3" (UID: "9fed03fd-0263-410b-93f8-91351eb114b3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:17:58.237315 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.237295    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b11756f2-3e8e-4f31-be8b-f37ac0decf01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b11756f2-3e8e-4f31-be8b-f37ac0decf01" (UID: "b11756f2-3e8e-4f31-be8b-f37ac0decf01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:17:58.239177 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.239152    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b11756f2-3e8e-4f31-be8b-f37ac0decf01-kube-api-access-7d27w" (OuterVolumeSpecName: "kube-api-access-7d27w") pod "b11756f2-3e8e-4f31-be8b-f37ac0decf01" (UID: "b11756f2-3e8e-4f31-be8b-f37ac0decf01"). InnerVolumeSpecName "kube-api-access-7d27w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:17:58.239314 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.239181    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6967a9-d020-47d6-aa11-25a5915b75d3-kube-api-access-pncbm" (OuterVolumeSpecName: "kube-api-access-pncbm") pod "9a6967a9-d020-47d6-aa11-25a5915b75d3" (UID: "9a6967a9-d020-47d6-aa11-25a5915b75d3"). InnerVolumeSpecName "kube-api-access-pncbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:17:58.239314 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.239196    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fed03fd-0263-410b-93f8-91351eb114b3-kube-api-access-7qqjv" (OuterVolumeSpecName: "kube-api-access-7qqjv") pod "9fed03fd-0263-410b-93f8-91351eb114b3" (UID: "9fed03fd-0263-410b-93f8-91351eb114b3"). InnerVolumeSpecName "kube-api-access-7qqjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:17:58.239314 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.239214    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6967a9-d020-47d6-aa11-25a5915b75d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a6967a9-d020-47d6-aa11-25a5915b75d3" (UID: "9a6967a9-d020-47d6-aa11-25a5915b75d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:17:58.338503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.338418    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a6967a9-d020-47d6-aa11-25a5915b75d3-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:17:58.338503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.338450    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qqjv\" (UniqueName: \"kubernetes.io/projected/9fed03fd-0263-410b-93f8-91351eb114b3-kube-api-access-7qqjv\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:17:58.338503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.338460    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fed03fd-0263-410b-93f8-91351eb114b3-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:17:58.338503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.338470    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11756f2-3e8e-4f31-be8b-f37ac0decf01-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:17:58.338503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.338478    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pncbm\" (UniqueName: \"kubernetes.io/projected/9a6967a9-d020-47d6-aa11-25a5915b75d3-kube-api-access-pncbm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:17:58.338503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.338488    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d27w\" (UniqueName: \"kubernetes.io/projected/b11756f2-3e8e-4f31-be8b-f37ac0decf01-kube-api-access-7d27w\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:17:58.338503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.338496    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6967a9-d020-47d6-aa11-25a5915b75d3-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:17:58.454190 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.454157    2600 generic.go:356] "Generic (PLEG): container finished" podID="9fed03fd-0263-410b-93f8-91351eb114b3" containerID="1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c" exitCode=0
Jul 24 16:17:58.454366 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.454205    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"
Jul 24 16:17:58.454366 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.454251    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw" event={"ID":"9fed03fd-0263-410b-93f8-91351eb114b3","Type":"ContainerDied","Data":"1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c"}
Jul 24 16:17:58.454366 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.454315    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw" event={"ID":"9fed03fd-0263-410b-93f8-91351eb114b3","Type":"ContainerDied","Data":"94d4804569ce4a17fe219d85c4705ec0a1ea6bbffa4565fd4fd28a68c6be1fc9"}
Jul 24 16:17:58.454366 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.454339    2600 scope.go:117] "RemoveContainer" containerID="1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c"
Jul 24 16:17:58.455498 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.455474    2600 generic.go:356] "Generic (PLEG): container finished" podID="9a6967a9-d020-47d6-aa11-25a5915b75d3" containerID="f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e" exitCode=0
Jul 24 16:17:58.455629 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.455548    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"
Jul 24 16:17:58.455692 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.455545    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t" event={"ID":"9a6967a9-d020-47d6-aa11-25a5915b75d3","Type":"ContainerDied","Data":"f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e"}
Jul 24 16:17:58.455692 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.455669    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t" event={"ID":"9a6967a9-d020-47d6-aa11-25a5915b75d3","Type":"ContainerDied","Data":"52f26b09a1d2b2d500dc6783a17d7f98e57ddd9c794c9793e5d5559358367a8d"}
Jul 24 16:17:58.457194 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.457170    2600 generic.go:356] "Generic (PLEG): container finished" podID="b11756f2-3e8e-4f31-be8b-f37ac0decf01" containerID="200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5" exitCode=0
Jul 24 16:17:58.457349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.457209    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"
Jul 24 16:17:58.457349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.457222    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj" event={"ID":"b11756f2-3e8e-4f31-be8b-f37ac0decf01","Type":"ContainerDied","Data":"200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5"}
Jul 24 16:17:58.457349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.457259    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj" event={"ID":"b11756f2-3e8e-4f31-be8b-f37ac0decf01","Type":"ContainerDied","Data":"d6e5aabff8c4ae49eb6daee77760f9c925f59d8195945d82d74970ddb7c2727f"}
Jul 24 16:17:58.463826 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.463807    2600 scope.go:117] "RemoveContainer" containerID="1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c"
Jul 24 16:17:58.464112 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:17:58.464090    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c\": container with ID starting with 1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c not found: ID does not exist" containerID="1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c"
Jul 24 16:17:58.464188 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.464119    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c"} err="failed to get container status \"1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c\": rpc error: code = NotFound desc = could not find container \"1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c\": container with ID starting with 1e0e4a17be2aac366ad8294098d43f5b26d85f21741cbfcd931197646240674c not found: ID does not exist"
Jul 24 16:17:58.464188 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.464135    2600 scope.go:117] "RemoveContainer" containerID="f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e"
Jul 24 16:17:58.472042 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.472025    2600 scope.go:117] "RemoveContainer" containerID="f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e"
Jul 24 16:17:58.472305 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:17:58.472287    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e\": container with ID starting with f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e not found: ID does not exist" containerID="f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e"
Jul 24 16:17:58.472357 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.472314    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e"} err="failed to get container status \"f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e\": rpc error: code = NotFound desc = could not find container \"f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e\": container with ID starting with f911072a0f807a8971bc15d170fc7ced945fddcc72364ebdbced7e6c81a4330e not found: ID does not exist"
Jul 24 16:17:58.472357 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.472329    2600 scope.go:117] "RemoveContainer" containerID="200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5"
Jul 24 16:17:58.479780 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.479756    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"]
Jul 24 16:17:58.481036 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.481017    2600 scope.go:117] "RemoveContainer" containerID="200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5"
Jul 24 16:17:58.481316 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:17:58.481296    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5\": container with ID starting with 200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5 not found: ID does not exist" containerID="200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5"
Jul 24 16:17:58.481388 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.481322    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5"} err="failed to get container status \"200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5\": rpc error: code = NotFound desc = could not find container \"200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5\": container with ID starting with 200a38fd39a0ca6183261b0bff74d2e79936d8c3dcf851c53c254336c449d3d5 not found: ID does not exist"
Jul 24 16:17:58.484440 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.484419    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-383dbbf6-5b9967c864-zcphw"]
Jul 24 16:17:58.494950 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.494926    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"]
Jul 24 16:17:58.499017 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.498996    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-383dbbf6-86c464d78b-n2wsj"]
Jul 24 16:17:58.509652 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.509621    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"]
Jul 24 16:17:58.511953 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:17:58.511933    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-383dbbf6-7bc9f7b59b-cns8t"]
Jul 24 16:18:00.403286 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:00.403253    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a6967a9-d020-47d6-aa11-25a5915b75d3" path="/var/lib/kubelet/pods/9a6967a9-d020-47d6-aa11-25a5915b75d3/volumes"
Jul 24 16:18:00.403736 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:00.403587    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fed03fd-0263-410b-93f8-91351eb114b3" path="/var/lib/kubelet/pods/9fed03fd-0263-410b-93f8-91351eb114b3/volumes"
Jul 24 16:18:00.403932 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:00.403917    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b11756f2-3e8e-4f31-be8b-f37ac0decf01" path="/var/lib/kubelet/pods/b11756f2-3e8e-4f31-be8b-f37ac0decf01/volumes"
Jul 24 16:18:00.706221 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:00.706187    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:18:02.583824 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:02.583789    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:02.596536 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:02.596505    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"]
Jul 24 16:18:02.600332 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:02.600311    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-383dbbf6-twx7x"]
Jul 24 16:18:02.963939 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:02.963898    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:04.403540 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:04.403506    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da441f5b-41e3-41ef-a24b-a246e26e519b" path="/var/lib/kubelet/pods/da441f5b-41e3-41ef-a24b-a246e26e519b/volumes"
Jul 24 16:18:09.291347 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:09.291307    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:09.404190 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:09.404156    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:09.619863 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:09.619776    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:09.932162 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:09.932135    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:10.119144 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:10.119115    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:10.259091 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:10.258999    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:15.899423 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:15.899388    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:16.005447 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:16.005412    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:16.100124 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:16.100094    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:16.258898 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:16.258864    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:20.650150 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:20.650062    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:22.363366 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:22.363335    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:22.462427 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:22.462384    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:29.214919 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:29.214886    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:29.535982 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:29.535894    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:30.341455 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:30.341419    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:32.934669 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:32.934639    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:33.083070 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.083039    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:33.122551 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122525    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"]
Jul 24 16:18:33.122834 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122819    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6967a9-d020-47d6-aa11-25a5915b75d3" containerName="maas-api"
Jul 24 16:18:33.122834 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122834    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6967a9-d020-47d6-aa11-25a5915b75d3" containerName="maas-api"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122847    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fed03fd-0263-410b-93f8-91351eb114b3" containerName="payload-pre-processing"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122853    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fed03fd-0263-410b-93f8-91351eb114b3" containerName="payload-pre-processing"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122862    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da441f5b-41e3-41ef-a24b-a246e26e519b" containerName="revoke-keys"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122867    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="da441f5b-41e3-41ef-a24b-a246e26e519b" containerName="revoke-keys"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122881    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b11756f2-3e8e-4f31-be8b-f37ac0decf01" containerName="payload-processing"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122886    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="b11756f2-3e8e-4f31-be8b-f37ac0decf01" containerName="payload-processing"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122932    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="b11756f2-3e8e-4f31-be8b-f37ac0decf01" containerName="payload-processing"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122944    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6967a9-d020-47d6-aa11-25a5915b75d3" containerName="maas-api"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122955    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fed03fd-0263-410b-93f8-91351eb114b3" containerName="payload-pre-processing"
Jul 24 16:18:33.123002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.122963    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="da441f5b-41e3-41ef-a24b-a246e26e519b" containerName="revoke-keys"
Jul 24 16:18:33.125931 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.125912    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.132499 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.132189    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f4ba5c28-serving-cert\""
Jul 24 16:18:33.140095 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.140072    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:18:33.140212 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.140105    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w4m8q\""
Jul 24 16:18:33.140392 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.140376    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:18:33.155204 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.155181    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"]
Jul 24 16:18:33.226255 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.226179    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb8kh\" (UniqueName: \"kubernetes.io/projected/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-kube-api-access-fb8kh\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.226255 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.226243    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-openshift-service-ca\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.226422 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.226309    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-maas-api-tls\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.227869 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.227846    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:33.327740 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.327712    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb8kh\" (UniqueName: \"kubernetes.io/projected/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-kube-api-access-fb8kh\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.327902 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.327757    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-openshift-service-ca\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.327902 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.327787    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-maas-api-tls\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.328423 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.328398    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-openshift-service-ca\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.330271 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.330256    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-maas-api-tls\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.348344 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.348320    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb8kh\" (UniqueName: \"kubernetes.io/projected/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-kube-api-access-fb8kh\") pod \"maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.435731 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.435712    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:33.455474 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.455447    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:33.610691 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:18:33.610665    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4335d4_55b7_4268_b8bc_0b8e9bae3a26.slice/crio-ab08d6ece1c29ce602656763809ea01b8ad51b0836b5aa207e631af20d5e1788 WatchSource:0}: Error finding container ab08d6ece1c29ce602656763809ea01b8ad51b0836b5aa207e631af20d5e1788: Status 404 returned error can't find the container with id ab08d6ece1c29ce602656763809ea01b8ad51b0836b5aa207e631af20d5e1788
Jul 24 16:18:33.612180 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.612156    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"]
Jul 24 16:18:33.624558 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:33.624532    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2" event={"ID":"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26","Type":"ContainerStarted","Data":"ab08d6ece1c29ce602656763809ea01b8ad51b0836b5aa207e631af20d5e1788"}
Jul 24 16:18:34.187431 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.187404    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:34.318367 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.318282    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:34.421869 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.421841    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"]
Jul 24 16:18:34.424949 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.424932    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:34.432868 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.432845    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f4ba5c28-dockercfg-lnbdf\""
Jul 24 16:18:34.432868 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.432860    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f4ba5c28\""
Jul 24 16:18:34.456529 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.456510    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"]
Jul 24 16:18:34.472976 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.472950    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"]
Jul 24 16:18:34.475958 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.475944    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:34.503285 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.503261    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"]
Jul 24 16:18:34.544841 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.544817    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852\" (UID: \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:34.544989 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.544971    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwsqs\" (UniqueName: \"kubernetes.io/projected/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-kube-api-access-cwsqs\") pod \"payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852\" (UID: \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:34.634167 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.634092    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2" event={"ID":"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26","Type":"ContainerStarted","Data":"e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5"}
Jul 24 16:18:34.634294 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.634213    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:34.646164 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.646135    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852\" (UID: \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:34.646258 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.646179    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bdkp\" (UniqueName: \"kubernetes.io/projected/6c467de2-8ed4-499b-b515-6650a4eeab03-kube-api-access-5bdkp\") pod \"payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl\" (UID: \"6c467de2-8ed4-499b-b515-6650a4eeab03\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:34.646323 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.646258    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwsqs\" (UniqueName: \"kubernetes.io/projected/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-kube-api-access-cwsqs\") pod \"payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852\" (UID: \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:34.646323 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.646284    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c467de2-8ed4-499b-b515-6650a4eeab03-plugins-config-volume\") pod \"payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl\" (UID: \"6c467de2-8ed4-499b-b515-6650a4eeab03\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:34.646787 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.646771    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852\" (UID: \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:34.660010 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.659982    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwsqs\" (UniqueName: \"kubernetes.io/projected/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-kube-api-access-cwsqs\") pod \"payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852\" (UID: \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:34.672392 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.672352    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2" podStartSLOduration=1.302106155 podStartE2EDuration="1.672339718s" totalImagesPullingTime="370.233563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:18:34.670662615 +0000 UTC m=+1988.828529310" watchObservedRunningTime="2026-07-24 16:18:34.672339718 +0000 UTC m=+1988.830206416"
Jul 24 16:18:34.735055 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.735034    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:34.747060 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.747037    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bdkp\" (UniqueName: \"kubernetes.io/projected/6c467de2-8ed4-499b-b515-6650a4eeab03-kube-api-access-5bdkp\") pod \"payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl\" (UID: \"6c467de2-8ed4-499b-b515-6650a4eeab03\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:34.747159 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.747100    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c467de2-8ed4-499b-b515-6650a4eeab03-plugins-config-volume\") pod \"payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl\" (UID: \"6c467de2-8ed4-499b-b515-6650a4eeab03\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:34.747840 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.747815    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c467de2-8ed4-499b-b515-6650a4eeab03-plugins-config-volume\") pod \"payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl\" (UID: \"6c467de2-8ed4-499b-b515-6650a4eeab03\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:34.765694 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.765671    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bdkp\" (UniqueName: \"kubernetes.io/projected/6c467de2-8ed4-499b-b515-6650a4eeab03-kube-api-access-5bdkp\") pod \"payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl\" (UID: \"6c467de2-8ed4-499b-b515-6650a4eeab03\") " pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:34.785562 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.785531    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:34.879126 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.879100    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"]
Jul 24 16:18:34.880675 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:18:34.880647    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd217e11_c7aa_47a3_9b2c_96b07790b1f6.slice/crio-8e814cfb59b7f4e7a9f1534f856b76443b0c4c2224bfc6249f4be6c255e62f01 WatchSource:0}: Error finding container 8e814cfb59b7f4e7a9f1534f856b76443b0c4c2224bfc6249f4be6c255e62f01: Status 404 returned error can't find the container with id 8e814cfb59b7f4e7a9f1534f856b76443b0c4c2224bfc6249f4be6c255e62f01
Jul 24 16:18:34.931514 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:34.931493    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"]
Jul 24 16:18:34.934179 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:18:34.934155    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c467de2_8ed4_499b_b515_6650a4eeab03.slice/crio-ed255a6cc19518bb102be062b29721f88f2eb7e9f47f8e86247de5948e37e870 WatchSource:0}: Error finding container ed255a6cc19518bb102be062b29721f88f2eb7e9f47f8e86247de5948e37e870: Status 404 returned error can't find the container with id ed255a6cc19518bb102be062b29721f88f2eb7e9f47f8e86247de5948e37e870
Jul 24 16:18:35.646480 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:35.646445    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl" event={"ID":"6c467de2-8ed4-499b-b515-6650a4eeab03","Type":"ContainerStarted","Data":"4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0"}
Jul 24 16:18:35.646945 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:35.646518    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl" event={"ID":"6c467de2-8ed4-499b-b515-6650a4eeab03","Type":"ContainerStarted","Data":"ed255a6cc19518bb102be062b29721f88f2eb7e9f47f8e86247de5948e37e870"}
Jul 24 16:18:35.646945 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:35.646585    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:35.648289 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:35.648251    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852" event={"ID":"cd217e11-c7aa-47a3-9b2c-96b07790b1f6","Type":"ContainerStarted","Data":"e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84"}
Jul 24 16:18:35.648414 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:35.648330    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:35.648414 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:35.648381    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852" event={"ID":"cd217e11-c7aa-47a3-9b2c-96b07790b1f6","Type":"ContainerStarted","Data":"8e814cfb59b7f4e7a9f1534f856b76443b0c4c2224bfc6249f4be6c255e62f01"}
Jul 24 16:18:35.675274 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:35.675231    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl" podStartSLOduration=1.6752182960000002 podStartE2EDuration="1.675218296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:18:35.674389233 +0000 UTC m=+1989.832255957" watchObservedRunningTime="2026-07-24 16:18:35.675218296 +0000 UTC m=+1989.833084994"
Jul 24 16:18:35.710352 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:35.710305    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852" podStartSLOduration=1.710293793 podStartE2EDuration="1.710293793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:18:35.708594051 +0000 UTC m=+1989.866460752" watchObservedRunningTime="2026-07-24 16:18:35.710293793 +0000 UTC m=+1989.868160491"
Jul 24 16:18:37.461830 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:37.461795    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:39.822471 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:39.822441    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:18:40.654106 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:40.654080    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:18:46.655255 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:46.655222    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:18:46.655646 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:46.655312    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:18:49.065495 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:49.065454    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:18:52.403945 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:18:52.403914    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:19:10.023893 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:10.023859    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:19:17.286327 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.286291    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"]
Jul 24 16:19:17.289865 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.289849    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"
Jul 24 16:19:17.293060 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.293041    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:19:17.312772 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.312257    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"]
Jul 24 16:19:17.387389 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.387362    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443a0ffa-9b07-4148-b1f5-a2c630f76696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9\" (UID: \"443a0ffa-9b07-4148-b1f5-a2c630f76696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"
Jul 24 16:19:17.488863 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.488823    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443a0ffa-9b07-4148-b1f5-a2c630f76696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9\" (UID: \"443a0ffa-9b07-4148-b1f5-a2c630f76696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"
Jul 24 16:19:17.489436 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.489416    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443a0ffa-9b07-4148-b1f5-a2c630f76696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9\" (UID: \"443a0ffa-9b07-4148-b1f5-a2c630f76696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"
Jul 24 16:19:17.600023 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.599940    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"
Jul 24 16:19:17.768590 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.768554    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"]
Jul 24 16:19:17.772911 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:19:17.772885    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443a0ffa_9b07_4148_b1f5_a2c630f76696.slice/crio-a26612de0a371597196becf3b856d3238d623814f503b8d7f1bc36c8511ea41f WatchSource:0}: Error finding container a26612de0a371597196becf3b856d3238d623814f503b8d7f1bc36c8511ea41f: Status 404 returned error can't find the container with id a26612de0a371597196becf3b856d3238d623814f503b8d7f1bc36c8511ea41f
Jul 24 16:19:17.846253 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:17.846225    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9" event={"ID":"443a0ffa-9b07-4148-b1f5-a2c630f76696","Type":"ContainerStarted","Data":"a26612de0a371597196becf3b856d3238d623814f503b8d7f1bc36c8511ea41f"}
Jul 24 16:19:18.852960 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:18.852864    2600 generic.go:356] "Generic (PLEG): container finished" podID="443a0ffa-9b07-4148-b1f5-a2c630f76696" containerID="2f7d471763460c3ef1485f4e200c6f2282a8526d8e1548831e8aa566dc3eb794" exitCode=0
Jul 24 16:19:18.853368 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:18.852956    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9" event={"ID":"443a0ffa-9b07-4148-b1f5-a2c630f76696","Type":"ContainerDied","Data":"2f7d471763460c3ef1485f4e200c6f2282a8526d8e1548831e8aa566dc3eb794"}
Jul 24 16:19:19.983045 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:19.983021    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"
Jul 24 16:19:20.114727 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:20.114647    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443a0ffa-9b07-4148-b1f5-a2c630f76696-maas-api-service-ca\") pod \"443a0ffa-9b07-4148-b1f5-a2c630f76696\" (UID: \"443a0ffa-9b07-4148-b1f5-a2c630f76696\") "
Jul 24 16:19:20.115010 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:20.114982    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/443a0ffa-9b07-4148-b1f5-a2c630f76696-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "443a0ffa-9b07-4148-b1f5-a2c630f76696" (UID: "443a0ffa-9b07-4148-b1f5-a2c630f76696"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:19:20.216024 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:20.215994    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443a0ffa-9b07-4148-b1f5-a2c630f76696-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:19:20.863902 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:20.863876    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"
Jul 24 16:19:20.863902 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:20.863889    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9" event={"ID":"443a0ffa-9b07-4148-b1f5-a2c630f76696","Type":"ContainerDied","Data":"a26612de0a371597196becf3b856d3238d623814f503b8d7f1bc36c8511ea41f"}
Jul 24 16:19:20.864114 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:20.863938    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a26612de0a371597196becf3b856d3238d623814f503b8d7f1bc36c8511ea41f"
Jul 24 16:19:31.753680 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:31.753642    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:19:32.917929 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:32.917899    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"]
Jul 24 16:19:32.918359 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:32.918095    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2" podUID="8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" containerName="maas-api" containerID="cri-o://e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5" gracePeriod=30
Jul 24 16:19:32.984941 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:32.984907    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:19:33.034123 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.034098    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"]
Jul 24 16:19:33.034347 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.034323    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl" podUID="6c467de2-8ed4-499b-b515-6650a4eeab03" containerName="payload-processing" containerID="cri-o://4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0" gracePeriod=30
Jul 24 16:19:33.047820 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.047794    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"]
Jul 24 16:19:33.048024 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.048000    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852" podUID="cd217e11-c7aa-47a3-9b2c-96b07790b1f6" containerName="payload-pre-processing" containerID="cri-o://e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84" gracePeriod=30
Jul 24 16:19:33.181002 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.180968    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:19:33.297657 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.297634    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:19:33.331955 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.331929    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-maas-api-tls\") pod \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") "
Jul 24 16:19:33.332107 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.331983    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-openshift-service-ca\") pod \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") "
Jul 24 16:19:33.332107 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.332002    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb8kh\" (UniqueName: \"kubernetes.io/projected/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-kube-api-access-fb8kh\") pod \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\" (UID: \"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26\") "
Jul 24 16:19:33.332364 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.332333    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" (UID: "8e4335d4-55b7-4268-b8bc-0b8e9bae3a26"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:19:33.334331 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.334309    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" (UID: "8e4335d4-55b7-4268-b8bc-0b8e9bae3a26"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:19:33.334437 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.334418    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-kube-api-access-fb8kh" (OuterVolumeSpecName: "kube-api-access-fb8kh") pod "8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" (UID: "8e4335d4-55b7-4268-b8bc-0b8e9bae3a26"). InnerVolumeSpecName "kube-api-access-fb8kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:19:33.336176 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.336156    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:19:33.433266 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433188    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bdkp\" (UniqueName: \"kubernetes.io/projected/6c467de2-8ed4-499b-b515-6650a4eeab03-kube-api-access-5bdkp\") pod \"6c467de2-8ed4-499b-b515-6650a4eeab03\" (UID: \"6c467de2-8ed4-499b-b515-6650a4eeab03\") "
Jul 24 16:19:33.433266 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433236    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c467de2-8ed4-499b-b515-6650a4eeab03-plugins-config-volume\") pod \"6c467de2-8ed4-499b-b515-6650a4eeab03\" (UID: \"6c467de2-8ed4-499b-b515-6650a4eeab03\") "
Jul 24 16:19:33.433492 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433305    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwsqs\" (UniqueName: \"kubernetes.io/projected/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-kube-api-access-cwsqs\") pod \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\" (UID: \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\") "
Jul 24 16:19:33.433492 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433342    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-plugins-config-volume\") pod \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\" (UID: \"cd217e11-c7aa-47a3-9b2c-96b07790b1f6\") "
Jul 24 16:19:33.433637 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433586    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:19:33.433637 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433630    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:19:33.433746 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433645    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb8kh\" (UniqueName: \"kubernetes.io/projected/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26-kube-api-access-fb8kh\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:19:33.433746 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433721    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c467de2-8ed4-499b-b515-6650a4eeab03-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c467de2-8ed4-499b-b515-6650a4eeab03" (UID: "6c467de2-8ed4-499b-b515-6650a4eeab03"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:19:33.433827 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.433743    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd217e11-c7aa-47a3-9b2c-96b07790b1f6" (UID: "cd217e11-c7aa-47a3-9b2c-96b07790b1f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:19:33.435536 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.435516    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-kube-api-access-cwsqs" (OuterVolumeSpecName: "kube-api-access-cwsqs") pod "cd217e11-c7aa-47a3-9b2c-96b07790b1f6" (UID: "cd217e11-c7aa-47a3-9b2c-96b07790b1f6"). InnerVolumeSpecName "kube-api-access-cwsqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:19:33.435581 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.435544    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c467de2-8ed4-499b-b515-6650a4eeab03-kube-api-access-5bdkp" (OuterVolumeSpecName: "kube-api-access-5bdkp") pod "6c467de2-8ed4-499b-b515-6650a4eeab03" (UID: "6c467de2-8ed4-499b-b515-6650a4eeab03"). InnerVolumeSpecName "kube-api-access-5bdkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:19:33.534895 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.534873    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwsqs\" (UniqueName: \"kubernetes.io/projected/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-kube-api-access-cwsqs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:19:33.534895 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.534893    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd217e11-c7aa-47a3-9b2c-96b07790b1f6-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:19:33.535030 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.534902    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bdkp\" (UniqueName: \"kubernetes.io/projected/6c467de2-8ed4-499b-b515-6650a4eeab03-kube-api-access-5bdkp\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:19:33.535030 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.534911    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c467de2-8ed4-499b-b515-6650a4eeab03-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:19:33.921696 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.921584    2600 generic.go:356] "Generic (PLEG): container finished" podID="6c467de2-8ed4-499b-b515-6650a4eeab03" containerID="4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0" exitCode=0
Jul 24 16:19:33.921696 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.921661    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"
Jul 24 16:19:33.921696 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.921672    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl" event={"ID":"6c467de2-8ed4-499b-b515-6650a4eeab03","Type":"ContainerDied","Data":"4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0"}
Jul 24 16:19:33.922252 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.921758    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl" event={"ID":"6c467de2-8ed4-499b-b515-6650a4eeab03","Type":"ContainerDied","Data":"ed255a6cc19518bb102be062b29721f88f2eb7e9f47f8e86247de5948e37e870"}
Jul 24 16:19:33.922252 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.921785    2600 scope.go:117] "RemoveContainer" containerID="4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0"
Jul 24 16:19:33.923072 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.922994    2600 generic.go:356] "Generic (PLEG): container finished" podID="cd217e11-c7aa-47a3-9b2c-96b07790b1f6" containerID="e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84" exitCode=0
Jul 24 16:19:33.923072 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.923045    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852" event={"ID":"cd217e11-c7aa-47a3-9b2c-96b07790b1f6","Type":"ContainerDied","Data":"e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84"}
Jul 24 16:19:33.923072 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.923054    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"
Jul 24 16:19:33.923250 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.923098    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852" event={"ID":"cd217e11-c7aa-47a3-9b2c-96b07790b1f6","Type":"ContainerDied","Data":"8e814cfb59b7f4e7a9f1534f856b76443b0c4c2224bfc6249f4be6c255e62f01"}
Jul 24 16:19:33.924555 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.924534    2600 generic.go:356] "Generic (PLEG): container finished" podID="8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" containerID="e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5" exitCode=0
Jul 24 16:19:33.924672 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.924582    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2" event={"ID":"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26","Type":"ContainerDied","Data":"e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5"}
Jul 24 16:19:33.924672 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.924645    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2" event={"ID":"8e4335d4-55b7-4268-b8bc-0b8e9bae3a26","Type":"ContainerDied","Data":"ab08d6ece1c29ce602656763809ea01b8ad51b0836b5aa207e631af20d5e1788"}
Jul 24 16:19:33.924672 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.924666    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"
Jul 24 16:19:33.941713 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.941593    2600 scope.go:117] "RemoveContainer" containerID="4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0"
Jul 24 16:19:33.942074 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:19:33.941887    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0\": container with ID starting with 4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0 not found: ID does not exist" containerID="4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0"
Jul 24 16:19:33.942074 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.941922    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0"} err="failed to get container status \"4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0\": rpc error: code = NotFound desc = could not find container \"4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0\": container with ID starting with 4818380c811ecdc8eebe0347a9641db4c513d26adca40a09370de073b6bcbec0 not found: ID does not exist"
Jul 24 16:19:33.942074 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.941944    2600 scope.go:117] "RemoveContainer" containerID="e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84"
Jul 24 16:19:33.949581 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.949566    2600 scope.go:117] "RemoveContainer" containerID="e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84"
Jul 24 16:19:33.949831 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:19:33.949813    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84\": container with ID starting with e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84 not found: ID does not exist" containerID="e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84"
Jul 24 16:19:33.949893 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.949838    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84"} err="failed to get container status \"e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84\": rpc error: code = NotFound desc = could not find container \"e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84\": container with ID starting with e42093db970c5279fceb5821e7991986915275aa9d78ac39f0c5a74fb604ed84 not found: ID does not exist"
Jul 24 16:19:33.949893 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.949855    2600 scope.go:117] "RemoveContainer" containerID="e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5"
Jul 24 16:19:33.957411 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.957394    2600 scope.go:117] "RemoveContainer" containerID="e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5"
Jul 24 16:19:33.957656 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:19:33.957631    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5\": container with ID starting with e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5 not found: ID does not exist" containerID="e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5"
Jul 24 16:19:33.957733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.957660    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5"} err="failed to get container status \"e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5\": rpc error: code = NotFound desc = could not find container \"e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5\": container with ID starting with e028b8b3f19c8743e7e1234d88cafbefc2924a02a89348069556fb5b8fbb9ce5 not found: ID does not exist"
Jul 24 16:19:33.968849 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.968829    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"]
Jul 24 16:19:33.980131 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:33.980112    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f4ba5c28-5897ff6f48-zm852"]
Jul 24 16:19:34.026449 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:34.026424    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"]
Jul 24 16:19:34.030920 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:34.030900    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f4ba5c28-6bbf56c65d-nk4fl"]
Jul 24 16:19:34.065724 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:34.065700    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"]
Jul 24 16:19:34.077452 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:34.077430    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f4ba5c28-8b58f676f-mdmv2"]
Jul 24 16:19:34.403348 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:34.403304    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c467de2-8ed4-499b-b515-6650a4eeab03" path="/var/lib/kubelet/pods/6c467de2-8ed4-499b-b515-6650a4eeab03/volumes"
Jul 24 16:19:34.403779 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:34.403760    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" path="/var/lib/kubelet/pods/8e4335d4-55b7-4268-b8bc-0b8e9bae3a26/volumes"
Jul 24 16:19:34.404133 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:34.404115    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd217e11-c7aa-47a3-9b2c-96b07790b1f6" path="/var/lib/kubelet/pods/cd217e11-c7aa-47a3-9b2c-96b07790b1f6/volumes"
Jul 24 16:19:34.527256 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:34.527225    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:19:37.413432 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:37.413401    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"]
Jul 24 16:19:37.416026 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:37.416000    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f4ba5c28-htgf9"]
Jul 24 16:19:37.422625 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:37.422583    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:19:38.402594 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:38.402559    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="443a0ffa-9b07-4148-b1f5-a2c630f76696" path="/var/lib/kubelet/pods/443a0ffa-9b07-4148-b1f5-a2c630f76696/volumes"
Jul 24 16:19:41.020322 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:41.020285    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:19:42.039270 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:42.039237    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:19:46.047020 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:19:46.046974    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:13.705181 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:13.705087    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:23.313096 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:23.313064    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:23.736864 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:23.736830    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:26.458431 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:26.458404    2600 scope.go:117] "RemoveContainer" containerID="36cd1fdde2be6cf30d396082357614b2745b436d1e8f0db936f878e2eb6a52c4"
Jul 24 16:20:26.466256 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:26.466236    2600 scope.go:117] "RemoveContainer" containerID="01a644ef40f1acac5b9ece1b183e6aa5c7e44810760ee3c57e519e5120ffc8e0"
Jul 24 16:20:30.478766 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:30.478728    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:30.612847 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:30.612810    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:30.787081 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:30.787001    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:31.021811 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:31.021768    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:32.109848 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:32.109813    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:32.208558 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:32.208524    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:32.338112 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:32.338081    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:33.257900 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:33.257851    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:33.472574 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:33.472536    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:34.888123 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:34.888093    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:35.044441 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:35.044407    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:20:40.868822 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:40.868791    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:40.993530 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:40.993496    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:41.637009 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:41.636972    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:47.244936 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:47.244903    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:20:47.904061 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:47.904016    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:48.016323 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:48.016290    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:48.103116 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:48.103082    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:58.622846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:58.622814    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:20:58.988511 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:20:58.988475    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:19.984707 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:19.984626    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:26.496615 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:26.496584    2600 scope.go:117] "RemoveContainer" containerID="b34ce4b9d543ce333d87211db6b668b3e7f7cb19efc9e0e4444e7c5bfc5a1a97"
Jul 24 16:21:26.504650 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:26.504631    2600 scope.go:117] "RemoveContainer" containerID="75b55d471b2f838aa35c98680d80e803b5b05a49f2d5f476df89451110a24bb8"
Jul 24 16:21:26.766724 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:26.766639    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:26.867416 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:26.867385    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:27.156297 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:27.156208    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:27.525351 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:27.525323    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:27.660659 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:27.660624    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:30.631172 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.631133    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:30.718107 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718059    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"]
Jul 24 16:21:30.718417 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718402    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c467de2-8ed4-499b-b515-6650a4eeab03" containerName="payload-processing"
Jul 24 16:21:30.718487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718418    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c467de2-8ed4-499b-b515-6650a4eeab03" containerName="payload-processing"
Jul 24 16:21:30.718487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718433    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443a0ffa-9b07-4148-b1f5-a2c630f76696" containerName="revoke-keys"
Jul 24 16:21:30.718487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718439    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="443a0ffa-9b07-4148-b1f5-a2c630f76696" containerName="revoke-keys"
Jul 24 16:21:30.718487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718452    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" containerName="maas-api"
Jul 24 16:21:30.718487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718460    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" containerName="maas-api"
Jul 24 16:21:30.718487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718467    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd217e11-c7aa-47a3-9b2c-96b07790b1f6" containerName="payload-pre-processing"
Jul 24 16:21:30.718487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718473    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd217e11-c7aa-47a3-9b2c-96b07790b1f6" containerName="payload-pre-processing"
Jul 24 16:21:30.718876 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718528    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="443a0ffa-9b07-4148-b1f5-a2c630f76696" containerName="revoke-keys"
Jul 24 16:21:30.718876 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718540    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e4335d4-55b7-4268-b8bc-0b8e9bae3a26" containerName="maas-api"
Jul 24 16:21:30.718876 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718549    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd217e11-c7aa-47a3-9b2c-96b07790b1f6" containerName="payload-pre-processing"
Jul 24 16:21:30.718876 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.718555    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c467de2-8ed4-499b-b515-6650a4eeab03" containerName="payload-processing"
Jul 24 16:21:30.720696 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.720673    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:30.721274 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.721258    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:30.724158 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.724135    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w4m8q\""
Jul 24 16:21:30.724681 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.724662    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:21:30.725155 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.725137    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:21:30.725244 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.725138    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-57d2c2-serving-cert\""
Jul 24 16:21:30.734578 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.734558    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"]
Jul 24 16:21:30.813507 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.813471    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:30.813507 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.813506    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52c7226e-a514-4625-85d4-58e78bc24717-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:30.813724 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.813547    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8h5w\" (UniqueName: \"kubernetes.io/projected/52c7226e-a514-4625-85d4-58e78bc24717-kube-api-access-q8h5w\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:30.818465 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.818438    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:30.914637 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.914548    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:30.914637 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.914585    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52c7226e-a514-4625-85d4-58e78bc24717-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:30.914806 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.914660    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8h5w\" (UniqueName: \"kubernetes.io/projected/52c7226e-a514-4625-85d4-58e78bc24717-kube-api-access-q8h5w\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:30.914806 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:21:30.914706    2600 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-serving-cert: secret "maas-api-e2e-inf-a-57d2c2-serving-cert" not found
Jul 24 16:21:30.914806 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:21:30.914762    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls podName:52c7226e-a514-4625-85d4-58e78bc24717 nodeName:}" failed. No retries permitted until 2026-07-24 16:21:31.414746169 +0000 UTC m=+2165.572612849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls") pod "maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk" (UID: "52c7226e-a514-4625-85d4-58e78bc24717") : secret "maas-api-e2e-inf-a-57d2c2-serving-cert" not found
Jul 24 16:21:30.915337 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.915319    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52c7226e-a514-4625-85d4-58e78bc24717-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:30.924951 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:30.924930    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8h5w\" (UniqueName: \"kubernetes.io/projected/52c7226e-a514-4625-85d4-58e78bc24717-kube-api-access-q8h5w\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:31.061009 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.060978    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:31.414494 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.414462    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:31.418567 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.418543    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:31.421033 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.421009    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls\") pod \"maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:31.510232 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.510203    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:31.510894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.510878    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"]
Jul 24 16:21:31.513984 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.513964    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:31.517027 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.517006    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-57d2c2\""
Jul 24 16:21:31.517621 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.517590    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-57d2c2-dockercfg-s5bs4\""
Jul 24 16:21:31.530476 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.530458    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"]
Jul 24 16:21:31.567106 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.567081    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"]
Jul 24 16:21:31.569911 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.569897    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:31.590082 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.590055    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"]
Jul 24 16:21:31.624543 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.624511    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a370532-47c9-4b27-b3b2-e9ace40dd96b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8\" (UID: \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:31.624683 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.624560    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfba1e69-f264-4db7-be08-f55fcbf89814-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8\" (UID: \"dfba1e69-f264-4db7-be08-f55fcbf89814\") " pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:31.624683 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.624587    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2tff\" (UniqueName: \"kubernetes.io/projected/4a370532-47c9-4b27-b3b2-e9ace40dd96b-kube-api-access-m2tff\") pod \"payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8\" (UID: \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:31.624793 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.624707    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lwjl\" (UniqueName: \"kubernetes.io/projected/dfba1e69-f264-4db7-be08-f55fcbf89814-kube-api-access-5lwjl\") pod \"payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8\" (UID: \"dfba1e69-f264-4db7-be08-f55fcbf89814\") " pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:31.631494 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.631474    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:31.725311 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.725280    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfba1e69-f264-4db7-be08-f55fcbf89814-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8\" (UID: \"dfba1e69-f264-4db7-be08-f55fcbf89814\") " pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:31.725479 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.725318    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2tff\" (UniqueName: \"kubernetes.io/projected/4a370532-47c9-4b27-b3b2-e9ace40dd96b-kube-api-access-m2tff\") pod \"payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8\" (UID: \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:31.725479 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.725350    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lwjl\" (UniqueName: \"kubernetes.io/projected/dfba1e69-f264-4db7-be08-f55fcbf89814-kube-api-access-5lwjl\") pod \"payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8\" (UID: \"dfba1e69-f264-4db7-be08-f55fcbf89814\") " pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:31.725479 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.725426    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a370532-47c9-4b27-b3b2-e9ace40dd96b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8\" (UID: \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:31.726134 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.726114    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a370532-47c9-4b27-b3b2-e9ace40dd96b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8\" (UID: \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:31.726223 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.726187    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfba1e69-f264-4db7-be08-f55fcbf89814-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8\" (UID: \"dfba1e69-f264-4db7-be08-f55fcbf89814\") " pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:31.737873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.737843    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2tff\" (UniqueName: \"kubernetes.io/projected/4a370532-47c9-4b27-b3b2-e9ace40dd96b-kube-api-access-m2tff\") pod \"payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8\" (UID: \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:31.738798 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.738775    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lwjl\" (UniqueName: \"kubernetes.io/projected/dfba1e69-f264-4db7-be08-f55fcbf89814-kube-api-access-5lwjl\") pod \"payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8\" (UID: \"dfba1e69-f264-4db7-be08-f55fcbf89814\") " pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:31.770973 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.768363    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"]
Jul 24 16:21:31.773314 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.773294    2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:21:31.824482 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.824457    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:31.878660 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.878569    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:31.973655 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:31.973625    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"]
Jul 24 16:21:31.976234 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:21:31.976195    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfba1e69_f264_4db7_be08_f55fcbf89814.slice/crio-82d99f0bc7ad9d31a146ccc20c2642290be467e5d8ca8f47f8d8dea250f452c8 WatchSource:0}: Error finding container 82d99f0bc7ad9d31a146ccc20c2642290be467e5d8ca8f47f8d8dea250f452c8: Status 404 returned error can't find the container with id 82d99f0bc7ad9d31a146ccc20c2642290be467e5d8ca8f47f8d8dea250f452c8
Jul 24 16:21:32.024923 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.024897    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"]
Jul 24 16:21:32.036541 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:21:32.036520    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a370532_47c9_4b27_b3b2_e9ace40dd96b.slice/crio-60d2196e245231a4f2edc1e212e1e294c8c61ebc3f2ac0472e4e6c667bfbd742 WatchSource:0}: Error finding container 60d2196e245231a4f2edc1e212e1e294c8c61ebc3f2ac0472e4e6c667bfbd742: Status 404 returned error can't find the container with id 60d2196e245231a4f2edc1e212e1e294c8c61ebc3f2ac0472e4e6c667bfbd742
Jul 24 16:21:32.452760 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.452731    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8" event={"ID":"4a370532-47c9-4b27-b3b2-e9ace40dd96b","Type":"ContainerStarted","Data":"e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d"}
Jul 24 16:21:32.452953 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.452791    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8" event={"ID":"4a370532-47c9-4b27-b3b2-e9ace40dd96b","Type":"ContainerStarted","Data":"60d2196e245231a4f2edc1e212e1e294c8c61ebc3f2ac0472e4e6c667bfbd742"}
Jul 24 16:21:32.452953 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.452818    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:32.454367 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.454343    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8" event={"ID":"dfba1e69-f264-4db7-be08-f55fcbf89814","Type":"ContainerStarted","Data":"906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26"}
Jul 24 16:21:32.454477 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.454385    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8" event={"ID":"dfba1e69-f264-4db7-be08-f55fcbf89814","Type":"ContainerStarted","Data":"82d99f0bc7ad9d31a146ccc20c2642290be467e5d8ca8f47f8d8dea250f452c8"}
Jul 24 16:21:32.454477 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.454414    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:32.455834 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.455810    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk" event={"ID":"52c7226e-a514-4625-85d4-58e78bc24717","Type":"ContainerStarted","Data":"b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9"}
Jul 24 16:21:32.455991 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.455861    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk" event={"ID":"52c7226e-a514-4625-85d4-58e78bc24717","Type":"ContainerStarted","Data":"f4e814bdc0c5c99a54a4945d4e58184f7046fd6f2329aed32511d22d9558f3f1"}
Jul 24 16:21:32.455991 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.455892    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:32.472366 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.472328    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8" podStartSLOduration=1.4723135 podStartE2EDuration="1.4723135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:21:32.47083056 +0000 UTC m=+2166.628697259" watchObservedRunningTime="2026-07-24 16:21:32.4723135 +0000 UTC m=+2166.630180199"
Jul 24 16:21:32.491702 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.491657    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk" podStartSLOduration=2.009676555 podStartE2EDuration="2.491644263s" totalImagesPullingTime="481.967708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:21:32.490225129 +0000 UTC m=+2166.648091854" watchObservedRunningTime="2026-07-24 16:21:32.491644263 +0000 UTC m=+2166.649510962"
Jul 24 16:21:32.510820 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:32.510749    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8" podStartSLOduration=1.510736144 podStartE2EDuration="1.510736144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:21:32.50944659 +0000 UTC m=+2166.667313290" watchObservedRunningTime="2026-07-24 16:21:32.510736144 +0000 UTC m=+2166.668602843"
Jul 24 16:21:35.183781 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:35.183747    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:35.526813 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:35.526729    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:35.977493 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:35.977437    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:36.307023 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:36.306925    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:37.691407 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:37.691368    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:21:38.471598 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.471567    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:21:38.613624 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.613578    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:38.714777 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.714747    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"]
Jul 24 16:21:38.718228 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.718212    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:38.721926 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.721868    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-573c9b-serving-cert\""
Jul 24 16:21:38.734409 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.734386    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:38.742619 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.742565    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"]
Jul 24 16:21:38.787678 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.787650    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9871c324-df0b-4db7-93f8-20ae1b8e4980-openshift-service-ca\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:38.787827 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.787726    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:38.787827 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.787759    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cjr7\" (UniqueName: \"kubernetes.io/projected/9871c324-df0b-4db7-93f8-20ae1b8e4980-kube-api-access-5cjr7\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:38.844958 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.844926    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:38.888863 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.888830    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:38.889031 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.888886    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cjr7\" (UniqueName: \"kubernetes.io/projected/9871c324-df0b-4db7-93f8-20ae1b8e4980-kube-api-access-5cjr7\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:38.889031 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.888931    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9871c324-df0b-4db7-93f8-20ae1b8e4980-openshift-service-ca\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:38.889031 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:21:38.888989    2600 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-serving-cert: secret "maas-api-e2e-inf-b-573c9b-serving-cert" not found
Jul 24 16:21:38.889202 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:21:38.889071    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls podName:9871c324-df0b-4db7-93f8-20ae1b8e4980 nodeName:}" failed. No retries permitted until 2026-07-24 16:21:39.389050792 +0000 UTC m=+2173.546917469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls") pod "maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt" (UID: "9871c324-df0b-4db7-93f8-20ae1b8e4980") : secret "maas-api-e2e-inf-b-573c9b-serving-cert" not found
Jul 24 16:21:38.889652 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.889632    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9871c324-df0b-4db7-93f8-20ae1b8e4980-openshift-service-ca\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:38.901580 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:38.901558    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cjr7\" (UniqueName: \"kubernetes.io/projected/9871c324-df0b-4db7-93f8-20ae1b8e4980-kube-api-access-5cjr7\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:39.146387 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:39.146305    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:39.393975 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:39.393935    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:39.396542 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:39.396478    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls\") pod \"maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:39.491768 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:39.491735    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:39.590832 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:39.590804    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:39.628789 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:39.628763    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:39.768035 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:39.767952    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"]
Jul 24 16:21:39.770689 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:21:39.770665    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9871c324_df0b_4db7_93f8_20ae1b8e4980.slice/crio-d9223060b3d61e433b0ec5a879527cc0ad1227c38f52c3c0ad7a2669912c1fac WatchSource:0}: Error finding container d9223060b3d61e433b0ec5a879527cc0ad1227c38f52c3c0ad7a2669912c1fac: Status 404 returned error can't find the container with id d9223060b3d61e433b0ec5a879527cc0ad1227c38f52c3c0ad7a2669912c1fac
Jul 24 16:21:40.495373 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:40.495336    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt" event={"ID":"9871c324-df0b-4db7-93f8-20ae1b8e4980","Type":"ContainerStarted","Data":"c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0"}
Jul 24 16:21:40.495561 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:40.495391    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt" event={"ID":"9871c324-df0b-4db7-93f8-20ae1b8e4980","Type":"ContainerStarted","Data":"d9223060b3d61e433b0ec5a879527cc0ad1227c38f52c3c0ad7a2669912c1fac"}
Jul 24 16:21:40.495561 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:40.495419    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:40.520362 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:40.520289    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt" podStartSLOduration=2.135579554 podStartE2EDuration="2.520273634s" totalImagesPullingTime="384.69408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:21:40.518993859 +0000 UTC m=+2174.676860559" watchObservedRunningTime="2026-07-24 16:21:40.520273634 +0000 UTC m=+2174.678140334"
Jul 24 16:21:43.121442 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:43.121410    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:21:43.463452 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:43.463422    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:21:43.463651 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:43.463499    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:21:46.506099 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:46.506068    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:21:48.982948 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:48.982917    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:21:59.100391 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:21:59.100357    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:22:02.484234 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:22:02.484203    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:22:16.196104 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:22:16.196070    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:22:26.524217 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:22:26.524180    2600 scope.go:117] "RemoveContainer" containerID="d10827bde1ff8f01580e5bfc186835b0741cd99c880b8430088c3103124d50c8"
Jul 24 16:22:42.319504 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:22:42.319433    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:22:46.194814 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:22:46.194778    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:23:00.986785 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:00.986710    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:23:33.853013 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:33.852973    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:34.932817 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:34.932781    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:35.009298 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.009265    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"]
Jul 24 16:23:35.012672 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.012652    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"
Jul 24 16:23:35.015143 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.015118    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:23:35.019940 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.019920    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"]
Jul 24 16:23:35.086834 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.086804    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb7338f-aac1-41dc-bdaa-2c110293fa36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km\" (UID: \"ffb7338f-aac1-41dc-bdaa-2c110293fa36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"
Jul 24 16:23:35.188220 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.188146    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb7338f-aac1-41dc-bdaa-2c110293fa36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km\" (UID: \"ffb7338f-aac1-41dc-bdaa-2c110293fa36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"
Jul 24 16:23:35.188788 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.188770    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb7338f-aac1-41dc-bdaa-2c110293fa36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km\" (UID: \"ffb7338f-aac1-41dc-bdaa-2c110293fa36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"
Jul 24 16:23:35.323600 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.323570    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"
Jul 24 16:23:35.462369 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:35.462344    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"]
Jul 24 16:23:35.464467 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:23:35.464444    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb7338f_aac1_41dc_bdaa_2c110293fa36.slice/crio-11aa8f0b47a1a537ebd5c29dbefaa3edd1cca689f1f0c8f1569e6d43dccf32df WatchSource:0}: Error finding container 11aa8f0b47a1a537ebd5c29dbefaa3edd1cca689f1f0c8f1569e6d43dccf32df: Status 404 returned error can't find the container with id 11aa8f0b47a1a537ebd5c29dbefaa3edd1cca689f1f0c8f1569e6d43dccf32df
Jul 24 16:23:36.035925 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:36.035891    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km" event={"ID":"ffb7338f-aac1-41dc-bdaa-2c110293fa36","Type":"ContainerStarted","Data":"90067c5cc58eddc7e76fa21939f33eb0f96db16087c7a96e980b8c5af49ac8f5"}
Jul 24 16:23:36.036290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:36.035944    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km" event={"ID":"ffb7338f-aac1-41dc-bdaa-2c110293fa36","Type":"ContainerStarted","Data":"11aa8f0b47a1a537ebd5c29dbefaa3edd1cca689f1f0c8f1569e6d43dccf32df"}
Jul 24 16:23:36.055176 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:36.055120    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km" podStartSLOduration=2.055105028 podStartE2EDuration="2.055105028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:23:36.052880089 +0000 UTC m=+2290.210746787" watchObservedRunningTime="2026-07-24 16:23:36.055105028 +0000 UTC m=+2290.212971726"
Jul 24 16:23:36.996078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:36.996043    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:23:37.042166 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:37.042132    2600 generic.go:356] "Generic (PLEG): container finished" podID="ffb7338f-aac1-41dc-bdaa-2c110293fa36" containerID="90067c5cc58eddc7e76fa21939f33eb0f96db16087c7a96e980b8c5af49ac8f5" exitCode=0
Jul 24 16:23:37.042527 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:37.042181    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km" event={"ID":"ffb7338f-aac1-41dc-bdaa-2c110293fa36","Type":"ContainerDied","Data":"90067c5cc58eddc7e76fa21939f33eb0f96db16087c7a96e980b8c5af49ac8f5"}
Jul 24 16:23:38.183300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:38.183273    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"
Jul 24 16:23:38.315487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:38.315416    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb7338f-aac1-41dc-bdaa-2c110293fa36-maas-api-service-ca\") pod \"ffb7338f-aac1-41dc-bdaa-2c110293fa36\" (UID: \"ffb7338f-aac1-41dc-bdaa-2c110293fa36\") "
Jul 24 16:23:38.315785 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:38.315755    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb7338f-aac1-41dc-bdaa-2c110293fa36-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ffb7338f-aac1-41dc-bdaa-2c110293fa36" (UID: "ffb7338f-aac1-41dc-bdaa-2c110293fa36"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:23:38.416842 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:38.416821    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb7338f-aac1-41dc-bdaa-2c110293fa36-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:23:39.052434 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:39.052408    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"
Jul 24 16:23:39.052434 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:39.052428    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km" event={"ID":"ffb7338f-aac1-41dc-bdaa-2c110293fa36","Type":"ContainerDied","Data":"11aa8f0b47a1a537ebd5c29dbefaa3edd1cca689f1f0c8f1569e6d43dccf32df"}
Jul 24 16:23:39.052706 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:39.052469    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11aa8f0b47a1a537ebd5c29dbefaa3edd1cca689f1f0c8f1569e6d43dccf32df"
Jul 24 16:23:45.437110 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.437073    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"]
Jul 24 16:23:45.437593 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.437294    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk" podUID="52c7226e-a514-4625-85d4-58e78bc24717" containerName="maas-api" containerID="cri-o://b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9" gracePeriod=30
Jul 24 16:23:45.476364 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.476335    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:45.506329 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.506299    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"]
Jul 24 16:23:45.506636 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.506592    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8" podUID="dfba1e69-f264-4db7-be08-f55fcbf89814" containerName="payload-processing" containerID="cri-o://906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26" gracePeriod=30
Jul 24 16:23:45.513715 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.513687    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"]
Jul 24 16:23:45.514316 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.513969    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8" podUID="4a370532-47c9-4b27-b3b2-e9ace40dd96b" containerName="payload-pre-processing" containerID="cri-o://e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d" gracePeriod=30
Jul 24 16:23:45.568666 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.568626    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:45.655175 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.655140    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:45.802775 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.802744    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:23:45.804736 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.804716    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:23:45.879951 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.879929    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfba1e69-f264-4db7-be08-f55fcbf89814-plugins-config-volume\") pod \"dfba1e69-f264-4db7-be08-f55fcbf89814\" (UID: \"dfba1e69-f264-4db7-be08-f55fcbf89814\") "
Jul 24 16:23:45.880066 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.880046    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lwjl\" (UniqueName: \"kubernetes.io/projected/dfba1e69-f264-4db7-be08-f55fcbf89814-kube-api-access-5lwjl\") pod \"dfba1e69-f264-4db7-be08-f55fcbf89814\" (UID: \"dfba1e69-f264-4db7-be08-f55fcbf89814\") "
Jul 24 16:23:45.880343 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.880311    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfba1e69-f264-4db7-be08-f55fcbf89814-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfba1e69-f264-4db7-be08-f55fcbf89814" (UID: "dfba1e69-f264-4db7-be08-f55fcbf89814"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:23:45.882372 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.882348    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfba1e69-f264-4db7-be08-f55fcbf89814-kube-api-access-5lwjl" (OuterVolumeSpecName: "kube-api-access-5lwjl") pod "dfba1e69-f264-4db7-be08-f55fcbf89814" (UID: "dfba1e69-f264-4db7-be08-f55fcbf89814"). InnerVolumeSpecName "kube-api-access-5lwjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:23:45.889408 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.889385    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:23:45.981057 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.980967    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls\") pod \"52c7226e-a514-4625-85d4-58e78bc24717\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") "
Jul 24 16:23:45.981237 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.981057    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8h5w\" (UniqueName: \"kubernetes.io/projected/52c7226e-a514-4625-85d4-58e78bc24717-kube-api-access-q8h5w\") pod \"52c7226e-a514-4625-85d4-58e78bc24717\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") "
Jul 24 16:23:45.981237 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.981087    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52c7226e-a514-4625-85d4-58e78bc24717-openshift-service-ca\") pod \"52c7226e-a514-4625-85d4-58e78bc24717\" (UID: \"52c7226e-a514-4625-85d4-58e78bc24717\") "
Jul 24 16:23:45.981237 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.981102    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a370532-47c9-4b27-b3b2-e9ace40dd96b-plugins-config-volume\") pod \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\" (UID: \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\") "
Jul 24 16:23:45.981237 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.981128    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2tff\" (UniqueName: \"kubernetes.io/projected/4a370532-47c9-4b27-b3b2-e9ace40dd96b-kube-api-access-m2tff\") pod \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\" (UID: \"4a370532-47c9-4b27-b3b2-e9ace40dd96b\") "
Jul 24 16:23:45.981441 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.981331    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lwjl\" (UniqueName: \"kubernetes.io/projected/dfba1e69-f264-4db7-be08-f55fcbf89814-kube-api-access-5lwjl\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:23:45.981441 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.981343    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfba1e69-f264-4db7-be08-f55fcbf89814-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:23:45.981549 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.981445    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52c7226e-a514-4625-85d4-58e78bc24717-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "52c7226e-a514-4625-85d4-58e78bc24717" (UID: "52c7226e-a514-4625-85d4-58e78bc24717"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:23:45.981549 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.981511    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a370532-47c9-4b27-b3b2-e9ace40dd96b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4a370532-47c9-4b27-b3b2-e9ace40dd96b" (UID: "4a370532-47c9-4b27-b3b2-e9ace40dd96b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:23:45.983301 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.983276    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "52c7226e-a514-4625-85d4-58e78bc24717" (UID: "52c7226e-a514-4625-85d4-58e78bc24717"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:23:45.983301 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.983290    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a370532-47c9-4b27-b3b2-e9ace40dd96b-kube-api-access-m2tff" (OuterVolumeSpecName: "kube-api-access-m2tff") pod "4a370532-47c9-4b27-b3b2-e9ace40dd96b" (UID: "4a370532-47c9-4b27-b3b2-e9ace40dd96b"). InnerVolumeSpecName "kube-api-access-m2tff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:23:45.983448 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:45.983297    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c7226e-a514-4625-85d4-58e78bc24717-kube-api-access-q8h5w" (OuterVolumeSpecName: "kube-api-access-q8h5w") pod "52c7226e-a514-4625-85d4-58e78bc24717" (UID: "52c7226e-a514-4625-85d4-58e78bc24717"). InnerVolumeSpecName "kube-api-access-q8h5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:23:46.082457 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.082432    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52c7226e-a514-4625-85d4-58e78bc24717-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:23:46.082457 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.082456    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8h5w\" (UniqueName: \"kubernetes.io/projected/52c7226e-a514-4625-85d4-58e78bc24717-kube-api-access-q8h5w\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:23:46.082644 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.082466    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52c7226e-a514-4625-85d4-58e78bc24717-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:23:46.082644 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.082476    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a370532-47c9-4b27-b3b2-e9ace40dd96b-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:23:46.082644 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.082484    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2tff\" (UniqueName: \"kubernetes.io/projected/4a370532-47c9-4b27-b3b2-e9ace40dd96b-kube-api-access-m2tff\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:23:46.084397 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.084375    2600 generic.go:356] "Generic (PLEG): container finished" podID="dfba1e69-f264-4db7-be08-f55fcbf89814" containerID="906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26" exitCode=0
Jul 24 16:23:46.084440 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.084423    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"
Jul 24 16:23:46.084481 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.084449    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8" event={"ID":"dfba1e69-f264-4db7-be08-f55fcbf89814","Type":"ContainerDied","Data":"906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26"}
Jul 24 16:23:46.084553 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.084526    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8" event={"ID":"dfba1e69-f264-4db7-be08-f55fcbf89814","Type":"ContainerDied","Data":"82d99f0bc7ad9d31a146ccc20c2642290be467e5d8ca8f47f8d8dea250f452c8"}
Jul 24 16:23:46.084625 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.084566    2600 scope.go:117] "RemoveContainer" containerID="906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26"
Jul 24 16:23:46.085891 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.085865    2600 generic.go:356] "Generic (PLEG): container finished" podID="52c7226e-a514-4625-85d4-58e78bc24717" containerID="b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9" exitCode=0
Jul 24 16:23:46.086012 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.085916    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"
Jul 24 16:23:46.086012 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.085952    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk" event={"ID":"52c7226e-a514-4625-85d4-58e78bc24717","Type":"ContainerDied","Data":"b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9"}
Jul 24 16:23:46.086012 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.085994    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk" event={"ID":"52c7226e-a514-4625-85d4-58e78bc24717","Type":"ContainerDied","Data":"f4e814bdc0c5c99a54a4945d4e58184f7046fd6f2329aed32511d22d9558f3f1"}
Jul 24 16:23:46.087343 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.087321    2600 generic.go:356] "Generic (PLEG): container finished" podID="4a370532-47c9-4b27-b3b2-e9ace40dd96b" containerID="e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d" exitCode=0
Jul 24 16:23:46.087435 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.087357    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"
Jul 24 16:23:46.087435 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.087356    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8" event={"ID":"4a370532-47c9-4b27-b3b2-e9ace40dd96b","Type":"ContainerDied","Data":"e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d"}
Jul 24 16:23:46.087526 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.087468    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8" event={"ID":"4a370532-47c9-4b27-b3b2-e9ace40dd96b","Type":"ContainerDied","Data":"60d2196e245231a4f2edc1e212e1e294c8c61ebc3f2ac0472e4e6c667bfbd742"}
Jul 24 16:23:46.095007 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.094987    2600 scope.go:117] "RemoveContainer" containerID="906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26"
Jul 24 16:23:46.095284 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:23:46.095264    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26\": container with ID starting with 906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26 not found: ID does not exist" containerID="906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26"
Jul 24 16:23:46.095344 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.095292    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26"} err="failed to get container status \"906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26\": rpc error: code = NotFound desc = could not find container \"906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26\": container with ID starting with 906c54453b4414f32369f5196dcca0af217a8c091c4e258acf6a7b5f1f537d26 not found: ID does not exist"
Jul 24 16:23:46.095344 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.095308    2600 scope.go:117] "RemoveContainer" containerID="b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9"
Jul 24 16:23:46.103093 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.103049    2600 scope.go:117] "RemoveContainer" containerID="b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9"
Jul 24 16:23:46.103285 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:23:46.103270    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9\": container with ID starting with b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9 not found: ID does not exist" containerID="b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9"
Jul 24 16:23:46.103331 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.103289    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9"} err="failed to get container status \"b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9\": rpc error: code = NotFound desc = could not find container \"b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9\": container with ID starting with b813f78e335fc3bbeb6064aee5e4fc990c4b7b8a2ddf2c4a421b132f0358b9d9 not found: ID does not exist"
Jul 24 16:23:46.103331 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.103302    2600 scope.go:117] "RemoveContainer" containerID="e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d"
Jul 24 16:23:46.110317 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.110301    2600 scope.go:117] "RemoveContainer" containerID="e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d"
Jul 24 16:23:46.110560 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:23:46.110543    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d\": container with ID starting with e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d not found: ID does not exist" containerID="e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d"
Jul 24 16:23:46.110633 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.110565    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d"} err="failed to get container status \"e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d\": rpc error: code = NotFound desc = could not find container \"e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d\": container with ID starting with e023785d4447ba4fc3fb6650b82eabab671aff4da6623ecad706821580a6e90d not found: ID does not exist"
Jul 24 16:23:46.114077 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.114058    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"]
Jul 24 16:23:46.119343 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.119321    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57d2c2-8575c67d7-7mdtk"]
Jul 24 16:23:46.130726 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.130703    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"]
Jul 24 16:23:46.135409 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.135389    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-57d2c2-5b4c56dcd8-ppfg8"]
Jul 24 16:23:46.147422 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.147401    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"]
Jul 24 16:23:46.151467 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.151448    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-57d2c2-7c9b589dc6-nv2q8"]
Jul 24 16:23:46.402856 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.402762    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a370532-47c9-4b27-b3b2-e9ace40dd96b" path="/var/lib/kubelet/pods/4a370532-47c9-4b27-b3b2-e9ace40dd96b/volumes"
Jul 24 16:23:46.403237 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.403218    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52c7226e-a514-4625-85d4-58e78bc24717" path="/var/lib/kubelet/pods/52c7226e-a514-4625-85d4-58e78bc24717/volumes"
Jul 24 16:23:46.403599 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:46.403580    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfba1e69-f264-4db7-be08-f55fcbf89814" path="/var/lib/kubelet/pods/dfba1e69-f264-4db7-be08-f55fcbf89814/volumes"
Jul 24 16:23:50.091704 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:50.091676    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:23:50.094815 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:50.094787    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:50.108733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:50.108705    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"]
Jul 24 16:23:50.112665 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:50.112638    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57d2c2-6m5km"]
Jul 24 16:23:50.403148 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:50.403069    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffb7338f-aac1-41dc-bdaa-2c110293fa36" path="/var/lib/kubelet/pods/ffb7338f-aac1-41dc-bdaa-2c110293fa36/volumes"
Jul 24 16:23:50.547316 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:50.547266    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:56.610639 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:56.610587    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:56.682358 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:56.682319    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:56.895336 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:56.895255    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:57.161162 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.161071    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:57.277357 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277323    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"]
Jul 24 16:23:57.277770 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277753    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c7226e-a514-4625-85d4-58e78bc24717" containerName="maas-api"
Jul 24 16:23:57.277873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277772    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c7226e-a514-4625-85d4-58e78bc24717" containerName="maas-api"
Jul 24 16:23:57.277873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277787    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfba1e69-f264-4db7-be08-f55fcbf89814" containerName="payload-processing"
Jul 24 16:23:57.277873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277795    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfba1e69-f264-4db7-be08-f55fcbf89814" containerName="payload-processing"
Jul 24 16:23:57.277873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277818    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb7338f-aac1-41dc-bdaa-2c110293fa36" containerName="revoke-keys"
Jul 24 16:23:57.277873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277826    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb7338f-aac1-41dc-bdaa-2c110293fa36" containerName="revoke-keys"
Jul 24 16:23:57.277873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277836    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a370532-47c9-4b27-b3b2-e9ace40dd96b" containerName="payload-pre-processing"
Jul 24 16:23:57.277873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277844    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a370532-47c9-4b27-b3b2-e9ace40dd96b" containerName="payload-pre-processing"
Jul 24 16:23:57.278256 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277919    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfba1e69-f264-4db7-be08-f55fcbf89814" containerName="payload-processing"
Jul 24 16:23:57.278256 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277931    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffb7338f-aac1-41dc-bdaa-2c110293fa36" containerName="revoke-keys"
Jul 24 16:23:57.278256 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277945    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a370532-47c9-4b27-b3b2-e9ace40dd96b" containerName="payload-pre-processing"
Jul 24 16:23:57.278256 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.277955    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c7226e-a514-4625-85d4-58e78bc24717" containerName="maas-api"
Jul 24 16:23:57.281270 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.281253    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"
Jul 24 16:23:57.284156 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.284138    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:23:57.288787 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.288767    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"]
Jul 24 16:23:57.377908 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.377874    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b159bd-8def-467f-acd0-cef87fc96eb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn\" (UID: \"60b159bd-8def-467f-acd0-cef87fc96eb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"
Jul 24 16:23:57.478684 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.478642    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b159bd-8def-467f-acd0-cef87fc96eb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn\" (UID: \"60b159bd-8def-467f-acd0-cef87fc96eb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"
Jul 24 16:23:57.479276 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.479255    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b159bd-8def-467f-acd0-cef87fc96eb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn\" (UID: \"60b159bd-8def-467f-acd0-cef87fc96eb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"
Jul 24 16:23:57.592754 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.592721    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"
Jul 24 16:23:57.721586 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:57.721533    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"]
Jul 24 16:23:57.723954 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:23:57.723926    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b159bd_8def_467f_acd0_cef87fc96eb6.slice/crio-eea753c3b7c43453df7f46b1833aa69cb2b38373b998aa5bd0ccc0cf698e479b WatchSource:0}: Error finding container eea753c3b7c43453df7f46b1833aa69cb2b38373b998aa5bd0ccc0cf698e479b: Status 404 returned error can't find the container with id eea753c3b7c43453df7f46b1833aa69cb2b38373b998aa5bd0ccc0cf698e479b
Jul 24 16:23:58.150775 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:58.150677    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn" event={"ID":"60b159bd-8def-467f-acd0-cef87fc96eb6","Type":"ContainerStarted","Data":"67a64fd423aa0901f3b63e089046cd30f3fab1b110045172822d7ae302165488"}
Jul 24 16:23:58.150775 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:58.150748    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn" event={"ID":"60b159bd-8def-467f-acd0-cef87fc96eb6","Type":"ContainerStarted","Data":"eea753c3b7c43453df7f46b1833aa69cb2b38373b998aa5bd0ccc0cf698e479b"}
Jul 24 16:23:58.168917 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:58.168861    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn" podStartSLOduration=1.168843894 podStartE2EDuration="1.168843894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:23:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:23:58.166436855 +0000 UTC m=+2312.324303557" watchObservedRunningTime="2026-07-24 16:23:58.168843894 +0000 UTC m=+2312.326710592"
Jul 24 16:23:58.887669 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:58.887638    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:58.992105 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:58.992073    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:23:59.156312 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:59.156223    2600 generic.go:356] "Generic (PLEG): container finished" podID="60b159bd-8def-467f-acd0-cef87fc96eb6" containerID="67a64fd423aa0901f3b63e089046cd30f3fab1b110045172822d7ae302165488" exitCode=0
Jul 24 16:23:59.156312 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:23:59.156279    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn" event={"ID":"60b159bd-8def-467f-acd0-cef87fc96eb6","Type":"ContainerDied","Data":"67a64fd423aa0901f3b63e089046cd30f3fab1b110045172822d7ae302165488"}
Jul 24 16:24:00.292051 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:00.292030    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"
Jul 24 16:24:00.300438 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:00.300420    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b159bd-8def-467f-acd0-cef87fc96eb6-maas-api-service-ca\") pod \"60b159bd-8def-467f-acd0-cef87fc96eb6\" (UID: \"60b159bd-8def-467f-acd0-cef87fc96eb6\") "
Jul 24 16:24:00.300764 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:00.300743    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60b159bd-8def-467f-acd0-cef87fc96eb6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60b159bd-8def-467f-acd0-cef87fc96eb6" (UID: "60b159bd-8def-467f-acd0-cef87fc96eb6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:24:00.401078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:00.401041    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b159bd-8def-467f-acd0-cef87fc96eb6-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:01.166550 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:01.166517    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn" event={"ID":"60b159bd-8def-467f-acd0-cef87fc96eb6","Type":"ContainerDied","Data":"eea753c3b7c43453df7f46b1833aa69cb2b38373b998aa5bd0ccc0cf698e479b"}
Jul 24 16:24:01.166550 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:01.166540    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"
Jul 24 16:24:01.166779 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:01.166563    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eea753c3b7c43453df7f46b1833aa69cb2b38373b998aa5bd0ccc0cf698e479b"
Jul 24 16:24:07.946157 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:07.946122    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"]
Jul 24 16:24:07.946548 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:07.946315    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt" podUID="9871c324-df0b-4db7-93f8-20ae1b8e4980" containerName="maas-api" containerID="cri-o://c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0" gracePeriod=30
Jul 24 16:24:07.973017 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:07.972986    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:08.045676 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.045639    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:08.147349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.147317    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:08.188992 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.188971    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:24:08.201204 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.201144    2600 generic.go:356] "Generic (PLEG): container finished" podID="9871c324-df0b-4db7-93f8-20ae1b8e4980" containerID="c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0" exitCode=0
Jul 24 16:24:08.201204 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.201183    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"
Jul 24 16:24:08.201342 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.201231    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt" event={"ID":"9871c324-df0b-4db7-93f8-20ae1b8e4980","Type":"ContainerDied","Data":"c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0"}
Jul 24 16:24:08.201342 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.201283    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt" event={"ID":"9871c324-df0b-4db7-93f8-20ae1b8e4980","Type":"ContainerDied","Data":"d9223060b3d61e433b0ec5a879527cc0ad1227c38f52c3c0ad7a2669912c1fac"}
Jul 24 16:24:08.201342 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.201309    2600 scope.go:117] "RemoveContainer" containerID="c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0"
Jul 24 16:24:08.209667 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.209647    2600 scope.go:117] "RemoveContainer" containerID="c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0"
Jul 24 16:24:08.209946 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:24:08.209918    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0\": container with ID starting with c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0 not found: ID does not exist" containerID="c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0"
Jul 24 16:24:08.210079 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.209957    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0"} err="failed to get container status \"c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0\": rpc error: code = NotFound desc = could not find container \"c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0\": container with ID starting with c976fbafe2259113aa18dc609d3f44fb5862bfa17a96da9cea318450a9042da0 not found: ID does not exist"
Jul 24 16:24:08.262749 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.262723    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9871c324-df0b-4db7-93f8-20ae1b8e4980-openshift-service-ca\") pod \"9871c324-df0b-4db7-93f8-20ae1b8e4980\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") "
Jul 24 16:24:08.262749 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.262752    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls\") pod \"9871c324-df0b-4db7-93f8-20ae1b8e4980\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") "
Jul 24 16:24:08.262947 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.262769    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cjr7\" (UniqueName: \"kubernetes.io/projected/9871c324-df0b-4db7-93f8-20ae1b8e4980-kube-api-access-5cjr7\") pod \"9871c324-df0b-4db7-93f8-20ae1b8e4980\" (UID: \"9871c324-df0b-4db7-93f8-20ae1b8e4980\") "
Jul 24 16:24:08.263124 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.263100    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9871c324-df0b-4db7-93f8-20ae1b8e4980-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9871c324-df0b-4db7-93f8-20ae1b8e4980" (UID: "9871c324-df0b-4db7-93f8-20ae1b8e4980"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:24:08.265007 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.264987    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9871c324-df0b-4db7-93f8-20ae1b8e4980" (UID: "9871c324-df0b-4db7-93f8-20ae1b8e4980"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:24:08.265078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.265034    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9871c324-df0b-4db7-93f8-20ae1b8e4980-kube-api-access-5cjr7" (OuterVolumeSpecName: "kube-api-access-5cjr7") pod "9871c324-df0b-4db7-93f8-20ae1b8e4980" (UID: "9871c324-df0b-4db7-93f8-20ae1b8e4980"). InnerVolumeSpecName "kube-api-access-5cjr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:24:08.364113 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.364086    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9871c324-df0b-4db7-93f8-20ae1b8e4980-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:08.364113 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.364110    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9871c324-df0b-4db7-93f8-20ae1b8e4980-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:08.364277 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.364120    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cjr7\" (UniqueName: \"kubernetes.io/projected/9871c324-df0b-4db7-93f8-20ae1b8e4980-kube-api-access-5cjr7\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:08.518136 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.518058    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"]
Jul 24 16:24:08.524018 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.523994    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-573c9b-68cdc74db6-2h4wt"]
Jul 24 16:24:08.785756 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:08.785667    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:10.402732 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:10.402695    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9871c324-df0b-4db7-93f8-20ae1b8e4980" path="/var/lib/kubelet/pods/9871c324-df0b-4db7-93f8-20ae1b8e4980/volumes"
Jul 24 16:24:10.891306 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:10.891274    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:24:12.449499 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:12.449464    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:12.450144 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:12.450118    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"]
Jul 24 16:24:12.451825 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:12.451804    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-573c9b-z7nfn"]
Jul 24 16:24:12.892246 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:12.892159    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:14.402352 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:14.402323    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60b159bd-8def-467f-acd0-cef87fc96eb6" path="/var/lib/kubelet/pods/60b159bd-8def-467f-acd0-cef87fc96eb6/volumes"
Jul 24 16:24:18.814999 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:18.814905    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:18.918646 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:18.918589    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:19.120391 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:19.120287    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:19.334832 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:19.334800    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:19.709812 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:19.709780    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:20.055817 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:20.055731    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:20.243767 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:20.243704    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:23.440877 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.440840    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:23.534659 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.534626    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:23.542238 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.542214    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"]
Jul 24 16:24:23.542544 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.542532    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9871c324-df0b-4db7-93f8-20ae1b8e4980" containerName="maas-api"
Jul 24 16:24:23.542591 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.542546    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="9871c324-df0b-4db7-93f8-20ae1b8e4980" containerName="maas-api"
Jul 24 16:24:23.542591 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.542560    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b159bd-8def-467f-acd0-cef87fc96eb6" containerName="revoke-keys"
Jul 24 16:24:23.542591 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.542566    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b159bd-8def-467f-acd0-cef87fc96eb6" containerName="revoke-keys"
Jul 24 16:24:23.542713 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.542644    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="60b159bd-8def-467f-acd0-cef87fc96eb6" containerName="revoke-keys"
Jul 24 16:24:23.542713 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.542651    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="9871c324-df0b-4db7-93f8-20ae1b8e4980" containerName="maas-api"
Jul 24 16:24:23.546671 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.546656    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.549755 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.549736    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-876108-serving-cert\""
Jul 24 16:24:23.549913 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.549898    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:24:23.550776 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.550761    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w4m8q\""
Jul 24 16:24:23.550819 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.550777    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:24:23.571734 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.571709    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"]
Jul 24 16:24:23.584069 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.584043    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzhzd\" (UniqueName: \"kubernetes.io/projected/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-kube-api-access-dzhzd\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.584179 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.584109    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-openshift-service-ca\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.584179 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.584164    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-maas-api-tls\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.640577 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.640543    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:23.685578 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.685556    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzhzd\" (UniqueName: \"kubernetes.io/projected/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-kube-api-access-dzhzd\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.685690 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.685597    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-openshift-service-ca\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.685750 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.685723    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-maas-api-tls\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.686291 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.686273    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-openshift-service-ca\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.688272 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.688250    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-maas-api-tls\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.694208 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.694178    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzhzd\" (UniqueName: \"kubernetes.io/projected/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-kube-api-access-dzhzd\") pod \"maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.730340 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.730307    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:23.856112 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.856073    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:23.989678 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:23.989655    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"]
Jul 24 16:24:23.992106 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:24:23.992079    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d71efa_b1be_4c15_a3c9_1fcd6fd16139.slice/crio-6856961b62b275855b0466755d192fe8152b336dd0850521303c088257f5a02d WatchSource:0}: Error finding container 6856961b62b275855b0466755d192fe8152b336dd0850521303c088257f5a02d: Status 404 returned error can't find the container with id 6856961b62b275855b0466755d192fe8152b336dd0850521303c088257f5a02d
Jul 24 16:24:24.158152 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.158117    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:24.247575 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.247493    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:24.272205 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.272172    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj" event={"ID":"56d71efa-b1be-4c15-a3c9-1fcd6fd16139","Type":"ContainerStarted","Data":"6856961b62b275855b0466755d192fe8152b336dd0850521303c088257f5a02d"}
Jul 24 16:24:24.294870 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.294837    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"]
Jul 24 16:24:24.299220 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.299201    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:24.301721 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.301699    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-876108\""
Jul 24 16:24:24.301808 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.301706    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-876108-dockercfg-v5ll4\""
Jul 24 16:24:24.309148 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.309124    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"]
Jul 24 16:24:24.337373 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.337338    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"]
Jul 24 16:24:24.340384 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.340368    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:24.351318 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.351297    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"]
Jul 24 16:24:24.391304 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.391265    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8\" (UID: \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:24.391455 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.391338    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dxc\" (UniqueName: \"kubernetes.io/projected/103de7c1-71e3-4f45-81b2-7565942f6559-kube-api-access-46dxc\") pod \"payload-processing-e2e-api-a-876108-68fc46467b-h7p6z\" (UID: \"103de7c1-71e3-4f45-81b2-7565942f6559\") " pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:24.391455 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.391428    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmdtp\" (UniqueName: \"kubernetes.io/projected/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-kube-api-access-rmdtp\") pod \"payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8\" (UID: \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:24.391568 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.391462    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/103de7c1-71e3-4f45-81b2-7565942f6559-plugins-config-volume\") pod \"payload-processing-e2e-api-a-876108-68fc46467b-h7p6z\" (UID: \"103de7c1-71e3-4f45-81b2-7565942f6559\") " pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:24.492311 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.492285    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dxc\" (UniqueName: \"kubernetes.io/projected/103de7c1-71e3-4f45-81b2-7565942f6559-kube-api-access-46dxc\") pod \"payload-processing-e2e-api-a-876108-68fc46467b-h7p6z\" (UID: \"103de7c1-71e3-4f45-81b2-7565942f6559\") " pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:24.492719 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.492343    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmdtp\" (UniqueName: \"kubernetes.io/projected/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-kube-api-access-rmdtp\") pod \"payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8\" (UID: \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:24.492719 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.492366    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/103de7c1-71e3-4f45-81b2-7565942f6559-plugins-config-volume\") pod \"payload-processing-e2e-api-a-876108-68fc46467b-h7p6z\" (UID: \"103de7c1-71e3-4f45-81b2-7565942f6559\") " pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:24.492719 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.492406    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8\" (UID: \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:24.493107 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.493087    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/103de7c1-71e3-4f45-81b2-7565942f6559-plugins-config-volume\") pod \"payload-processing-e2e-api-a-876108-68fc46467b-h7p6z\" (UID: \"103de7c1-71e3-4f45-81b2-7565942f6559\") " pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:24.493107 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.493103    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8\" (UID: \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:24.502561 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.502515    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dxc\" (UniqueName: \"kubernetes.io/projected/103de7c1-71e3-4f45-81b2-7565942f6559-kube-api-access-46dxc\") pod \"payload-processing-e2e-api-a-876108-68fc46467b-h7p6z\" (UID: \"103de7c1-71e3-4f45-81b2-7565942f6559\") " pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:24.502666 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.502633    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmdtp\" (UniqueName: \"kubernetes.io/projected/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-kube-api-access-rmdtp\") pod \"payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8\" (UID: \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:24.610055 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.610018    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:24.649856 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.649820    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:24.755631 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.755473    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"]
Jul 24 16:24:24.758816 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:24:24.758772    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod103de7c1_71e3_4f45_81b2_7565942f6559.slice/crio-8a8fe26f97968c77d8977de58f15ec02f7cafedb2744f4c8f41d08be6be09bcc WatchSource:0}: Error finding container 8a8fe26f97968c77d8977de58f15ec02f7cafedb2744f4c8f41d08be6be09bcc: Status 404 returned error can't find the container with id 8a8fe26f97968c77d8977de58f15ec02f7cafedb2744f4c8f41d08be6be09bcc
Jul 24 16:24:24.795083 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:24.794974    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"]
Jul 24 16:24:24.797290 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:24:24.797266    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f63d4a_54ba_4184_bbaf_3bbbee19bce7.slice/crio-ba598d5f40bbe4abe074df38f35c669ca367d02fb6dc9990b09baf0a86322ace WatchSource:0}: Error finding container ba598d5f40bbe4abe074df38f35c669ca367d02fb6dc9990b09baf0a86322ace: Status 404 returned error can't find the container with id ba598d5f40bbe4abe074df38f35c669ca367d02fb6dc9990b09baf0a86322ace
Jul 24 16:24:25.279269 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.279230    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj" event={"ID":"56d71efa-b1be-4c15-a3c9-1fcd6fd16139","Type":"ContainerStarted","Data":"39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9"}
Jul 24 16:24:25.279444 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.279382    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:25.280856 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.280833    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z" event={"ID":"103de7c1-71e3-4f45-81b2-7565942f6559","Type":"ContainerStarted","Data":"a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b"}
Jul 24 16:24:25.280969 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.280877    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z" event={"ID":"103de7c1-71e3-4f45-81b2-7565942f6559","Type":"ContainerStarted","Data":"8a8fe26f97968c77d8977de58f15ec02f7cafedb2744f4c8f41d08be6be09bcc"}
Jul 24 16:24:25.280969 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.280904    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:25.282316 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.282297    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8" event={"ID":"85f63d4a-54ba-4184-bbaf-3bbbee19bce7","Type":"ContainerStarted","Data":"586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91"}
Jul 24 16:24:25.282440 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.282331    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8" event={"ID":"85f63d4a-54ba-4184-bbaf-3bbbee19bce7","Type":"ContainerStarted","Data":"ba598d5f40bbe4abe074df38f35c669ca367d02fb6dc9990b09baf0a86322ace"}
Jul 24 16:24:25.282440 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.282353    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:25.302354 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.302314    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj" podStartSLOduration=1.8914555 podStartE2EDuration="2.302302762s" totalImagesPullingTime="410.847262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:24:25.297932469 +0000 UTC m=+2339.455799168" watchObservedRunningTime="2026-07-24 16:24:25.302302762 +0000 UTC m=+2339.460169458"
Jul 24 16:24:25.316153 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.316113    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z" podStartSLOduration=1.3160995770000001 podStartE2EDuration="1.316099577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:24:25.31499781 +0000 UTC m=+2339.472864513" watchObservedRunningTime="2026-07-24 16:24:25.316099577 +0000 UTC m=+2339.473966278"
Jul 24 16:24:25.334108 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:25.334066    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8" podStartSLOduration=1.334050071 podStartE2EDuration="1.334050071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:24:25.33233933 +0000 UTC m=+2339.490206035" watchObservedRunningTime="2026-07-24 16:24:25.334050071 +0000 UTC m=+2339.491916750"
Jul 24 16:24:26.549667 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:26.549641    2600 scope.go:117] "RemoveContainer" containerID="a58c06ea7eee1141612b22fa8567949915bace79650de7fe92e55d686e29142b"
Jul 24 16:24:27.919545 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:27.919508    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:28.426595 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:28.426550    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:28.750424 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:28.750348    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:28.971917 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:28.971871    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:31.293314 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.293282    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:31.394712 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.394679    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:31.494489 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.494442    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:31.594076 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.593977    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:24:31.607876 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.607845    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"]
Jul 24 16:24:31.611316 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.611294    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:31.613945 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.613925    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-966c3e-serving-cert\""
Jul 24 16:24:31.622005 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.621978    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"]
Jul 24 16:24:31.648963 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.648936    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:31.659204 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.659175    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:31.659315 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.659251    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcvjf\" (UniqueName: \"kubernetes.io/projected/ae64f707-2fa1-401a-824b-a39461c37737-kube-api-access-qcvjf\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:31.659315 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.659275    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae64f707-2fa1-401a-824b-a39461c37737-openshift-service-ca\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:31.760066 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.760030    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:31.760249 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.760078    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvjf\" (UniqueName: \"kubernetes.io/projected/ae64f707-2fa1-401a-824b-a39461c37737-kube-api-access-qcvjf\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:31.760249 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.760105    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae64f707-2fa1-401a-824b-a39461c37737-openshift-service-ca\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:31.760249 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:24:31.760201    2600 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-serving-cert: secret "maas-api-e2e-api-b-966c3e-serving-cert" not found
Jul 24 16:24:31.760358 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:24:31.760272    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls podName:ae64f707-2fa1-401a-824b-a39461c37737 nodeName:}" failed. No retries permitted until 2026-07-24 16:24:32.260251678 +0000 UTC m=+2346.418118356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls") pod "maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj" (UID: "ae64f707-2fa1-401a-824b-a39461c37737") : secret "maas-api-e2e-api-b-966c3e-serving-cert" not found
Jul 24 16:24:31.760720 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.760703    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae64f707-2fa1-401a-824b-a39461c37737-openshift-service-ca\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:31.769507 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:31.769486    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcvjf\" (UniqueName: \"kubernetes.io/projected/ae64f707-2fa1-401a-824b-a39461c37737-kube-api-access-qcvjf\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:32.264162 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:32.264126    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:32.264348 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:24:32.264244    2600 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-serving-cert: secret "maas-api-e2e-api-b-966c3e-serving-cert" not found
Jul 24 16:24:32.264348 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:24:32.264300    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls podName:ae64f707-2fa1-401a-824b-a39461c37737 nodeName:}" failed. No retries permitted until 2026-07-24 16:24:33.264284644 +0000 UTC m=+2347.422151321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls") pod "maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj" (UID: "ae64f707-2fa1-401a-824b-a39461c37737") : secret "maas-api-e2e-api-b-966c3e-serving-cert" not found
Jul 24 16:24:32.413347 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:32.413314    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:32.570779 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:32.570684    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:32.685678 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:32.685649    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:33.273350 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:33.273305    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:33.275955 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:33.275922    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls\") pod \"maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:33.425567 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:33.425527    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:33.565480 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:33.565438    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"]
Jul 24 16:24:33.567996 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:24:33.567969    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae64f707_2fa1_401a_824b_a39461c37737.slice/crio-9e9c94cdb5cb11f8c2bb0105a35959e5e4824e1bb8a5ca6d0b6fc60f94774875 WatchSource:0}: Error finding container 9e9c94cdb5cb11f8c2bb0105a35959e5e4824e1bb8a5ca6d0b6fc60f94774875: Status 404 returned error can't find the container with id 9e9c94cdb5cb11f8c2bb0105a35959e5e4824e1bb8a5ca6d0b6fc60f94774875
Jul 24 16:24:34.324783 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:34.324739    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj" event={"ID":"ae64f707-2fa1-401a-824b-a39461c37737","Type":"ContainerStarted","Data":"cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d"}
Jul 24 16:24:34.324991 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:34.324803    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj" event={"ID":"ae64f707-2fa1-401a-824b-a39461c37737","Type":"ContainerStarted","Data":"9e9c94cdb5cb11f8c2bb0105a35959e5e4824e1bb8a5ca6d0b6fc60f94774875"}
Jul 24 16:24:34.324991 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:34.324834    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:34.347753 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:34.347703    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj" podStartSLOduration=2.997812625 podStartE2EDuration="3.347687572s" totalImagesPullingTime="349.874947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:24:34.345750993 +0000 UTC m=+2348.503617704" watchObservedRunningTime="2026-07-24 16:24:34.347687572 +0000 UTC m=+2348.505554271"
Jul 24 16:24:35.931561 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:35.931528    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:36.289246 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:36.289155    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:36.289414 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:36.289382    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:40.334111 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:40.334085    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:24:44.281473 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.281442    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"]
Jul 24 16:24:44.285122 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.285106    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"
Jul 24 16:24:44.288106 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.288085    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:24:44.294672 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.294645    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"]
Jul 24 16:24:44.370858 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.370826    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/479b0379-d7e8-49f0-be93-e783e6b49c90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-876108-sdjdz\" (UID: \"479b0379-d7e8-49f0-be93-e783e6b49c90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"
Jul 24 16:24:44.472310 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.472273    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/479b0379-d7e8-49f0-be93-e783e6b49c90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-876108-sdjdz\" (UID: \"479b0379-d7e8-49f0-be93-e783e6b49c90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"
Jul 24 16:24:44.472913 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.472894    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/479b0379-d7e8-49f0-be93-e783e6b49c90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-876108-sdjdz\" (UID: \"479b0379-d7e8-49f0-be93-e783e6b49c90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"
Jul 24 16:24:44.494129 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.494101    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:24:44.595806 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.595737    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"
Jul 24 16:24:44.727853 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:44.727786    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"]
Jul 24 16:24:44.730194 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:24:44.730161    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479b0379_d7e8_49f0_be93_e783e6b49c90.slice/crio-ccb304613513068c1d88087b5c017e92ef6698972b7dd906c34b01cb756c8c9d WatchSource:0}: Error finding container ccb304613513068c1d88087b5c017e92ef6698972b7dd906c34b01cb756c8c9d: Status 404 returned error can't find the container with id ccb304613513068c1d88087b5c017e92ef6698972b7dd906c34b01cb756c8c9d
Jul 24 16:24:45.382621 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:45.382561    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz" event={"ID":"479b0379-d7e8-49f0-be93-e783e6b49c90","Type":"ContainerStarted","Data":"5e52e718327d43db309874230e1b4b81078fac2df2ab851806d4493422329793"}
Jul 24 16:24:45.382992 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:45.382673    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz" event={"ID":"479b0379-d7e8-49f0-be93-e783e6b49c90","Type":"ContainerStarted","Data":"ccb304613513068c1d88087b5c017e92ef6698972b7dd906c34b01cb756c8c9d"}
Jul 24 16:24:45.400289 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:45.400232    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz" podStartSLOduration=1.400219863 podStartE2EDuration="1.400219863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:24:45.39850508 +0000 UTC m=+2359.556371802" watchObservedRunningTime="2026-07-24 16:24:45.400219863 +0000 UTC m=+2359.558086562"
Jul 24 16:24:46.390760 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:46.390676    2600 generic.go:356] "Generic (PLEG): container finished" podID="479b0379-d7e8-49f0-be93-e783e6b49c90" containerID="5e52e718327d43db309874230e1b4b81078fac2df2ab851806d4493422329793" exitCode=0
Jul 24 16:24:46.390760 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:46.390725    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz" event={"ID":"479b0379-d7e8-49f0-be93-e783e6b49c90","Type":"ContainerDied","Data":"5e52e718327d43db309874230e1b4b81078fac2df2ab851806d4493422329793"}
Jul 24 16:24:47.530349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:47.530322    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"
Jul 24 16:24:47.699100 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:47.699075    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/479b0379-d7e8-49f0-be93-e783e6b49c90-maas-api-service-ca\") pod \"479b0379-d7e8-49f0-be93-e783e6b49c90\" (UID: \"479b0379-d7e8-49f0-be93-e783e6b49c90\") "
Jul 24 16:24:47.699416 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:47.699392    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/479b0379-d7e8-49f0-be93-e783e6b49c90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "479b0379-d7e8-49f0-be93-e783e6b49c90" (UID: "479b0379-d7e8-49f0-be93-e783e6b49c90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:24:47.799595 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:47.799563    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/479b0379-d7e8-49f0-be93-e783e6b49c90-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:48.401729 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:48.401697    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"
Jul 24 16:24:48.403528 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:48.403492    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz" event={"ID":"479b0379-d7e8-49f0-be93-e783e6b49c90","Type":"ContainerDied","Data":"ccb304613513068c1d88087b5c017e92ef6698972b7dd906c34b01cb756c8c9d"}
Jul 24 16:24:48.403703 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:48.403547    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccb304613513068c1d88087b5c017e92ef6698972b7dd906c34b01cb756c8c9d"
Jul 24 16:24:53.533854 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:53.533813    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:59.437395 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.437358    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"]
Jul 24 16:24:59.438056 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.437620    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj" podUID="56d71efa-b1be-4c15-a3c9-1fcd6fd16139" containerName="maas-api" containerID="cri-o://39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9" gracePeriod=30
Jul 24 16:24:59.477930 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.477899    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:59.506814 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.506792    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"]
Jul 24 16:24:59.507043 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.507016    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z" podUID="103de7c1-71e3-4f45-81b2-7565942f6559" containerName="payload-processing" containerID="cri-o://a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b" gracePeriod=30
Jul 24 16:24:59.514222 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.514196    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"]
Jul 24 16:24:59.514579 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.514466    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8" podUID="85f63d4a-54ba-4184-bbaf-3bbbee19bce7" containerName="payload-pre-processing" containerID="cri-o://586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91" gracePeriod=30
Jul 24 16:24:59.564067 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.564035    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:59.643841 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.643746    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:24:59.787525 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.787505    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:24:59.790652 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.790599    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:24:59.802480 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.802462    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzhzd\" (UniqueName: \"kubernetes.io/projected/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-kube-api-access-dzhzd\") pod \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") "
Jul 24 16:24:59.802574 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.802494    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/103de7c1-71e3-4f45-81b2-7565942f6559-plugins-config-volume\") pod \"103de7c1-71e3-4f45-81b2-7565942f6559\" (UID: \"103de7c1-71e3-4f45-81b2-7565942f6559\") "
Jul 24 16:24:59.802574 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.802551    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-openshift-service-ca\") pod \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") "
Jul 24 16:24:59.802705 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.802580    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46dxc\" (UniqueName: \"kubernetes.io/projected/103de7c1-71e3-4f45-81b2-7565942f6559-kube-api-access-46dxc\") pod \"103de7c1-71e3-4f45-81b2-7565942f6559\" (UID: \"103de7c1-71e3-4f45-81b2-7565942f6559\") "
Jul 24 16:24:59.802705 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.802628    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-maas-api-tls\") pod \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\" (UID: \"56d71efa-b1be-4c15-a3c9-1fcd6fd16139\") "
Jul 24 16:24:59.802982 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.802957    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56d71efa-b1be-4c15-a3c9-1fcd6fd16139" (UID: "56d71efa-b1be-4c15-a3c9-1fcd6fd16139"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:24:59.802982 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.802971    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103de7c1-71e3-4f45-81b2-7565942f6559-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "103de7c1-71e3-4f45-81b2-7565942f6559" (UID: "103de7c1-71e3-4f45-81b2-7565942f6559"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:24:59.805348 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.805308    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56d71efa-b1be-4c15-a3c9-1fcd6fd16139" (UID: "56d71efa-b1be-4c15-a3c9-1fcd6fd16139"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:24:59.805476 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.805351    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-kube-api-access-dzhzd" (OuterVolumeSpecName: "kube-api-access-dzhzd") pod "56d71efa-b1be-4c15-a3c9-1fcd6fd16139" (UID: "56d71efa-b1be-4c15-a3c9-1fcd6fd16139"). InnerVolumeSpecName "kube-api-access-dzhzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:24:59.805983 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.805957    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/103de7c1-71e3-4f45-81b2-7565942f6559-kube-api-access-46dxc" (OuterVolumeSpecName: "kube-api-access-46dxc") pod "103de7c1-71e3-4f45-81b2-7565942f6559" (UID: "103de7c1-71e3-4f45-81b2-7565942f6559"). InnerVolumeSpecName "kube-api-access-46dxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:24:59.819286 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.819268    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:24:59.903137 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.903108    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-plugins-config-volume\") pod \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\" (UID: \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\") "
Jul 24 16:24:59.903305 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.903154    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmdtp\" (UniqueName: \"kubernetes.io/projected/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-kube-api-access-rmdtp\") pod \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\" (UID: \"85f63d4a-54ba-4184-bbaf-3bbbee19bce7\") "
Jul 24 16:24:59.903355 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.903337    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzhzd\" (UniqueName: \"kubernetes.io/projected/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-kube-api-access-dzhzd\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:59.903391 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.903354    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/103de7c1-71e3-4f45-81b2-7565942f6559-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:59.903391 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.903369    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:59.903391 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.903385    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46dxc\" (UniqueName: \"kubernetes.io/projected/103de7c1-71e3-4f45-81b2-7565942f6559-kube-api-access-46dxc\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:59.903484 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.903398    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d71efa-b1be-4c15-a3c9-1fcd6fd16139-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:24:59.903517 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.903481    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85f63d4a-54ba-4184-bbaf-3bbbee19bce7" (UID: "85f63d4a-54ba-4184-bbaf-3bbbee19bce7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:24:59.905356 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:24:59.905332    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-kube-api-access-rmdtp" (OuterVolumeSpecName: "kube-api-access-rmdtp") pod "85f63d4a-54ba-4184-bbaf-3bbbee19bce7" (UID: "85f63d4a-54ba-4184-bbaf-3bbbee19bce7"). InnerVolumeSpecName "kube-api-access-rmdtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:25:00.004500 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.004422    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmdtp\" (UniqueName: \"kubernetes.io/projected/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-kube-api-access-rmdtp\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:25:00.004500 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.004445    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f63d4a-54ba-4184-bbaf-3bbbee19bce7-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:25:00.453127 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.453093    2600 generic.go:356] "Generic (PLEG): container finished" podID="56d71efa-b1be-4c15-a3c9-1fcd6fd16139" containerID="39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9" exitCode=0
Jul 24 16:25:00.453504 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.453152    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"
Jul 24 16:25:00.453504 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.453230    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj" event={"ID":"56d71efa-b1be-4c15-a3c9-1fcd6fd16139","Type":"ContainerDied","Data":"39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9"}
Jul 24 16:25:00.453504 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.453282    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj" event={"ID":"56d71efa-b1be-4c15-a3c9-1fcd6fd16139","Type":"ContainerDied","Data":"6856961b62b275855b0466755d192fe8152b336dd0850521303c088257f5a02d"}
Jul 24 16:25:00.453504 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.453316    2600 scope.go:117] "RemoveContainer" containerID="39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9"
Jul 24 16:25:00.455438 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.455414    2600 generic.go:356] "Generic (PLEG): container finished" podID="103de7c1-71e3-4f45-81b2-7565942f6559" containerID="a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b" exitCode=0
Jul 24 16:25:00.455644 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.455488    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"
Jul 24 16:25:00.455644 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.455518    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z" event={"ID":"103de7c1-71e3-4f45-81b2-7565942f6559","Type":"ContainerDied","Data":"a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b"}
Jul 24 16:25:00.455644 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.455551    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z" event={"ID":"103de7c1-71e3-4f45-81b2-7565942f6559","Type":"ContainerDied","Data":"8a8fe26f97968c77d8977de58f15ec02f7cafedb2744f4c8f41d08be6be09bcc"}
Jul 24 16:25:00.457120 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.457098    2600 generic.go:356] "Generic (PLEG): container finished" podID="85f63d4a-54ba-4184-bbaf-3bbbee19bce7" containerID="586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91" exitCode=0
Jul 24 16:25:00.457235 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.457142    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"
Jul 24 16:25:00.457235 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.457172    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8" event={"ID":"85f63d4a-54ba-4184-bbaf-3bbbee19bce7","Type":"ContainerDied","Data":"586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91"}
Jul 24 16:25:00.457235 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.457202    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8" event={"ID":"85f63d4a-54ba-4184-bbaf-3bbbee19bce7","Type":"ContainerDied","Data":"ba598d5f40bbe4abe074df38f35c669ca367d02fb6dc9990b09baf0a86322ace"}
Jul 24 16:25:00.465826 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.465810    2600 scope.go:117] "RemoveContainer" containerID="39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9"
Jul 24 16:25:00.466109 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:25:00.466083    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9\": container with ID starting with 39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9 not found: ID does not exist" containerID="39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9"
Jul 24 16:25:00.466224 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.466110    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9"} err="failed to get container status \"39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9\": rpc error: code = NotFound desc = could not find container \"39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9\": container with ID starting with 39e8ad30896a376bf1c6fc9909e6ce78d742614f0c2524ab3e47d4ab3a3e28b9 not found: ID does not exist"
Jul 24 16:25:00.466224 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.466129    2600 scope.go:117] "RemoveContainer" containerID="a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b"
Jul 24 16:25:00.473763 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.473747    2600 scope.go:117] "RemoveContainer" containerID="a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b"
Jul 24 16:25:00.474014 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:25:00.473997    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b\": container with ID starting with a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b not found: ID does not exist" containerID="a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b"
Jul 24 16:25:00.474068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.474022    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b"} err="failed to get container status \"a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b\": rpc error: code = NotFound desc = could not find container \"a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b\": container with ID starting with a6167f56d5477af84b58f7317fa45f8aeddc4eb2ecee5304936e7e4303cfba7b not found: ID does not exist"
Jul 24 16:25:00.474068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.474045    2600 scope.go:117] "RemoveContainer" containerID="586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91"
Jul 24 16:25:00.478450 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.478430    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"]
Jul 24 16:25:00.481556 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.481538    2600 scope.go:117] "RemoveContainer" containerID="586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91"
Jul 24 16:25:00.481861 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:25:00.481836    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91\": container with ID starting with 586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91 not found: ID does not exist" containerID="586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91"
Jul 24 16:25:00.481950 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.481874    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91"} err="failed to get container status \"586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91\": rpc error: code = NotFound desc = could not find container \"586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91\": container with ID starting with 586b3ddb9ed3d3c94330533cf038a6bdf286213327f686dc223f5836233a6f91 not found: ID does not exist"
Jul 24 16:25:00.484017 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.483998    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-876108-ccb47dfb5-w6rlj"]
Jul 24 16:25:00.493894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.493875    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"]
Jul 24 16:25:00.499523 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.499503    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-876108-68fc46467b-h7p6z"]
Jul 24 16:25:00.510827 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.510802    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"]
Jul 24 16:25:00.512583 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:00.512564    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-876108-5775b64fb8-zjbc8"]
Jul 24 16:25:01.684307 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:01.684271    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:25:02.402679 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:02.402650    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="103de7c1-71e3-4f45-81b2-7565942f6559" path="/var/lib/kubelet/pods/103de7c1-71e3-4f45-81b2-7565942f6559/volumes"
Jul 24 16:25:02.403046 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:02.403033    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d71efa-b1be-4c15-a3c9-1fcd6fd16139" path="/var/lib/kubelet/pods/56d71efa-b1be-4c15-a3c9-1fcd6fd16139/volumes"
Jul 24 16:25:02.403336 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:02.403325    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85f63d4a-54ba-4184-bbaf-3bbbee19bce7" path="/var/lib/kubelet/pods/85f63d4a-54ba-4184-bbaf-3bbbee19bce7/volumes"
Jul 24 16:25:04.409990 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:04.409953    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:04.432015 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:04.431990    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"]
Jul 24 16:25:04.437524 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:04.437502    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-876108-sdjdz"]
Jul 24 16:25:04.835261 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:04.835233    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:06.402536 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:06.402502    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="479b0379-d7e8-49f0-be93-e783e6b49c90" path="/var/lib/kubelet/pods/479b0379-d7e8-49f0-be93-e783e6b49c90/volumes"
Jul 24 16:25:11.189951 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.189917    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:11.288557 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.288515    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:11.513937 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.513841    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:11.737505 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.737466    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:11.868054 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.867989    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"]
Jul 24 16:25:11.868304 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868292    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d71efa-b1be-4c15-a3c9-1fcd6fd16139" containerName="maas-api"
Jul 24 16:25:11.868349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868305    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d71efa-b1be-4c15-a3c9-1fcd6fd16139" containerName="maas-api"
Jul 24 16:25:11.868349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868317    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479b0379-d7e8-49f0-be93-e783e6b49c90" containerName="revoke-keys"
Jul 24 16:25:11.868349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868323    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="479b0379-d7e8-49f0-be93-e783e6b49c90" containerName="revoke-keys"
Jul 24 16:25:11.868349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868329    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f63d4a-54ba-4184-bbaf-3bbbee19bce7" containerName="payload-pre-processing"
Jul 24 16:25:11.868349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868334    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f63d4a-54ba-4184-bbaf-3bbbee19bce7" containerName="payload-pre-processing"
Jul 24 16:25:11.868349 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868346    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103de7c1-71e3-4f45-81b2-7565942f6559" containerName="payload-processing"
Jul 24 16:25:11.868534 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868351    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="103de7c1-71e3-4f45-81b2-7565942f6559" containerName="payload-processing"
Jul 24 16:25:11.868534 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868410    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="85f63d4a-54ba-4184-bbaf-3bbbee19bce7" containerName="payload-pre-processing"
Jul 24 16:25:11.868534 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868416    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="479b0379-d7e8-49f0-be93-e783e6b49c90" containerName="revoke-keys"
Jul 24 16:25:11.868534 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868423    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="103de7c1-71e3-4f45-81b2-7565942f6559" containerName="payload-processing"
Jul 24 16:25:11.868534 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.868429    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d71efa-b1be-4c15-a3c9-1fcd6fd16139" containerName="maas-api"
Jul 24 16:25:11.872698 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.872684    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"
Jul 24 16:25:11.876939 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.876913    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:25:11.883964 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:11.883942    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"]
Jul 24 16:25:12.004959 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:12.004932    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1350f2-3a69-4e98-8f94-6703fe087e48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj\" (UID: \"0a1350f2-3a69-4e98-8f94-6703fe087e48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"
Jul 24 16:25:12.105216 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:12.105182    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1350f2-3a69-4e98-8f94-6703fe087e48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj\" (UID: \"0a1350f2-3a69-4e98-8f94-6703fe087e48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"
Jul 24 16:25:12.105805 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:12.105789    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1350f2-3a69-4e98-8f94-6703fe087e48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj\" (UID: \"0a1350f2-3a69-4e98-8f94-6703fe087e48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"
Jul 24 16:25:12.182988 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:12.182968    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"
Jul 24 16:25:12.312855 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:12.312830    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"]
Jul 24 16:25:12.315029 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:25:12.315000    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1350f2_3a69_4e98_8f94_6703fe087e48.slice/crio-0a29415c1add2eb8f665910009fe5b30079c4fc944466e67b187bda97625cb6b WatchSource:0}: Error finding container 0a29415c1add2eb8f665910009fe5b30079c4fc944466e67b187bda97625cb6b: Status 404 returned error can't find the container with id 0a29415c1add2eb8f665910009fe5b30079c4fc944466e67b187bda97625cb6b
Jul 24 16:25:12.516252 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:12.516182    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj" event={"ID":"0a1350f2-3a69-4e98-8f94-6703fe087e48","Type":"ContainerStarted","Data":"0a29415c1add2eb8f665910009fe5b30079c4fc944466e67b187bda97625cb6b"}
Jul 24 16:25:13.521833 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:13.521792    2600 generic.go:356] "Generic (PLEG): container finished" podID="0a1350f2-3a69-4e98-8f94-6703fe087e48" containerID="f78a1c824765a94c2e10a8efbdce5dea60511d636e14b5cbcf46fc6ab3600e68" exitCode=0
Jul 24 16:25:13.521833 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:13.521827    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj" event={"ID":"0a1350f2-3a69-4e98-8f94-6703fe087e48","Type":"ContainerDied","Data":"f78a1c824765a94c2e10a8efbdce5dea60511d636e14b5cbcf46fc6ab3600e68"}
Jul 24 16:25:14.654263 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:14.654237    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"
Jul 24 16:25:14.726894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:14.726870    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1350f2-3a69-4e98-8f94-6703fe087e48-maas-api-service-ca\") pod \"0a1350f2-3a69-4e98-8f94-6703fe087e48\" (UID: \"0a1350f2-3a69-4e98-8f94-6703fe087e48\") "
Jul 24 16:25:14.727210 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:14.727187    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a1350f2-3a69-4e98-8f94-6703fe087e48-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0a1350f2-3a69-4e98-8f94-6703fe087e48" (UID: "0a1350f2-3a69-4e98-8f94-6703fe087e48"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:25:14.828214 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:14.828149    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1350f2-3a69-4e98-8f94-6703fe087e48-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:25:15.532364 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:15.532327    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj" event={"ID":"0a1350f2-3a69-4e98-8f94-6703fe087e48","Type":"ContainerDied","Data":"0a29415c1add2eb8f665910009fe5b30079c4fc944466e67b187bda97625cb6b"}
Jul 24 16:25:15.532364 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:15.532347    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"
Jul 24 16:25:15.532634 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:15.532381    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a29415c1add2eb8f665910009fe5b30079c4fc944466e67b187bda97625cb6b"
Jul 24 16:25:26.584234 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:26.584207    2600 scope.go:117] "RemoveContainer" containerID="2f7d471763460c3ef1485f4e200c6f2282a8526d8e1548831e8aa566dc3eb794"
Jul 24 16:25:27.480806 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.480773    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"]
Jul 24 16:25:27.481015 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.480994    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj" podUID="ae64f707-2fa1-401a-824b-a39461c37737" containerName="maas-api" containerID="cri-o://cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d" gracePeriod=30
Jul 24 16:25:27.517565 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.517540    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:27.636821 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.636792    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:27.751010 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.750971    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:27.753452 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.753433    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:25:27.824927 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.824901    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae64f707-2fa1-401a-824b-a39461c37737-openshift-service-ca\") pod \"ae64f707-2fa1-401a-824b-a39461c37737\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") "
Jul 24 16:25:27.825092 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.824953    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcvjf\" (UniqueName: \"kubernetes.io/projected/ae64f707-2fa1-401a-824b-a39461c37737-kube-api-access-qcvjf\") pod \"ae64f707-2fa1-401a-824b-a39461c37737\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") "
Jul 24 16:25:27.825092 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.824981    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls\") pod \"ae64f707-2fa1-401a-824b-a39461c37737\" (UID: \"ae64f707-2fa1-401a-824b-a39461c37737\") "
Jul 24 16:25:27.825317 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.825291    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae64f707-2fa1-401a-824b-a39461c37737-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae64f707-2fa1-401a-824b-a39461c37737" (UID: "ae64f707-2fa1-401a-824b-a39461c37737"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:25:27.827198 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.827177    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae64f707-2fa1-401a-824b-a39461c37737" (UID: "ae64f707-2fa1-401a-824b-a39461c37737"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:25:27.827269 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.827225    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae64f707-2fa1-401a-824b-a39461c37737-kube-api-access-qcvjf" (OuterVolumeSpecName: "kube-api-access-qcvjf") pod "ae64f707-2fa1-401a-824b-a39461c37737" (UID: "ae64f707-2fa1-401a-824b-a39461c37737"). InnerVolumeSpecName "kube-api-access-qcvjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:25:27.926303 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.926274    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae64f707-2fa1-401a-824b-a39461c37737-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:25:27.926303 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.926298    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcvjf\" (UniqueName: \"kubernetes.io/projected/ae64f707-2fa1-401a-824b-a39461c37737-kube-api-access-qcvjf\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:25:27.926468 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:27.926326    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae64f707-2fa1-401a-824b-a39461c37737-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:25:28.592165 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.592135    2600 generic.go:356] "Generic (PLEG): container finished" podID="ae64f707-2fa1-401a-824b-a39461c37737" containerID="cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d" exitCode=0
Jul 24 16:25:28.592339 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.592181    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"
Jul 24 16:25:28.592339 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.592223    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj" event={"ID":"ae64f707-2fa1-401a-824b-a39461c37737","Type":"ContainerDied","Data":"cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d"}
Jul 24 16:25:28.592339 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.592279    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj" event={"ID":"ae64f707-2fa1-401a-824b-a39461c37737","Type":"ContainerDied","Data":"9e9c94cdb5cb11f8c2bb0105a35959e5e4824e1bb8a5ca6d0b6fc60f94774875"}
Jul 24 16:25:28.592339 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.592308    2600 scope.go:117] "RemoveContainer" containerID="cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d"
Jul 24 16:25:28.601287 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.601137    2600 scope.go:117] "RemoveContainer" containerID="cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d"
Jul 24 16:25:28.601446 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:25:28.601427    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d\": container with ID starting with cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d not found: ID does not exist" containerID="cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d"
Jul 24 16:25:28.601486 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.601455    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d"} err="failed to get container status \"cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d\": rpc error: code = NotFound desc = could not find container \"cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d\": container with ID starting with cebcf6d8fd110b70eacf7a22356ed265ec3719d097b60ef21b5b6a396409bd7d not found: ID does not exist"
Jul 24 16:25:28.610092 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.610071    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"]
Jul 24 16:25:28.613689 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:28.613669    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-966c3e-6cfdcf66b-q6jnj"]
Jul 24 16:25:30.403524 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:30.403486    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae64f707-2fa1-401a-824b-a39461c37737" path="/var/lib/kubelet/pods/ae64f707-2fa1-401a-824b-a39461c37737/volumes"
Jul 24 16:25:32.007264 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:32.007223    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"]
Jul 24 16:25:32.010244 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:32.010220    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-966c3e-9v2fj"]
Jul 24 16:25:32.012012 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:32.011984    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:32.403424 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:32.403349    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a1350f2-3a69-4e98-8f94-6703fe087e48" path="/var/lib/kubelet/pods/0a1350f2-3a69-4e98-8f94-6703fe087e48/volumes"
Jul 24 16:25:32.450580 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:32.450553    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:32.597976 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:32.597941    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:25:38.502151 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:38.502111    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:38.573212 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:38.573183    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:38.803389 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:38.803308    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:38.992084 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:38.992048    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:39.346148 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:39.346114    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:39.702827 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:39.702792    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:39.792810 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:39.792781    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:42.861708 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.861664    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:42.953490 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.953459    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"]
Jul 24 16:25:42.953788 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.953773    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae64f707-2fa1-401a-824b-a39461c37737" containerName="maas-api"
Jul 24 16:25:42.953845 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.953790    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae64f707-2fa1-401a-824b-a39461c37737" containerName="maas-api"
Jul 24 16:25:42.953845 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.953801    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1350f2-3a69-4e98-8f94-6703fe087e48" containerName="revoke-keys"
Jul 24 16:25:42.953845 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.953806    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1350f2-3a69-4e98-8f94-6703fe087e48" containerName="revoke-keys"
Jul 24 16:25:42.953943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.953880    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a1350f2-3a69-4e98-8f94-6703fe087e48" containerName="revoke-keys"
Jul 24 16:25:42.953943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.953890    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae64f707-2fa1-401a-824b-a39461c37737" containerName="maas-api"
Jul 24 16:25:42.957018 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.957003    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:42.960811 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.960767    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:25:42.960950 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.960835    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w4m8q\""
Jul 24 16:25:42.960950 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.960863    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-764b09-serving-cert\""
Jul 24 16:25:42.961755 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.961741    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 16:25:42.972959 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.972938    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"]
Jul 24 16:25:42.974666 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:42.974642    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:43.050971 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.050949    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.051104 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.051018    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr8tb\" (UniqueName: \"kubernetes.io/projected/1727dc08-95a6-4a3e-9406-b1e84ab9d242-kube-api-access-xr8tb\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.051104 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.051081    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1727dc08-95a6-4a3e-9406-b1e84ab9d242-openshift-service-ca\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.109636 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.109582    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:43.151676 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.151595    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8tb\" (UniqueName: \"kubernetes.io/projected/1727dc08-95a6-4a3e-9406-b1e84ab9d242-kube-api-access-xr8tb\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.151676 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.151659    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1727dc08-95a6-4a3e-9406-b1e84ab9d242-openshift-service-ca\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.151820 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.151707    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.151863 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:25:43.151851    2600 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-serving-cert: secret "maas-api-e2e-shared-a-764b09-serving-cert" not found
Jul 24 16:25:43.151941 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:25:43.151929    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls podName:1727dc08-95a6-4a3e-9406-b1e84ab9d242 nodeName:}" failed. No retries permitted until 2026-07-24 16:25:43.651900867 +0000 UTC m=+2417.809767546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls") pod "maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j" (UID: "1727dc08-95a6-4a3e-9406-b1e84ab9d242") : secret "maas-api-e2e-shared-a-764b09-serving-cert" not found
Jul 24 16:25:43.152242 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.152225    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1727dc08-95a6-4a3e-9406-b1e84ab9d242-openshift-service-ca\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.168911 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.168885    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr8tb\" (UniqueName: \"kubernetes.io/projected/1727dc08-95a6-4a3e-9406-b1e84ab9d242-kube-api-access-xr8tb\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.577137 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.577099    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:43.655812 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.655777    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.658343 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.658323    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls\") pod \"maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.821951 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.821923    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:43.866629 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.866544    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:43.965081 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.965050    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:43.997419 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:43.997387    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"]
Jul 24 16:25:44.001871 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.001852    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.009563 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.009540    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-764b09\""
Jul 24 16:25:44.009709 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.009689    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-764b09-dockercfg-b249l\""
Jul 24 16:25:44.037934 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:25:44.037899    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1727dc08_95a6_4a3e_9406_b1e84ab9d242.slice/crio-1acbe63aab7415152c312e348ac894f46407b793fd02dda7a77b23f609ea3107 WatchSource:0}: Error finding container 1acbe63aab7415152c312e348ac894f46407b793fd02dda7a77b23f609ea3107: Status 404 returned error can't find the container with id 1acbe63aab7415152c312e348ac894f46407b793fd02dda7a77b23f609ea3107
Jul 24 16:25:44.039528 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.039508    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"]
Jul 24 16:25:44.041468 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.041445    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"]
Jul 24 16:25:44.108886 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.108863    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"]
Jul 24 16:25:44.112205 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.112175    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.132548 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.132520    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"]
Jul 24 16:25:44.160173 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.160145    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29add0e-0856-45ef-9a96-33ae4c3b6991-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf\" (UID: \"b29add0e-0856-45ef-9a96-33ae4c3b6991\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.160295 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.160212    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4mgd\" (UniqueName: \"kubernetes.io/projected/b29add0e-0856-45ef-9a96-33ae4c3b6991-kube-api-access-m4mgd\") pod \"payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf\" (UID: \"b29add0e-0856-45ef-9a96-33ae4c3b6991\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.260597 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.260571    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29add0e-0856-45ef-9a96-33ae4c3b6991-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf\" (UID: \"b29add0e-0856-45ef-9a96-33ae4c3b6991\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.260742 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.260639    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f450370f-6f6f-42fc-9771-aa91a34510fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l\" (UID: \"f450370f-6f6f-42fc-9771-aa91a34510fa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.260742 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.260670    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4mgd\" (UniqueName: \"kubernetes.io/projected/b29add0e-0856-45ef-9a96-33ae4c3b6991-kube-api-access-m4mgd\") pod \"payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf\" (UID: \"b29add0e-0856-45ef-9a96-33ae4c3b6991\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.260742 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.260696    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dz8t\" (UniqueName: \"kubernetes.io/projected/f450370f-6f6f-42fc-9771-aa91a34510fa-kube-api-access-4dz8t\") pod \"payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l\" (UID: \"f450370f-6f6f-42fc-9771-aa91a34510fa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.261288 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.261271    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29add0e-0856-45ef-9a96-33ae4c3b6991-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf\" (UID: \"b29add0e-0856-45ef-9a96-33ae4c3b6991\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.271242 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.271214    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4mgd\" (UniqueName: \"kubernetes.io/projected/b29add0e-0856-45ef-9a96-33ae4c3b6991-kube-api-access-m4mgd\") pod \"payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf\" (UID: \"b29add0e-0856-45ef-9a96-33ae4c3b6991\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.311937 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.311915    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.361325 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.361284    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f450370f-6f6f-42fc-9771-aa91a34510fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l\" (UID: \"f450370f-6f6f-42fc-9771-aa91a34510fa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.361552 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.361528    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dz8t\" (UniqueName: \"kubernetes.io/projected/f450370f-6f6f-42fc-9771-aa91a34510fa-kube-api-access-4dz8t\") pod \"payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l\" (UID: \"f450370f-6f6f-42fc-9771-aa91a34510fa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.362200 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.362127    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f450370f-6f6f-42fc-9771-aa91a34510fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l\" (UID: \"f450370f-6f6f-42fc-9771-aa91a34510fa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.373759 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.373709    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dz8t\" (UniqueName: \"kubernetes.io/projected/f450370f-6f6f-42fc-9771-aa91a34510fa-kube-api-access-4dz8t\") pod \"payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l\" (UID: \"f450370f-6f6f-42fc-9771-aa91a34510fa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.424255 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.424228    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.448307 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.448285    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"]
Jul 24 16:25:44.449523 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:25:44.449501    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29add0e_0856_45ef_9a96_33ae4c3b6991.slice/crio-f4accfcb6c39b6b18dad750242051a0890d038d809eeb88011a43a922810ec58 WatchSource:0}: Error finding container f4accfcb6c39b6b18dad750242051a0890d038d809eeb88011a43a922810ec58: Status 404 returned error can't find the container with id f4accfcb6c39b6b18dad750242051a0890d038d809eeb88011a43a922810ec58
Jul 24 16:25:44.590286 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.590265    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"]
Jul 24 16:25:44.592684 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:25:44.592656    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf450370f_6f6f_42fc_9771_aa91a34510fa.slice/crio-8bb1fbd774aa42fed2ad7b7ea6d4ed2aa0249bc6235dbcff9f240082cfc9f68a WatchSource:0}: Error finding container 8bb1fbd774aa42fed2ad7b7ea6d4ed2aa0249bc6235dbcff9f240082cfc9f68a: Status 404 returned error can't find the container with id 8bb1fbd774aa42fed2ad7b7ea6d4ed2aa0249bc6235dbcff9f240082cfc9f68a
Jul 24 16:25:44.679352 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.679318    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l" event={"ID":"f450370f-6f6f-42fc-9771-aa91a34510fa","Type":"ContainerStarted","Data":"f61a1b35ca9fc6b0dd50a822852bde32c45999c776172157efcf516646957b4c"}
Jul 24 16:25:44.679507 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.679389    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l" event={"ID":"f450370f-6f6f-42fc-9771-aa91a34510fa","Type":"ContainerStarted","Data":"8bb1fbd774aa42fed2ad7b7ea6d4ed2aa0249bc6235dbcff9f240082cfc9f68a"}
Jul 24 16:25:44.679507 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.679442    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:44.680926 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.680901    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf" event={"ID":"b29add0e-0856-45ef-9a96-33ae4c3b6991","Type":"ContainerStarted","Data":"6bb6c97e5df7d3e3166a0cb7767ae1ed691a6819374427c5d833a156d8b4e92e"}
Jul 24 16:25:44.681039 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.680947    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf" event={"ID":"b29add0e-0856-45ef-9a96-33ae4c3b6991","Type":"ContainerStarted","Data":"f4accfcb6c39b6b18dad750242051a0890d038d809eeb88011a43a922810ec58"}
Jul 24 16:25:44.681039 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.681036    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:44.682376 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.682358    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j" event={"ID":"1727dc08-95a6-4a3e-9406-b1e84ab9d242","Type":"ContainerStarted","Data":"cc803056a09cde0ba1ba3213b64aee31476f8119004d6312a363fe98df575959"}
Jul 24 16:25:44.682444 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.682397    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j" event={"ID":"1727dc08-95a6-4a3e-9406-b1e84ab9d242","Type":"ContainerStarted","Data":"1acbe63aab7415152c312e348ac894f46407b793fd02dda7a77b23f609ea3107"}
Jul 24 16:25:44.682444 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.682417    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:44.722561 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.722518    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l" podStartSLOduration=0.722505443 podStartE2EDuration="722.505443ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:25:44.721679377 +0000 UTC m=+2418.879546075" watchObservedRunningTime="2026-07-24 16:25:44.722505443 +0000 UTC m=+2418.880372143"
Jul 24 16:25:44.752105 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.752056    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j" podStartSLOduration=2.351990437 podStartE2EDuration="2.752041864s" totalImagesPullingTime="400.051427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:25:44.749677259 +0000 UTC m=+2418.907543957" watchObservedRunningTime="2026-07-24 16:25:44.752041864 +0000 UTC m=+2418.909908609"
Jul 24 16:25:44.788519 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:44.788474    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf" podStartSLOduration=1.788460888 podStartE2EDuration="1.788460888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:25:44.787214575 +0000 UTC m=+2418.945081313" watchObservedRunningTime="2026-07-24 16:25:44.788460888 +0000 UTC m=+2418.946327587"
Jul 24 16:25:47.442794 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:47.442686    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:47.642274 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:47.642238    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:25:47.819389 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:47.819264    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:48.146346 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:48.146228    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:48.665150 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:48.665121    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:50.692693 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:50.692669    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:25:51.046738 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.046650    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:51.189469 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.189433    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:51.220176 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.220148    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"]
Jul 24 16:25:51.224644 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.224624    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.227756 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.227738    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-82adcb-serving-cert\""
Jul 24 16:25:51.242104 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.242085    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"]
Jul 24 16:25:51.298997 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.298904    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:51.323725 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.323676    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2319138c-fe27-4f8b-b2fa-64da016e6fae-maas-api-tls\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.323915 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.323726    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2319138c-fe27-4f8b-b2fa-64da016e6fae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.323915 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.323863    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7mxs\" (UniqueName: \"kubernetes.io/projected/2319138c-fe27-4f8b-b2fa-64da016e6fae-kube-api-access-t7mxs\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.424769 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.424737    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2319138c-fe27-4f8b-b2fa-64da016e6fae-maas-api-tls\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.424769 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.424777    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2319138c-fe27-4f8b-b2fa-64da016e6fae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.425028 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.424821    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7mxs\" (UniqueName: \"kubernetes.io/projected/2319138c-fe27-4f8b-b2fa-64da016e6fae-kube-api-access-t7mxs\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.425530 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.425449    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2319138c-fe27-4f8b-b2fa-64da016e6fae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.427300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.427280    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2319138c-fe27-4f8b-b2fa-64da016e6fae-maas-api-tls\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.436583 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.436565    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7mxs\" (UniqueName: \"kubernetes.io/projected/2319138c-fe27-4f8b-b2fa-64da016e6fae-kube-api-access-t7mxs\") pod \"maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.491900 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.491869    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:51.534762 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.534731    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:51.680897 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.680868    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"]
Jul 24 16:25:51.682527 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:25:51.682499    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2319138c_fe27_4f8b_b2fa_64da016e6fae.slice/crio-0f30f24d335aab69537489af97c8df0f439c900152c62f6a2a93a3e51245c363 WatchSource:0}: Error finding container 0f30f24d335aab69537489af97c8df0f439c900152c62f6a2a93a3e51245c363: Status 404 returned error can't find the container with id 0f30f24d335aab69537489af97c8df0f439c900152c62f6a2a93a3e51245c363
Jul 24 16:25:51.716343 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.716315    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc" event={"ID":"2319138c-fe27-4f8b-b2fa-64da016e6fae","Type":"ContainerStarted","Data":"0f30f24d335aab69537489af97c8df0f439c900152c62f6a2a93a3e51245c363"}
Jul 24 16:25:51.865494 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.865409    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:51.972458 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.972424    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:51.982145 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.982116    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"]
Jul 24 16:25:51.986800 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.986781    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:51.989458 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.989437    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-82adcb\""
Jul 24 16:25:51.989561 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.989494    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-82adcb-dockercfg-26xd7\""
Jul 24 16:25:51.996502 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:51.996478    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"]
Jul 24 16:25:52.129369 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.129336    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24db291-dae7-40d5-b9e4-1567a7b9be26-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl\" (UID: \"a24db291-dae7-40d5-b9e4-1567a7b9be26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:52.129535 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.129462    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2mbx\" (UniqueName: \"kubernetes.io/projected/a24db291-dae7-40d5-b9e4-1567a7b9be26-kube-api-access-x2mbx\") pod \"payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl\" (UID: \"a24db291-dae7-40d5-b9e4-1567a7b9be26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:52.230690 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.230657    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24db291-dae7-40d5-b9e4-1567a7b9be26-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl\" (UID: \"a24db291-dae7-40d5-b9e4-1567a7b9be26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:52.230871 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.230794    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2mbx\" (UniqueName: \"kubernetes.io/projected/a24db291-dae7-40d5-b9e4-1567a7b9be26-kube-api-access-x2mbx\") pod \"payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl\" (UID: \"a24db291-dae7-40d5-b9e4-1567a7b9be26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:52.231351 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.231330    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24db291-dae7-40d5-b9e4-1567a7b9be26-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl\" (UID: \"a24db291-dae7-40d5-b9e4-1567a7b9be26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:52.239457 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.239439    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2mbx\" (UniqueName: \"kubernetes.io/projected/a24db291-dae7-40d5-b9e4-1567a7b9be26-kube-api-access-x2mbx\") pod \"payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl\" (UID: \"a24db291-dae7-40d5-b9e4-1567a7b9be26\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:52.297980 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.297958    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:52.640102 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.640078    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"]
Jul 24 16:25:52.641627 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:25:52.641577    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24db291_dae7_40d5_b9e4_1567a7b9be26.slice/crio-74c27a125db2d64727fdc2ae865aab08f16bf35e36f5cb5da47b5bf3798f1578 WatchSource:0}: Error finding container 74c27a125db2d64727fdc2ae865aab08f16bf35e36f5cb5da47b5bf3798f1578: Status 404 returned error can't find the container with id 74c27a125db2d64727fdc2ae865aab08f16bf35e36f5cb5da47b5bf3798f1578
Jul 24 16:25:52.723680 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.723651    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl" event={"ID":"a24db291-dae7-40d5-b9e4-1567a7b9be26","Type":"ContainerStarted","Data":"c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5"}
Jul 24 16:25:52.724038 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.723717    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:25:52.724038 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.723745    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl" event={"ID":"a24db291-dae7-40d5-b9e4-1567a7b9be26","Type":"ContainerStarted","Data":"74c27a125db2d64727fdc2ae865aab08f16bf35e36f5cb5da47b5bf3798f1578"}
Jul 24 16:25:52.725105 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.725081    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc" event={"ID":"2319138c-fe27-4f8b-b2fa-64da016e6fae","Type":"ContainerStarted","Data":"55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5"}
Jul 24 16:25:52.725229 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.725204    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:52.751460 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:52.751381    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl" podStartSLOduration=1.751369084 podStartE2EDuration="1.751369084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:25:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:25:52.750479719 +0000 UTC m=+2426.908346418" watchObservedRunningTime="2026-07-24 16:25:52.751369084 +0000 UTC m=+2426.909235789"
Jul 24 16:25:55.362053 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:55.362013    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:25:55.689403 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:55.689365    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:25:55.689560 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:55.689435    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:25:55.709238 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:55.709192    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc" podStartSLOduration=4.308073136 podStartE2EDuration="4.709175257s" totalImagesPullingTime="401.102121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:25:52.780043833 +0000 UTC m=+2426.937910532" watchObservedRunningTime="2026-07-24 16:25:55.709175257 +0000 UTC m=+2429.867041994"
Jul 24 16:25:58.735829 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:58.735804    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:25:58.997952 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:25:58.997862    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:26:03.732036 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:26:03.731989    2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl" podUID="a24db291-dae7-40d5-b9e4-1567a7b9be26" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.66:9004: connect: connection refused"
Jul 24 16:26:06.117664 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:26:06.117628    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:26:08.695679 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:26:08.695646    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:26:13.730862 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:26:13.730828    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:26:23.200976 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:26:23.200938    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:26:33.529757 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:26:33.529716    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:26:37.689952 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:26:37.689918    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:26:54.977236 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:26:54.977199    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:27:11.591689 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:27:11.591656    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:27:28.391165 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:27:28.391130    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:27:46.486794 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:27:46.486760    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:27:55.621031 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:27:55.620993    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:28:07.288789 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:28:07.288753    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:28:24.980042 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:28:24.980004    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:28:42.588509 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:28:42.588472    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:28:48.694258 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:28:48.694172    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:28:49.799728 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:28:49.799695    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:28:58.991274 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:28:58.991233    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:29:05.160756 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:29:05.160715    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:29:08.889380 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:29:08.889344    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:29:28.599785 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:29:28.599740    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:29:28.654551 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:29:28.654526    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:29:38.617774 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:29:38.617740    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:29:42.278728 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:29:42.278695    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:30:00.133662 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.133631    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n"]
Jul 24 16:30:00.137136 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.137115    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"]
Jul 24 16:30:00.137266 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.137226    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n"
Jul 24 16:30:00.140151 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.140134    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"]
Jul 24 16:30:00.140245 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.140236    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"
Jul 24 16:30:00.140396 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.140379    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:30:00.143443 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.143427    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"
Jul 24 16:30:00.148441 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.148419    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n"]
Jul 24 16:30:00.148720 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.148701    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n"
Jul 24 16:30:00.157894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.154244    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"]
Jul 24 16:30:00.159166 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.159073    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"]
Jul 24 16:30:00.177456 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.177357    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"
Jul 24 16:30:00.184471 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.184450    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"
Jul 24 16:30:00.313154 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.313053    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n"]
Jul 24 16:30:00.315392 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:30:00.315340    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b806668_c479_4a81_ae6e_94ccda7fb499.slice/crio-3d42eb627ca42da84321ead7b638b4ffdfc6793f3223f3cf9155f4b3c3dc233b WatchSource:0}: Error finding container 3d42eb627ca42da84321ead7b638b4ffdfc6793f3223f3cf9155f4b3c3dc233b: Status 404 returned error can't find the container with id 3d42eb627ca42da84321ead7b638b4ffdfc6793f3223f3cf9155f4b3c3dc233b
Jul 24 16:30:00.395200 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.395146    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:30:00.548423 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.548400    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"]
Jul 24 16:30:00.549798 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:30:00.549775    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0948c40_06a0_4ee1_8559_cd91ac31363d.slice/crio-e42b041c32962fc3a7cc58d983a0a052fa573563f43261ddca57c279f4903875 WatchSource:0}: Error finding container e42b041c32962fc3a7cc58d983a0a052fa573563f43261ddca57c279f4903875: Status 404 returned error can't find the container with id e42b041c32962fc3a7cc58d983a0a052fa573563f43261ddca57c279f4903875
Jul 24 16:30:00.570936 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.570913    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"]
Jul 24 16:30:00.578544 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:30:00.578522    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95853010_a2ea_48f2_ba81_d6e369f92016.slice/crio-572079733b5066487032b8abfbad9d33a6c06024508a9f8890f76536234a49a5 WatchSource:0}: Error finding container 572079733b5066487032b8abfbad9d33a6c06024508a9f8890f76536234a49a5: Status 404 returned error can't find the container with id 572079733b5066487032b8abfbad9d33a6c06024508a9f8890f76536234a49a5
Jul 24 16:30:00.864678 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.864649    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm" event={"ID":"95853010-a2ea-48f2-ba81-d6e369f92016","Type":"ContainerStarted","Data":"c71e35b62add8c8ae260b93bed7d22b1526429926f15321fcc8b7ae103982a98"}
Jul 24 16:30:00.864800 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.864717    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm" event={"ID":"95853010-a2ea-48f2-ba81-d6e369f92016","Type":"ContainerStarted","Data":"572079733b5066487032b8abfbad9d33a6c06024508a9f8890f76536234a49a5"}
Jul 24 16:30:00.866138 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.866107    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n" event={"ID":"9b806668-c479-4a81-ae6e-94ccda7fb499","Type":"ContainerStarted","Data":"4452e8a4bff86d78d229c2d39dba955cbe1a77e155025c5fb1b1e857e2923dcf"}
Jul 24 16:30:00.866290 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.866151    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n" event={"ID":"9b806668-c479-4a81-ae6e-94ccda7fb499","Type":"ContainerStarted","Data":"3d42eb627ca42da84321ead7b638b4ffdfc6793f3223f3cf9155f4b3c3dc233b"}
Jul 24 16:30:00.867558 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.867535    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc" event={"ID":"d0948c40-06a0-4ee1-8559-cd91ac31363d","Type":"ContainerStarted","Data":"6f45f0c409b4cf7daa883fcad74d2278b40bf010cac8e9379026bf51279ee19d"}
Jul 24 16:30:00.867676 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.867584    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc" event={"ID":"d0948c40-06a0-4ee1-8559-cd91ac31363d","Type":"ContainerStarted","Data":"e42b041c32962fc3a7cc58d983a0a052fa573563f43261ddca57c279f4903875"}
Jul 24 16:30:00.883111 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.882472    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm" podStartSLOduration=0.882454406 podStartE2EDuration="882.454406ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:30:00.881900459 +0000 UTC m=+2675.039767160" watchObservedRunningTime="2026-07-24 16:30:00.882454406 +0000 UTC m=+2675.040321106"
Jul 24 16:30:00.902217 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.902180    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc" podStartSLOduration=0.90217016 podStartE2EDuration="902.17016ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:30:00.899538156 +0000 UTC m=+2675.057404866" watchObservedRunningTime="2026-07-24 16:30:00.90217016 +0000 UTC m=+2675.060036859"
Jul 24 16:30:00.918029 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:00.917982    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n" podStartSLOduration=0.917970806 podStartE2EDuration="917.970806ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:30:00.91713583 +0000 UTC m=+2675.075002528" watchObservedRunningTime="2026-07-24 16:30:00.917970806 +0000 UTC m=+2675.075837505"
Jul 24 16:30:01.873408 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:01.873378    2600 generic.go:356] "Generic (PLEG): container finished" podID="95853010-a2ea-48f2-ba81-d6e369f92016" containerID="c71e35b62add8c8ae260b93bed7d22b1526429926f15321fcc8b7ae103982a98" exitCode=0
Jul 24 16:30:01.873811 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:01.873456    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm" event={"ID":"95853010-a2ea-48f2-ba81-d6e369f92016","Type":"ContainerDied","Data":"c71e35b62add8c8ae260b93bed7d22b1526429926f15321fcc8b7ae103982a98"}
Jul 24 16:30:01.875032 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:01.875009    2600 generic.go:356] "Generic (PLEG): container finished" podID="9b806668-c479-4a81-ae6e-94ccda7fb499" containerID="4452e8a4bff86d78d229c2d39dba955cbe1a77e155025c5fb1b1e857e2923dcf" exitCode=0
Jul 24 16:30:01.875101 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:01.875084    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n" event={"ID":"9b806668-c479-4a81-ae6e-94ccda7fb499","Type":"ContainerDied","Data":"4452e8a4bff86d78d229c2d39dba955cbe1a77e155025c5fb1b1e857e2923dcf"}
Jul 24 16:30:01.876487 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:01.876469    2600 generic.go:356] "Generic (PLEG): container finished" podID="d0948c40-06a0-4ee1-8559-cd91ac31363d" containerID="6f45f0c409b4cf7daa883fcad74d2278b40bf010cac8e9379026bf51279ee19d" exitCode=0
Jul 24 16:30:01.876539 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:01.876524    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc" event={"ID":"d0948c40-06a0-4ee1-8559-cd91ac31363d","Type":"ContainerDied","Data":"6f45f0c409b4cf7daa883fcad74d2278b40bf010cac8e9379026bf51279ee19d"}
Jul 24 16:30:03.021320 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.021293    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"
Jul 24 16:30:03.052101 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.052078    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"
Jul 24 16:30:03.075169 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.075147    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n"
Jul 24 16:30:03.887345 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.887321    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"
Jul 24 16:30:03.887345 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.887324    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm" event={"ID":"95853010-a2ea-48f2-ba81-d6e369f92016","Type":"ContainerDied","Data":"572079733b5066487032b8abfbad9d33a6c06024508a9f8890f76536234a49a5"}
Jul 24 16:30:03.887634 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.887368    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="572079733b5066487032b8abfbad9d33a6c06024508a9f8890f76536234a49a5"
Jul 24 16:30:03.888647 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.888632    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n"
Jul 24 16:30:03.888776 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.888672    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748510-pmq7n" event={"ID":"9b806668-c479-4a81-ae6e-94ccda7fb499","Type":"ContainerDied","Data":"3d42eb627ca42da84321ead7b638b4ffdfc6793f3223f3cf9155f4b3c3dc233b"}
Jul 24 16:30:03.888776 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.888716    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d42eb627ca42da84321ead7b638b4ffdfc6793f3223f3cf9155f4b3c3dc233b"
Jul 24 16:30:03.889943 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.889923    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc" event={"ID":"d0948c40-06a0-4ee1-8559-cd91ac31363d","Type":"ContainerDied","Data":"e42b041c32962fc3a7cc58d983a0a052fa573563f43261ddca57c279f4903875"}
Jul 24 16:30:03.890058 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.889947    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"
Jul 24 16:30:03.890058 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:03.889958    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e42b041c32962fc3a7cc58d983a0a052fa573563f43261ddca57c279f4903875"
Jul 24 16:30:12.464779 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:12.464742    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:30:18.987625 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:18.987528    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:30:25.489703 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:25.489659    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:30:26.321228 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:26.321187    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:30:26.642690 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:26.642595    2600 scope.go:117] "RemoveContainer" containerID="67a64fd423aa0901f3b63e089046cd30f3fab1b110045172822d7ae302165488"
Jul 24 16:30:26.651043 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:26.651020    2600 scope.go:117] "RemoveContainer" containerID="90067c5cc58eddc7e76fa21939f33eb0f96db16087c7a96e980b8c5af49ac8f5"
Jul 24 16:30:32.003386 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:32.003353    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:30:37.188078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:37.187988    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:30:53.634967 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:53.634936    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:30:55.650165 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:55.650132    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:30:57.180853 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:57.180817    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:30:57.193620 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:57.193585    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:30:57.278222 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:30:57.278193    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:31:10.115100 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:31:10.115062    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:31:14.281371 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:31:14.281338    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:31:26.672379 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:31:26.672267    2600 scope.go:117] "RemoveContainer" containerID="f78a1c824765a94c2e10a8efbdce5dea60511d636e14b5cbcf46fc6ab3600e68"
Jul 24 16:31:26.680312 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:31:26.680288    2600 scope.go:117] "RemoveContainer" containerID="5e52e718327d43db309874230e1b4b81078fac2df2ab851806d4493422329793"
Jul 24 16:31:31.594062 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:31:31.594026    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:31:47.199530 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:31:47.199444    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:31:56.027657 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:31:56.027621    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:31:57.094108 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:31:57.094076    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:04.122444 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:04.122408    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:32:17.385627 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:17.385564    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:17.852092 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:17.852060    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:17.966526 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:17.966484    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:20.029176 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:20.029140    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:20.682020 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:20.681977    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:20.788749 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:20.788711    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:20.875959 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:20.875929    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:21.098624 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.098512    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:21.423696 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.423590    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:21.522593 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.522558    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:21.530642 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.530600    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"]
Jul 24 16:32:21.530950 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.530938    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95853010-a2ea-48f2-ba81-d6e369f92016" containerName="cleanup"
Jul 24 16:32:21.530996 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.530952    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="95853010-a2ea-48f2-ba81-d6e369f92016" containerName="cleanup"
Jul 24 16:32:21.530996 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.530970    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b806668-c479-4a81-ae6e-94ccda7fb499" containerName="cleanup"
Jul 24 16:32:21.530996 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.530976    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b806668-c479-4a81-ae6e-94ccda7fb499" containerName="cleanup"
Jul 24 16:32:21.530996 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.530986    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0948c40-06a0-4ee1-8559-cd91ac31363d" containerName="cleanup"
Jul 24 16:32:21.530996 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.530991    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0948c40-06a0-4ee1-8559-cd91ac31363d" containerName="cleanup"
Jul 24 16:32:21.531173 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.531048    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b806668-c479-4a81-ae6e-94ccda7fb499" containerName="cleanup"
Jul 24 16:32:21.531173 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.531055    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="95853010-a2ea-48f2-ba81-d6e369f92016" containerName="cleanup"
Jul 24 16:32:21.531173 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.531063    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0948c40-06a0-4ee1-8559-cd91ac31363d" containerName="cleanup"
Jul 24 16:32:21.534225 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.534210    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:21.537069 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.537051    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-0107ee-dockercfg-76gpk\""
Jul 24 16:32:21.537323 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.537305    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-0107ee\""
Jul 24 16:32:21.543120 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.543103    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"]
Jul 24 16:32:21.560549 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.560530    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"]
Jul 24 16:32:21.564068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.564050    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:21.577376 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.577356    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"]
Jul 24 16:32:21.653157 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.653130    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a608fa-e705-4ee9-82f2-208fa4167852-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79\" (UID: \"b9a608fa-e705-4ee9-82f2-208fa4167852\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:21.653311 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.653192    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sh6s\" (UniqueName: \"kubernetes.io/projected/b9a608fa-e705-4ee9-82f2-208fa4167852-kube-api-access-5sh6s\") pod \"payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79\" (UID: \"b9a608fa-e705-4ee9-82f2-208fa4167852\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:21.754174 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.754144    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh6s\" (UniqueName: \"kubernetes.io/projected/b9a608fa-e705-4ee9-82f2-208fa4167852-kube-api-access-5sh6s\") pod \"payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79\" (UID: \"b9a608fa-e705-4ee9-82f2-208fa4167852\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:21.754319 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.754198    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75c72\" (UniqueName: \"kubernetes.io/projected/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-kube-api-access-75c72\") pod \"payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft\" (UID: \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:21.754319 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.754232    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a608fa-e705-4ee9-82f2-208fa4167852-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79\" (UID: \"b9a608fa-e705-4ee9-82f2-208fa4167852\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:21.754319 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.754256    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft\" (UID: \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:21.754934 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.754917    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a608fa-e705-4ee9-82f2-208fa4167852-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79\" (UID: \"b9a608fa-e705-4ee9-82f2-208fa4167852\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:21.762650 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.762631    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sh6s\" (UniqueName: \"kubernetes.io/projected/b9a608fa-e705-4ee9-82f2-208fa4167852-kube-api-access-5sh6s\") pod \"payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79\" (UID: \"b9a608fa-e705-4ee9-82f2-208fa4167852\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:21.846351 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.846329    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:21.854889 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.854866    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75c72\" (UniqueName: \"kubernetes.io/projected/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-kube-api-access-75c72\") pod \"payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft\" (UID: \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:21.854991 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.854916    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft\" (UID: \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:21.855508 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.855488    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft\" (UID: \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:21.863717 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.863686    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75c72\" (UniqueName: \"kubernetes.io/projected/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-kube-api-access-75c72\") pod \"payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft\" (UID: \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:21.873664 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:21.873642    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:22.025585 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.025514    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"]
Jul 24 16:32:22.029523 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:32:22.029497    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1f9188_c6c4_4d29_8fc7_1f3fb57b5377.slice/crio-7fd2b902d7ce57bbbe0a877c7f662970e4f3f35ce6726584b2342d72b5f8e1a6 WatchSource:0}: Error finding container 7fd2b902d7ce57bbbe0a877c7f662970e4f3f35ce6726584b2342d72b5f8e1a6: Status 404 returned error can't find the container with id 7fd2b902d7ce57bbbe0a877c7f662970e4f3f35ce6726584b2342d72b5f8e1a6
Jul 24 16:32:22.194600 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.194472    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"]
Jul 24 16:32:22.197118 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:32:22.197091    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a608fa_e705_4ee9_82f2_208fa4167852.slice/crio-5aaa21bafb38c96b8023dbc1240454dc9fe8764055924fec8b1c2e6848e70252 WatchSource:0}: Error finding container 5aaa21bafb38c96b8023dbc1240454dc9fe8764055924fec8b1c2e6848e70252: Status 404 returned error can't find the container with id 5aaa21bafb38c96b8023dbc1240454dc9fe8764055924fec8b1c2e6848e70252
Jul 24 16:32:22.554871 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.554835    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft" event={"ID":"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377","Type":"ContainerStarted","Data":"9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf"}
Jul 24 16:32:22.555075 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.554885    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft" event={"ID":"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377","Type":"ContainerStarted","Data":"7fd2b902d7ce57bbbe0a877c7f662970e4f3f35ce6726584b2342d72b5f8e1a6"}
Jul 24 16:32:22.555075 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.554939    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:22.556447 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.556424    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79" event={"ID":"b9a608fa-e705-4ee9-82f2-208fa4167852","Type":"ContainerStarted","Data":"7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66"}
Jul 24 16:32:22.556552 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.556464    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79" event={"ID":"b9a608fa-e705-4ee9-82f2-208fa4167852","Type":"ContainerStarted","Data":"5aaa21bafb38c96b8023dbc1240454dc9fe8764055924fec8b1c2e6848e70252"}
Jul 24 16:32:22.556552 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.556548    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:22.578806 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.578764    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft" podStartSLOduration=1.578751019 podStartE2EDuration="1.578751019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:32:22.576937378 +0000 UTC m=+2816.734804077" watchObservedRunningTime="2026-07-24 16:32:22.578751019 +0000 UTC m=+2816.736617738"
Jul 24 16:32:22.593433 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:22.593398    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79" podStartSLOduration=1.593387083 podStartE2EDuration="1.593387083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:32:22.591956325 +0000 UTC m=+2816.749823026" watchObservedRunningTime="2026-07-24 16:32:22.593387083 +0000 UTC m=+2816.751253783"
Jul 24 16:32:25.205980 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:25.205932    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:30.085809 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:30.085772    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:32:33.569165 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:33.569132    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:32:33.569576 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:33.569218    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:32:36.175919 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:36.175891    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:36.498417 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:36.498381    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:36.735270 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:36.735242    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:39.758088 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.758052    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:39.837337 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.837301    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:39.837632 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.837594    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"]
Jul 24 16:32:39.841129 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.841112    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:39.844327 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.844310    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-52d140-serving-cert\""
Jul 24 16:32:39.854589 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.854569    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"]
Jul 24 16:32:39.887945 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.887923    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:39.888078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.887966    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6brt\" (UniqueName: \"kubernetes.io/projected/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-kube-api-access-h6brt\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:39.888078 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.888009    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:39.913912 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.913886    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:39.989166 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.989136    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:39.989329 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.989189    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:39.989329 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.989230    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6brt\" (UniqueName: \"kubernetes.io/projected/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-kube-api-access-h6brt\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:39.989407 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:32:39.989352    2600 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-serving-cert: secret "maas-api-e2e-ipp-b-52d140-serving-cert" not found
Jul 24 16:32:39.989442 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:32:39.989419    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls podName:58e700a7-adcf-4909-8c1c-ec9f01e44ac0 nodeName:}" failed. No retries permitted until 2026-07-24 16:32:40.489403904 +0000 UTC m=+2834.647270584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls") pod "maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v" (UID: "58e700a7-adcf-4909-8c1c-ec9f01e44ac0") : secret "maas-api-e2e-ipp-b-52d140-serving-cert" not found
Jul 24 16:32:39.989829 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:39.989813    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:40.000567 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.000547    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6brt\" (UniqueName: \"kubernetes.io/projected/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-kube-api-access-h6brt\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:40.262147 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.262112    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:40.448206 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.448172    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:40.493789 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.493753    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:40.496197 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.496175    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:40.550174 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.550100    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:40.629962 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.629932    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"]
Jul 24 16:32:40.633705 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.633687    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:40.636395 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.636374    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-52d140-dockercfg-2lnmc\""
Jul 24 16:32:40.636526 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.636509    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-52d140\""
Jul 24 16:32:40.642459 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.642437    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"]
Jul 24 16:32:40.695645 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.695586    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf\" (UID: \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:40.695826 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.695699    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bw6b\" (UniqueName: \"kubernetes.io/projected/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-kube-api-access-6bw6b\") pod \"payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf\" (UID: \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:40.751540 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.751508    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:40.796916 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.796884    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf\" (UID: \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:40.797345 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.796930    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bw6b\" (UniqueName: \"kubernetes.io/projected/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-kube-api-access-6bw6b\") pod \"payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf\" (UID: \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:40.797748 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.797723    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf\" (UID: \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:40.808020 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.807996    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bw6b\" (UniqueName: \"kubernetes.io/projected/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-kube-api-access-6bw6b\") pod \"payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf\" (UID: \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:40.888687 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.888655    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"]
Jul 24 16:32:40.891668 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:32:40.891642    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e700a7_adcf_4909_8c1c_ec9f01e44ac0.slice/crio-342576aa38758bcfdb4d7d595dab9dd47579f114ce2356180830d10c99bcc886 WatchSource:0}: Error finding container 342576aa38758bcfdb4d7d595dab9dd47579f114ce2356180830d10c99bcc886: Status 404 returned error can't find the container with id 342576aa38758bcfdb4d7d595dab9dd47579f114ce2356180830d10c99bcc886
Jul 24 16:32:40.893085 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.893070    2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:32:40.945810 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:40.945785    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:41.083901 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.083878    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"]
Jul 24 16:32:41.085793 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:32:41.085762    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5a09c8_d9be_4ac3_b84f_0cc68973c5af.slice/crio-c2741df1fd7013d71aad4e7da386c989ffee9beccbdfc22dc2b7b64b8d759079 WatchSource:0}: Error finding container c2741df1fd7013d71aad4e7da386c989ffee9beccbdfc22dc2b7b64b8d759079: Status 404 returned error can't find the container with id c2741df1fd7013d71aad4e7da386c989ffee9beccbdfc22dc2b7b64b8d759079
Jul 24 16:32:41.652094 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.652004    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf" event={"ID":"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af","Type":"ContainerStarted","Data":"5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba"}
Jul 24 16:32:41.652094 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.652081    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf" event={"ID":"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af","Type":"ContainerStarted","Data":"c2741df1fd7013d71aad4e7da386c989ffee9beccbdfc22dc2b7b64b8d759079"}
Jul 24 16:32:41.652316 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.652113    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:32:41.653579 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.653556    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v" event={"ID":"58e700a7-adcf-4909-8c1c-ec9f01e44ac0","Type":"ContainerStarted","Data":"0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8"}
Jul 24 16:32:41.653697 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.653593    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v" event={"ID":"58e700a7-adcf-4909-8c1c-ec9f01e44ac0","Type":"ContainerStarted","Data":"342576aa38758bcfdb4d7d595dab9dd47579f114ce2356180830d10c99bcc886"}
Jul 24 16:32:41.653697 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.653684    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:41.670076 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.670030    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf" podStartSLOduration=1.670009109 podStartE2EDuration="1.670009109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:32:41.669290121 +0000 UTC m=+2835.827156821" watchObservedRunningTime="2026-07-24 16:32:41.670009109 +0000 UTC m=+2835.827875842"
Jul 24 16:32:41.688877 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:41.688833    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v" podStartSLOduration=2.219984273 podStartE2EDuration="2.688819747s" totalImagesPullingTime="468.835474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:32:41.687064554 +0000 UTC m=+2835.844931254" watchObservedRunningTime="2026-07-24 16:32:41.688819747 +0000 UTC m=+2835.846686445"
Jul 24 16:32:44.300021 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:44.299989    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:32:47.664876 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:47.664845    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:32:48.885533 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:48.885497    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:32:52.661164 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:32:52.661133    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:33:09.019647 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:09.019574    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:12.693831 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:12.693784    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:33:33.391705 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:33.391625    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:33:43.760366 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:43.760327    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft_3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377/payload-processing/0.log"
Jul 24 16:33:44.336306 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:44.336273    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:44.676552 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:44.676463    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:45.064282 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:45.064247    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:50.631268 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.631232    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:50.711193 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.711156    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"]
Jul 24 16:33:50.715306 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.715285    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:50.715481 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.715363    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:50.717894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.717870    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-2ba900-serving-cert\""
Jul 24 16:33:50.725922 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.725903    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"]
Jul 24 16:33:50.761398 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.761373    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqt9d\" (UniqueName: \"kubernetes.io/projected/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-kube-api-access-dqt9d\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:50.761510 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.761423    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:50.761510 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.761476    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:50.788416 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.788393    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:50.862733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.862700    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqt9d\" (UniqueName: \"kubernetes.io/projected/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-kube-api-access-dqt9d\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:50.862886 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.862752    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:50.863010 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.862987    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:50.863121 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:33:50.863103    2600 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-serving-cert: secret "maas-api-e2e-ipp-cleanup-2ba900-serving-cert" not found
Jul 24 16:33:50.863205 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:33:50.863194    2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls podName:4d5a3d0a-7b65-49ed-af86-acdb6c79b253 nodeName:}" failed. No retries permitted until 2026-07-24 16:33:51.363171187 +0000 UTC m=+2905.521037868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r" (UID: "4d5a3d0a-7b65-49ed-af86-acdb6c79b253") : secret "maas-api-e2e-ipp-cleanup-2ba900-serving-cert" not found
Jul 24 16:33:50.863523 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.863506    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:50.871818 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:50.871798    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqt9d\" (UniqueName: \"kubernetes.io/projected/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-kube-api-access-dqt9d\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:51.048882 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.048848    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:51.232093 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.232059    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:51.317746 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.317661    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:51.318627 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.318586    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"]
Jul 24 16:33:51.322091 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.322072    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:51.324992 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.324976    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-2ba900\""
Jul 24 16:33:51.330741 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.330721    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"]
Jul 24 16:33:51.368304 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.368278    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0578b378-b95e-48a9-9a5d-8028dfb7ee49-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn\" (UID: \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:51.368414 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.368398    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hvqw\" (UniqueName: \"kubernetes.io/projected/0578b378-b95e-48a9-9a5d-8028dfb7ee49-kube-api-access-4hvqw\") pod \"payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn\" (UID: \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:51.368472 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.368461    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:51.370873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.370856    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:51.469798 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.469763    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0578b378-b95e-48a9-9a5d-8028dfb7ee49-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn\" (UID: \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:51.469973 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.469892    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hvqw\" (UniqueName: \"kubernetes.io/projected/0578b378-b95e-48a9-9a5d-8028dfb7ee49-kube-api-access-4hvqw\") pod \"payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn\" (UID: \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:51.470503 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.470476    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0578b378-b95e-48a9-9a5d-8028dfb7ee49-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn\" (UID: \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:51.481005 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.480983    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hvqw\" (UniqueName: \"kubernetes.io/projected/0578b378-b95e-48a9-9a5d-8028dfb7ee49-kube-api-access-4hvqw\") pod \"payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn\" (UID: \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:51.627875 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.627809    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:51.633684 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.633667    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:51.771378 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.771355    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"]
Jul 24 16:33:51.773501 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:33:51.773473    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5a3d0a_7b65_49ed_af86_acdb6c79b253.slice/crio-7f1ca987d3c892a175e987d23d745fb5b37d5450f26ce67dd704756a81b3be61 WatchSource:0}: Error finding container 7f1ca987d3c892a175e987d23d745fb5b37d5450f26ce67dd704756a81b3be61: Status 404 returned error can't find the container with id 7f1ca987d3c892a175e987d23d745fb5b37d5450f26ce67dd704756a81b3be61
Jul 24 16:33:51.794593 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.794574    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"]
Jul 24 16:33:51.796266 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:33:51.796233    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0578b378_b95e_48a9_9a5d_8028dfb7ee49.slice/crio-3ff8a366f1d67fbe190ff4a7d9691c1faf3da5fbf87296a35f77fcf7583d95a6 WatchSource:0}: Error finding container 3ff8a366f1d67fbe190ff4a7d9691c1faf3da5fbf87296a35f77fcf7583d95a6: Status 404 returned error can't find the container with id 3ff8a366f1d67fbe190ff4a7d9691c1faf3da5fbf87296a35f77fcf7583d95a6
Jul 24 16:33:51.992766 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.992737    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r" event={"ID":"4d5a3d0a-7b65-49ed-af86-acdb6c79b253","Type":"ContainerStarted","Data":"7f1ca987d3c892a175e987d23d745fb5b37d5450f26ce67dd704756a81b3be61"}
Jul 24 16:33:51.994196 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.994166    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn" event={"ID":"0578b378-b95e-48a9-9a5d-8028dfb7ee49","Type":"ContainerStarted","Data":"43259e3aa45ecf92bdd3e992e8f7412dc2ebc6c32c2a1c659c86a14387ecbf5f"}
Jul 24 16:33:51.994331 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.994209    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn" event={"ID":"0578b378-b95e-48a9-9a5d-8028dfb7ee49","Type":"ContainerStarted","Data":"3ff8a366f1d67fbe190ff4a7d9691c1faf3da5fbf87296a35f77fcf7583d95a6"}
Jul 24 16:33:51.994331 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:51.994270    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:33:52.039551 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:52.039509    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn" podStartSLOduration=1.039494242 podStartE2EDuration="1.039494242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:33:52.037785085 +0000 UTC m=+2906.195651785" watchObservedRunningTime="2026-07-24 16:33:52.039494242 +0000 UTC m=+2906.197360944"
Jul 24 16:33:53.000675 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:53.000638    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r" event={"ID":"4d5a3d0a-7b65-49ed-af86-acdb6c79b253","Type":"ContainerStarted","Data":"aa4c41f0c802a607ad260d54716f0190e6b0db7bf83ff3ba1af7f29c0d0f908a"}
Jul 24 16:33:53.001087 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:53.000718    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:33:53.019723 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:53.019669    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r" podStartSLOduration=2.57721239 podStartE2EDuration="3.019654582s" totalImagesPullingTime="442.442192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:33:53.017764772 +0000 UTC m=+2907.175631473" watchObservedRunningTime="2026-07-24 16:33:53.019654582 +0000 UTC m=+2907.177521341"
Jul 24 16:33:55.179597 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:55.179564    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:33:59.010924 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:33:59.010897    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:34:03.003459 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:03.003426    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:34:04.787670 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:04.787634    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:34:16.899417 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:16.899379    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"]
Jul 24 16:34:16.899953 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:16.899680    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r" podUID="4d5a3d0a-7b65-49ed-af86-acdb6c79b253" containerName="maas-api" containerID="cri-o://aa4c41f0c802a607ad260d54716f0190e6b0db7bf83ff3ba1af7f29c0d0f908a" gracePeriod=30
Jul 24 16:34:16.927324 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:16.927302    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:16.970991 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:16.970963    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"]
Jul 24 16:34:16.971254 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:16.971229    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn" podUID="0578b378-b95e-48a9-9a5d-8028dfb7ee49" containerName="payload-pre-processing" containerID="cri-o://43259e3aa45ecf92bdd3e992e8f7412dc2ebc6c32c2a1c659c86a14387ecbf5f" gracePeriod=30
Jul 24 16:34:17.028399 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.028368    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:17.120695 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.120665    2600 generic.go:356] "Generic (PLEG): container finished" podID="0578b378-b95e-48a9-9a5d-8028dfb7ee49" containerID="43259e3aa45ecf92bdd3e992e8f7412dc2ebc6c32c2a1c659c86a14387ecbf5f" exitCode=0
Jul 24 16:34:17.120894 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.120739    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn" event={"ID":"0578b378-b95e-48a9-9a5d-8028dfb7ee49","Type":"ContainerDied","Data":"43259e3aa45ecf92bdd3e992e8f7412dc2ebc6c32c2a1c659c86a14387ecbf5f"}
Jul 24 16:34:17.122390 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.122367    2600 generic.go:356] "Generic (PLEG): container finished" podID="4d5a3d0a-7b65-49ed-af86-acdb6c79b253" containerID="aa4c41f0c802a607ad260d54716f0190e6b0db7bf83ff3ba1af7f29c0d0f908a" exitCode=0
Jul 24 16:34:17.122542 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.122442    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r" event={"ID":"4d5a3d0a-7b65-49ed-af86-acdb6c79b253","Type":"ContainerDied","Data":"aa4c41f0c802a607ad260d54716f0190e6b0db7bf83ff3ba1af7f29c0d0f908a"}
Jul 24 16:34:17.201685 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.201647    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:17.241777 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.241757    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:34:17.264540 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.264521    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:34:17.394134 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.394107    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hvqw\" (UniqueName: \"kubernetes.io/projected/0578b378-b95e-48a9-9a5d-8028dfb7ee49-kube-api-access-4hvqw\") pod \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\" (UID: \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\") "
Jul 24 16:34:17.394300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.394176    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0578b378-b95e-48a9-9a5d-8028dfb7ee49-plugins-config-volume\") pod \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\" (UID: \"0578b378-b95e-48a9-9a5d-8028dfb7ee49\") "
Jul 24 16:34:17.394300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.394227    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls\") pod \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") "
Jul 24 16:34:17.394300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.394263    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-openshift-service-ca\") pod \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") "
Jul 24 16:34:17.394300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.394293    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqt9d\" (UniqueName: \"kubernetes.io/projected/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-kube-api-access-dqt9d\") pod \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\" (UID: \"4d5a3d0a-7b65-49ed-af86-acdb6c79b253\") "
Jul 24 16:34:17.394582 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.394553    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0578b378-b95e-48a9-9a5d-8028dfb7ee49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0578b378-b95e-48a9-9a5d-8028dfb7ee49" (UID: "0578b378-b95e-48a9-9a5d-8028dfb7ee49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:17.394686 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.394662    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d5a3d0a-7b65-49ed-af86-acdb6c79b253" (UID: "4d5a3d0a-7b65-49ed-af86-acdb6c79b253"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:17.396227 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.396198    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0578b378-b95e-48a9-9a5d-8028dfb7ee49-kube-api-access-4hvqw" (OuterVolumeSpecName: "kube-api-access-4hvqw") pod "0578b378-b95e-48a9-9a5d-8028dfb7ee49" (UID: "0578b378-b95e-48a9-9a5d-8028dfb7ee49"). InnerVolumeSpecName "kube-api-access-4hvqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:17.396340 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.396313    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-kube-api-access-dqt9d" (OuterVolumeSpecName: "kube-api-access-dqt9d") pod "4d5a3d0a-7b65-49ed-af86-acdb6c79b253" (UID: "4d5a3d0a-7b65-49ed-af86-acdb6c79b253"). InnerVolumeSpecName "kube-api-access-dqt9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:17.396396 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.396330    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d5a3d0a-7b65-49ed-af86-acdb6c79b253" (UID: "4d5a3d0a-7b65-49ed-af86-acdb6c79b253"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:34:17.495073 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.495046    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0578b378-b95e-48a9-9a5d-8028dfb7ee49-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:17.495073 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.495071    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:17.495265 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.495081    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:17.495265 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.495090    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqt9d\" (UniqueName: \"kubernetes.io/projected/4d5a3d0a-7b65-49ed-af86-acdb6c79b253-kube-api-access-dqt9d\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:17.495265 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:17.495100    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hvqw\" (UniqueName: \"kubernetes.io/projected/0578b378-b95e-48a9-9a5d-8028dfb7ee49-kube-api-access-4hvqw\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:18.128898 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.128870    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"
Jul 24 16:34:18.129351 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.128916    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r" event={"ID":"4d5a3d0a-7b65-49ed-af86-acdb6c79b253","Type":"ContainerDied","Data":"7f1ca987d3c892a175e987d23d745fb5b37d5450f26ce67dd704756a81b3be61"}
Jul 24 16:34:18.129351 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.128963    2600 scope.go:117] "RemoveContainer" containerID="aa4c41f0c802a607ad260d54716f0190e6b0db7bf83ff3ba1af7f29c0d0f908a"
Jul 24 16:34:18.130312 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.130289    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn" event={"ID":"0578b378-b95e-48a9-9a5d-8028dfb7ee49","Type":"ContainerDied","Data":"3ff8a366f1d67fbe190ff4a7d9691c1faf3da5fbf87296a35f77fcf7583d95a6"}
Jul 24 16:34:18.130394 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.130299    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"
Jul 24 16:34:18.139501 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.139480    2600 scope.go:117] "RemoveContainer" containerID="43259e3aa45ecf92bdd3e992e8f7412dc2ebc6c32c2a1c659c86a14387ecbf5f"
Jul 24 16:34:18.157049 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.157024    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"]
Jul 24 16:34:18.158787 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.158769    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2ba900-6cdbcf8c9f-5z74r"]
Jul 24 16:34:18.169933 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.169885    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"]
Jul 24 16:34:18.174003 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.173979    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2ba900-7d976497b-hrpsn"]
Jul 24 16:34:18.403082 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.403050    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0578b378-b95e-48a9-9a5d-8028dfb7ee49" path="/var/lib/kubelet/pods/0578b378-b95e-48a9-9a5d-8028dfb7ee49/volumes"
Jul 24 16:34:18.403422 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:18.403410    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d5a3d0a-7b65-49ed-af86-acdb6c79b253" path="/var/lib/kubelet/pods/4d5a3d0a-7b65-49ed-af86-acdb6c79b253/volumes"
Jul 24 16:34:21.291599 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:21.291552    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:21.668760 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:21.668660    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:22.985566 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:22.985525    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:34:27.513873 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:27.513836    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:27.612881 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:27.612847    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:27.791372 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:27.791272    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:28.029956 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:28.029924    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:31.670085 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.670051    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"]
Jul 24 16:34:31.670451 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.670402    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0578b378-b95e-48a9-9a5d-8028dfb7ee49" containerName="payload-pre-processing"
Jul 24 16:34:31.670451 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.670412    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="0578b378-b95e-48a9-9a5d-8028dfb7ee49" containerName="payload-pre-processing"
Jul 24 16:34:31.670451 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.670431    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d5a3d0a-7b65-49ed-af86-acdb6c79b253" containerName="maas-api"
Jul 24 16:34:31.670451 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.670436    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d5a3d0a-7b65-49ed-af86-acdb6c79b253" containerName="maas-api"
Jul 24 16:34:31.670581 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.670509    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d5a3d0a-7b65-49ed-af86-acdb6c79b253" containerName="maas-api"
Jul 24 16:34:31.670581 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.670515    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="0578b378-b95e-48a9-9a5d-8028dfb7ee49" containerName="payload-pre-processing"
Jul 24 16:34:31.675122 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.675105    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"
Jul 24 16:34:31.677833 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.677811    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:34:31.681377 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.681356    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"]
Jul 24 16:34:31.806392 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.806358    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0103c716-673f-416d-8f07-cd637b2e66d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56\" (UID: \"0103c716-673f-416d-8f07-cd637b2e66d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"
Jul 24 16:34:31.907657 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.907628    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0103c716-673f-416d-8f07-cd637b2e66d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56\" (UID: \"0103c716-673f-416d-8f07-cd637b2e66d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"
Jul 24 16:34:31.908241 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.908218    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0103c716-673f-416d-8f07-cd637b2e66d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56\" (UID: \"0103c716-673f-416d-8f07-cd637b2e66d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"
Jul 24 16:34:31.986236 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:31.986208    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"
Jul 24 16:34:32.116579 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:32.116547    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"]
Jul 24 16:34:32.120069 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:34:32.120037    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0103c716_673f_416d_8f07_cd637b2e66d6.slice/crio-3e3d8d0e32c03d1b666ee4776ee8fbd68cabe6c881cfa9ed247232e4b2a807b6 WatchSource:0}: Error finding container 3e3d8d0e32c03d1b666ee4776ee8fbd68cabe6c881cfa9ed247232e4b2a807b6: Status 404 returned error can't find the container with id 3e3d8d0e32c03d1b666ee4776ee8fbd68cabe6c881cfa9ed247232e4b2a807b6
Jul 24 16:34:32.203684 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:32.203649    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56" event={"ID":"0103c716-673f-416d-8f07-cd637b2e66d6","Type":"ContainerStarted","Data":"3e3d8d0e32c03d1b666ee4776ee8fbd68cabe6c881cfa9ed247232e4b2a807b6"}
Jul 24 16:34:33.209860 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:33.209828    2600 generic.go:356] "Generic (PLEG): container finished" podID="0103c716-673f-416d-8f07-cd637b2e66d6" containerID="8e429934684d5a24546dc0e1171d825ef0d11a968023769a65a0022ead141d24" exitCode=0
Jul 24 16:34:33.210239 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:33.209921    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56" event={"ID":"0103c716-673f-416d-8f07-cd637b2e66d6","Type":"ContainerDied","Data":"8e429934684d5a24546dc0e1171d825ef0d11a968023769a65a0022ead141d24"}
Jul 24 16:34:34.351693 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:34.351670    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"
Jul 24 16:34:34.531198 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:34.531130    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0103c716-673f-416d-8f07-cd637b2e66d6-maas-api-service-ca\") pod \"0103c716-673f-416d-8f07-cd637b2e66d6\" (UID: \"0103c716-673f-416d-8f07-cd637b2e66d6\") "
Jul 24 16:34:34.531514 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:34.531493    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0103c716-673f-416d-8f07-cd637b2e66d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0103c716-673f-416d-8f07-cd637b2e66d6" (UID: "0103c716-673f-416d-8f07-cd637b2e66d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:34.632125 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:34.632079    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0103c716-673f-416d-8f07-cd637b2e66d6-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:35.220468 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:35.220440    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"
Jul 24 16:34:35.220468 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:35.220459    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56" event={"ID":"0103c716-673f-416d-8f07-cd637b2e66d6","Type":"ContainerDied","Data":"3e3d8d0e32c03d1b666ee4776ee8fbd68cabe6c881cfa9ed247232e4b2a807b6"}
Jul 24 16:34:35.220724 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:35.220500    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e3d8d0e32c03d1b666ee4776ee8fbd68cabe6c881cfa9ed247232e4b2a807b6"
Jul 24 16:34:47.194842 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.194745    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:34:47.459979 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.459890    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:47.482193 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.482164    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"]
Jul 24 16:34:47.482441 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.482414    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft" podUID="3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377" containerName="payload-processing" containerID="cri-o://9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf" gracePeriod=30
Jul 24 16:34:47.495635 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.495474    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"]
Jul 24 16:34:47.499071 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.499040    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79" podUID="b9a608fa-e705-4ee9-82f2-208fa4167852" containerName="payload-pre-processing" containerID="cri-o://7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66" gracePeriod=30
Jul 24 16:34:47.784588 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.784568    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:34:47.787182 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.787162    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:34:47.838375 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.838333    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-plugins-config-volume\") pod \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\" (UID: \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\") "
Jul 24 16:34:47.838538 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.838481    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75c72\" (UniqueName: \"kubernetes.io/projected/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-kube-api-access-75c72\") pod \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\" (UID: \"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377\") "
Jul 24 16:34:47.838600 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.838587    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sh6s\" (UniqueName: \"kubernetes.io/projected/b9a608fa-e705-4ee9-82f2-208fa4167852-kube-api-access-5sh6s\") pod \"b9a608fa-e705-4ee9-82f2-208fa4167852\" (UID: \"b9a608fa-e705-4ee9-82f2-208fa4167852\") "
Jul 24 16:34:47.838696 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.838679    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a608fa-e705-4ee9-82f2-208fa4167852-plugins-config-volume\") pod \"b9a608fa-e705-4ee9-82f2-208fa4167852\" (UID: \"b9a608fa-e705-4ee9-82f2-208fa4167852\") "
Jul 24 16:34:47.839004 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.838844    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377" (UID: "3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:47.839116 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.839040    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9a608fa-e705-4ee9-82f2-208fa4167852-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9a608fa-e705-4ee9-82f2-208fa4167852" (UID: "b9a608fa-e705-4ee9-82f2-208fa4167852"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:47.840771 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.840748    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-kube-api-access-75c72" (OuterVolumeSpecName: "kube-api-access-75c72") pod "3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377" (UID: "3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377"). InnerVolumeSpecName "kube-api-access-75c72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:47.840884 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.840827    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9a608fa-e705-4ee9-82f2-208fa4167852-kube-api-access-5sh6s" (OuterVolumeSpecName: "kube-api-access-5sh6s") pod "b9a608fa-e705-4ee9-82f2-208fa4167852" (UID: "b9a608fa-e705-4ee9-82f2-208fa4167852"). InnerVolumeSpecName "kube-api-access-5sh6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:47.940088 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.940050    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.940088 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.940084    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75c72\" (UniqueName: \"kubernetes.io/projected/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377-kube-api-access-75c72\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.940088 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.940093    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sh6s\" (UniqueName: \"kubernetes.io/projected/b9a608fa-e705-4ee9-82f2-208fa4167852-kube-api-access-5sh6s\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.940088 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:47.940103    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9a608fa-e705-4ee9-82f2-208fa4167852-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:34:48.284517 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.284482    2600 generic.go:356] "Generic (PLEG): container finished" podID="3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377" containerID="9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf" exitCode=0
Jul 24 16:34:48.285008 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.284544    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"
Jul 24 16:34:48.285008 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.284567    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft" event={"ID":"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377","Type":"ContainerDied","Data":"9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf"}
Jul 24 16:34:48.285008 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.284659    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft" event={"ID":"3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377","Type":"ContainerDied","Data":"7fd2b902d7ce57bbbe0a877c7f662970e4f3f35ce6726584b2342d72b5f8e1a6"}
Jul 24 16:34:48.285008 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.284683    2600 scope.go:117] "RemoveContainer" containerID="9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf"
Jul 24 16:34:48.285960 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.285937    2600 generic.go:356] "Generic (PLEG): container finished" podID="b9a608fa-e705-4ee9-82f2-208fa4167852" containerID="7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66" exitCode=0
Jul 24 16:34:48.286058 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.285991    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79" event={"ID":"b9a608fa-e705-4ee9-82f2-208fa4167852","Type":"ContainerDied","Data":"7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66"}
Jul 24 16:34:48.286058 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.285998    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"
Jul 24 16:34:48.286058 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.286034    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79" event={"ID":"b9a608fa-e705-4ee9-82f2-208fa4167852","Type":"ContainerDied","Data":"5aaa21bafb38c96b8023dbc1240454dc9fe8764055924fec8b1c2e6848e70252"}
Jul 24 16:34:48.293753 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.293743    2600 scope.go:117] "RemoveContainer" containerID="9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf"
Jul 24 16:34:48.293995 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:34:48.293970    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf\": container with ID starting with 9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf not found: ID does not exist" containerID="9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf"
Jul 24 16:34:48.294067 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.294003    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf"} err="failed to get container status \"9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf\": rpc error: code = NotFound desc = could not find container \"9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf\": container with ID starting with 9a1d80e1fcfad2326ce5a0883a36561113ebb7194df841d5609541d011420ebf not found: ID does not exist"
Jul 24 16:34:48.294067 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.294027    2600 scope.go:117] "RemoveContainer" containerID="7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66"
Jul 24 16:34:48.301568 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.301552    2600 scope.go:117] "RemoveContainer" containerID="7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66"
Jul 24 16:34:48.301840 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:34:48.301821    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66\": container with ID starting with 7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66 not found: ID does not exist" containerID="7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66"
Jul 24 16:34:48.301904 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.301848    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66"} err="failed to get container status \"7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66\": rpc error: code = NotFound desc = could not find container \"7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66\": container with ID starting with 7923fd31b65314c8799770172ad64adad8116e86b064a482a8a37938c7d8ca66 not found: ID does not exist"
Jul 24 16:34:48.307928 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.307907    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"]
Jul 24 16:34:48.312069 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.312050    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-0107ee-867fb59fdb-rc4ft"]
Jul 24 16:34:48.323851 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.323833    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"]
Jul 24 16:34:48.328158 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.328138    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-0107ee-6cb68d7864-khh79"]
Jul 24 16:34:48.402935 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.402911    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377" path="/var/lib/kubelet/pods/3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377/volumes"
Jul 24 16:34:48.403300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.403287    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9a608fa-e705-4ee9-82f2-208fa4167852" path="/var/lib/kubelet/pods/b9a608fa-e705-4ee9-82f2-208fa4167852/volumes"
Jul 24 16:34:48.758221 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:48.758184    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:51.747830 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:51.747798    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"]
Jul 24 16:34:51.751443 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:51.751417    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0107ee-l9s56"]
Jul 24 16:34:51.752086 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:51.752046    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:52.144521 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:52.144428    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:52.402769 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:52.402697    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0103c716-673f-416d-8f07-cd637b2e66d6" path="/var/lib/kubelet/pods/0103c716-673f-416d-8f07-cd637b2e66d6/volumes"
Jul 24 16:34:57.220643 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:57.220589    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:34:57.788202 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:34:57.788175    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:35:33.973226 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:33.973190    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:34.553649 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:34.553593    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:40.037220 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:40.037160    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:45.658956 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:45.658912    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:45.776974 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:45.776943    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:45.942966 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:45.942937    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:46.185666 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.185633    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:46.317708 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.317634    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"]
Jul 24 16:35:46.318008 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.317995    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377" containerName="payload-processing"
Jul 24 16:35:46.318068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.318009    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377" containerName="payload-processing"
Jul 24 16:35:46.318068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.318034    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0103c716-673f-416d-8f07-cd637b2e66d6" containerName="revoke-keys"
Jul 24 16:35:46.318068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.318040    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="0103c716-673f-416d-8f07-cd637b2e66d6" containerName="revoke-keys"
Jul 24 16:35:46.318068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.318058    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a608fa-e705-4ee9-82f2-208fa4167852" containerName="payload-pre-processing"
Jul 24 16:35:46.318068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.318063    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a608fa-e705-4ee9-82f2-208fa4167852" containerName="payload-pre-processing"
Jul 24 16:35:46.318250 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.318113    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="0103c716-673f-416d-8f07-cd637b2e66d6" containerName="revoke-keys"
Jul 24 16:35:46.318250 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.318124    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9a608fa-e705-4ee9-82f2-208fa4167852" containerName="payload-pre-processing"
Jul 24 16:35:46.318250 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.318130    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d1f9188-c6c4-4d29-8fc7-1f3fb57b5377" containerName="payload-processing"
Jul 24 16:35:46.321057 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.321041    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"
Jul 24 16:35:46.323464 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.323446    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:35:46.328963 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.328934    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"]
Jul 24 16:35:46.433864 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.433832    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c94f13-c030-4e7a-a8c2-9bbfbaa8607d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg\" (UID: \"85c94f13-c030-4e7a-a8c2-9bbfbaa8607d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"
Jul 24 16:35:46.535067 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.535034    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c94f13-c030-4e7a-a8c2-9bbfbaa8607d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg\" (UID: \"85c94f13-c030-4e7a-a8c2-9bbfbaa8607d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"
Jul 24 16:35:46.535664 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.535645    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c94f13-c030-4e7a-a8c2-9bbfbaa8607d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg\" (UID: \"85c94f13-c030-4e7a-a8c2-9bbfbaa8607d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"
Jul 24 16:35:46.633253 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.633171    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"
Jul 24 16:35:46.768111 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:46.768077    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"]
Jul 24 16:35:46.770987 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:35:46.770962    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c94f13_c030_4e7a_a8c2_9bbfbaa8607d.slice/crio-8d058fa5bd2aeb212392050d72540f5b55372993a77867d3e0ceaf46ee3196f8 WatchSource:0}: Error finding container 8d058fa5bd2aeb212392050d72540f5b55372993a77867d3e0ceaf46ee3196f8: Status 404 returned error can't find the container with id 8d058fa5bd2aeb212392050d72540f5b55372993a77867d3e0ceaf46ee3196f8
Jul 24 16:35:47.566233 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:47.566200    2600 generic.go:356] "Generic (PLEG): container finished" podID="85c94f13-c030-4e7a-a8c2-9bbfbaa8607d" containerID="703902cba8482e71e6923803aa645b4d7c4b47b61773ff7c04ba1ba68dda3d23" exitCode=0
Jul 24 16:35:47.566398 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:47.566297    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg" event={"ID":"85c94f13-c030-4e7a-a8c2-9bbfbaa8607d","Type":"ContainerDied","Data":"703902cba8482e71e6923803aa645b4d7c4b47b61773ff7c04ba1ba68dda3d23"}
Jul 24 16:35:47.566398 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:47.566357    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg" event={"ID":"85c94f13-c030-4e7a-a8c2-9bbfbaa8607d","Type":"ContainerStarted","Data":"8d058fa5bd2aeb212392050d72540f5b55372993a77867d3e0ceaf46ee3196f8"}
Jul 24 16:35:48.711327 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:48.711298    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"
Jul 24 16:35:48.753693 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:48.753663    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c94f13-c030-4e7a-a8c2-9bbfbaa8607d-maas-api-service-ca\") pod \"85c94f13-c030-4e7a-a8c2-9bbfbaa8607d\" (UID: \"85c94f13-c030-4e7a-a8c2-9bbfbaa8607d\") "
Jul 24 16:35:48.754074 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:48.754051    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85c94f13-c030-4e7a-a8c2-9bbfbaa8607d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85c94f13-c030-4e7a-a8c2-9bbfbaa8607d" (UID: "85c94f13-c030-4e7a-a8c2-9bbfbaa8607d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:35:48.854637 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:48.854550    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c94f13-c030-4e7a-a8c2-9bbfbaa8607d-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:35:49.576721 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:49.576683    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg" event={"ID":"85c94f13-c030-4e7a-a8c2-9bbfbaa8607d","Type":"ContainerDied","Data":"8d058fa5bd2aeb212392050d72540f5b55372993a77867d3e0ceaf46ee3196f8"}
Jul 24 16:35:49.576891 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:49.576739    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"
Jul 24 16:35:49.576891 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:49.576742    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d058fa5bd2aeb212392050d72540f5b55372993a77867d3e0ceaf46ee3196f8"
Jul 24 16:35:56.730304 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:56.730271    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"]
Jul 24 16:35:56.730796 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:56.730520    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v" podUID="58e700a7-adcf-4909-8c1c-ec9f01e44ac0" containerName="maas-api" containerID="cri-o://0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8" gracePeriod=30
Jul 24 16:35:56.760070 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:56.760041    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:56.797232 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:56.797199    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"]
Jul 24 16:35:56.797426 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:56.797403    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf" podUID="1e5a09c8-d9be-4ac3-b84f-0cc68973c5af" containerName="payload-pre-processing" containerID="cri-o://5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba" gracePeriod=30
Jul 24 16:35:56.860796 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:56.860756    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:56.968149 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:56.968112    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:57.054502 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.054479    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:35:57.088149 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.088126    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:35:57.126026 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.126000    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bw6b\" (UniqueName: \"kubernetes.io/projected/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-kube-api-access-6bw6b\") pod \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\" (UID: \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\") "
Jul 24 16:35:57.126150 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.126045    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-openshift-service-ca\") pod \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") "
Jul 24 16:35:57.126150 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.126085    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls\") pod \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") "
Jul 24 16:35:57.126150 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.126114    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-plugins-config-volume\") pod \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\" (UID: \"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af\") "
Jul 24 16:35:57.126326 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.126193    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6brt\" (UniqueName: \"kubernetes.io/projected/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-kube-api-access-h6brt\") pod \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\" (UID: \"58e700a7-adcf-4909-8c1c-ec9f01e44ac0\") "
Jul 24 16:35:57.126502 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.126482    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58e700a7-adcf-4909-8c1c-ec9f01e44ac0" (UID: "58e700a7-adcf-4909-8c1c-ec9f01e44ac0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:35:57.126565 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.126508    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e5a09c8-d9be-4ac3-b84f-0cc68973c5af" (UID: "1e5a09c8-d9be-4ac3-b84f-0cc68973c5af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:35:57.128260 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.128234    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-kube-api-access-6bw6b" (OuterVolumeSpecName: "kube-api-access-6bw6b") pod "1e5a09c8-d9be-4ac3-b84f-0cc68973c5af" (UID: "1e5a09c8-d9be-4ac3-b84f-0cc68973c5af"). InnerVolumeSpecName "kube-api-access-6bw6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:35:57.128339 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.128277    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58e700a7-adcf-4909-8c1c-ec9f01e44ac0" (UID: "58e700a7-adcf-4909-8c1c-ec9f01e44ac0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:35:57.128339 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.128295    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-kube-api-access-h6brt" (OuterVolumeSpecName: "kube-api-access-h6brt") pod "58e700a7-adcf-4909-8c1c-ec9f01e44ac0" (UID: "58e700a7-adcf-4909-8c1c-ec9f01e44ac0"). InnerVolumeSpecName "kube-api-access-h6brt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:35:57.168506 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.168480    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:35:57.227796 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.227775    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:35:57.227796 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.227795    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:35:57.227910 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.227806    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:35:57.227910 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.227815    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6brt\" (UniqueName: \"kubernetes.io/projected/58e700a7-adcf-4909-8c1c-ec9f01e44ac0-kube-api-access-h6brt\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:35:57.227910 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.227823    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bw6b\" (UniqueName: \"kubernetes.io/projected/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af-kube-api-access-6bw6b\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:35:57.614398 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.614368    2600 generic.go:356] "Generic (PLEG): container finished" podID="58e700a7-adcf-4909-8c1c-ec9f01e44ac0" containerID="0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8" exitCode=0
Jul 24 16:35:57.614640 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.614410    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"
Jul 24 16:35:57.614640 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.614452    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v" event={"ID":"58e700a7-adcf-4909-8c1c-ec9f01e44ac0","Type":"ContainerDied","Data":"0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8"}
Jul 24 16:35:57.614640 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.614506    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v" event={"ID":"58e700a7-adcf-4909-8c1c-ec9f01e44ac0","Type":"ContainerDied","Data":"342576aa38758bcfdb4d7d595dab9dd47579f114ce2356180830d10c99bcc886"}
Jul 24 16:35:57.614640 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.614528    2600 scope.go:117] "RemoveContainer" containerID="0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8"
Jul 24 16:35:57.615835 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.615818    2600 generic.go:356] "Generic (PLEG): container finished" podID="1e5a09c8-d9be-4ac3-b84f-0cc68973c5af" containerID="5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba" exitCode=0
Jul 24 16:35:57.615912 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.615860    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf" event={"ID":"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af","Type":"ContainerDied","Data":"5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba"}
Jul 24 16:35:57.615912 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.615872    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"
Jul 24 16:35:57.615912 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.615897    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf" event={"ID":"1e5a09c8-d9be-4ac3-b84f-0cc68973c5af","Type":"ContainerDied","Data":"c2741df1fd7013d71aad4e7da386c989ffee9beccbdfc22dc2b7b64b8d759079"}
Jul 24 16:35:57.624133 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.624068    2600 scope.go:117] "RemoveContainer" containerID="0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8"
Jul 24 16:35:57.624383 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:35:57.624360    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8\": container with ID starting with 0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8 not found: ID does not exist" containerID="0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8"
Jul 24 16:35:57.624444 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.624394    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8"} err="failed to get container status \"0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8\": rpc error: code = NotFound desc = could not find container \"0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8\": container with ID starting with 0ea1dedc84ac20309feb39533d7bb9115199c74b04df458a78d135d61775e8f8 not found: ID does not exist"
Jul 24 16:35:57.624444 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.624418    2600 scope.go:117] "RemoveContainer" containerID="5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba"
Jul 24 16:35:57.631904 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.631886    2600 scope.go:117] "RemoveContainer" containerID="5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba"
Jul 24 16:35:57.632140 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:35:57.632123    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba\": container with ID starting with 5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba not found: ID does not exist" containerID="5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba"
Jul 24 16:35:57.632194 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.632148    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba"} err="failed to get container status \"5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba\": rpc error: code = NotFound desc = could not find container \"5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba\": container with ID starting with 5a644d35970b10d0c97490774f4381cc4644c0cf81d1e6cd496c855f6eeee0ba not found: ID does not exist"
Jul 24 16:35:57.636751 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.636730    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"]
Jul 24 16:35:57.640825 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.640809    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-52d140-59d759fff5-6zl9v"]
Jul 24 16:35:57.650959 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.650938    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"]
Jul 24 16:35:57.654709 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:57.654693    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-52d140-6cb97f4d68-54wtf"]
Jul 24 16:35:58.403401 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:58.403361    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e5a09c8-d9be-4ac3-b84f-0cc68973c5af" path="/var/lib/kubelet/pods/1e5a09c8-d9be-4ac3-b84f-0cc68973c5af/volumes"
Jul 24 16:35:58.403840 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:35:58.403804    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e700a7-adcf-4909-8c1c-ec9f01e44ac0" path="/var/lib/kubelet/pods/58e700a7-adcf-4909-8c1c-ec9f01e44ac0/volumes"
Jul 24 16:36:00.084492 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:00.084443    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:36:01.388359 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:01.388323    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"]
Jul 24 16:36:01.389132 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:01.389098    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:01.391686 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:01.391661    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-52d140-v59lg"]
Jul 24 16:36:01.853426 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:01.853392    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:02.403241 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:02.403206    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85c94f13-c030-4e7a-a8c2-9bbfbaa8607d" path="/var/lib/kubelet/pods/85c94f13-c030-4e7a-a8c2-9bbfbaa8607d/volumes"
Jul 24 16:36:08.043559 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:08.043528    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:08.148036 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:08.148001    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:08.355176 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:08.355087    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:08.571185 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:08.571150    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:19.444057 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.443970    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"]
Jul 24 16:36:19.444493 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.444345    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j" podUID="1727dc08-95a6-4a3e-9406-b1e84ab9d242" containerName="maas-api" containerID="cri-o://cc803056a09cde0ba1ba3213b64aee31476f8119004d6312a363fe98df575959" gracePeriod=30
Jul 24 16:36:19.479421 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.479397    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"]
Jul 24 16:36:19.484372 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.484348    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-764b09-29748510-4kvxc"]
Jul 24 16:36:19.485009 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.484991    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:19.508093 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.508071    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"]
Jul 24 16:36:19.508305 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.508283    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l" podUID="f450370f-6f6f-42fc-9771-aa91a34510fa" containerName="payload-processing" containerID="cri-o://f61a1b35ca9fc6b0dd50a822852bde32c45999c776172157efcf516646957b4c" gracePeriod=30
Jul 24 16:36:19.512717 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.512687    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"]
Jul 24 16:36:19.512950 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.512896    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf" podUID="b29add0e-0856-45ef-9a96-33ae4c3b6991" containerName="payload-pre-processing" containerID="cri-o://6bb6c97e5df7d3e3166a0cb7767ae1ed691a6819374427c5d833a156d8b4e92e" gracePeriod=30
Jul 24 16:36:19.551127 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.551099    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:19.620882 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.620717    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:19.721625 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.721510    2600 generic.go:356] "Generic (PLEG): container finished" podID="f450370f-6f6f-42fc-9771-aa91a34510fa" containerID="f61a1b35ca9fc6b0dd50a822852bde32c45999c776172157efcf516646957b4c" exitCode=0
Jul 24 16:36:19.721625 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.721586    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l" event={"ID":"f450370f-6f6f-42fc-9771-aa91a34510fa","Type":"ContainerDied","Data":"f61a1b35ca9fc6b0dd50a822852bde32c45999c776172157efcf516646957b4c"}
Jul 24 16:36:19.723373 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.723346    2600 generic.go:356] "Generic (PLEG): container finished" podID="b29add0e-0856-45ef-9a96-33ae4c3b6991" containerID="6bb6c97e5df7d3e3166a0cb7767ae1ed691a6819374427c5d833a156d8b4e92e" exitCode=0
Jul 24 16:36:19.723531 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.723415    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf" event={"ID":"b29add0e-0856-45ef-9a96-33ae4c3b6991","Type":"ContainerDied","Data":"6bb6c97e5df7d3e3166a0cb7767ae1ed691a6819374427c5d833a156d8b4e92e"}
Jul 24 16:36:19.725209 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.725186    2600 generic.go:356] "Generic (PLEG): container finished" podID="1727dc08-95a6-4a3e-9406-b1e84ab9d242" containerID="cc803056a09cde0ba1ba3213b64aee31476f8119004d6312a363fe98df575959" exitCode=0
Jul 24 16:36:19.725322 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.725259    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j" event={"ID":"1727dc08-95a6-4a3e-9406-b1e84ab9d242","Type":"ContainerDied","Data":"cc803056a09cde0ba1ba3213b64aee31476f8119004d6312a363fe98df575959"}
Jul 24 16:36:19.763469 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.763423    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:36:19.798109 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.798082    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:36:19.807903 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.807881    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:36:19.899391 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899358    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4mgd\" (UniqueName: \"kubernetes.io/projected/b29add0e-0856-45ef-9a96-33ae4c3b6991-kube-api-access-m4mgd\") pod \"b29add0e-0856-45ef-9a96-33ae4c3b6991\" (UID: \"b29add0e-0856-45ef-9a96-33ae4c3b6991\") "
Jul 24 16:36:19.899559 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899396    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr8tb\" (UniqueName: \"kubernetes.io/projected/1727dc08-95a6-4a3e-9406-b1e84ab9d242-kube-api-access-xr8tb\") pod \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") "
Jul 24 16:36:19.899559 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899420    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls\") pod \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") "
Jul 24 16:36:19.899559 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899454    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29add0e-0856-45ef-9a96-33ae4c3b6991-plugins-config-volume\") pod \"b29add0e-0856-45ef-9a96-33ae4c3b6991\" (UID: \"b29add0e-0856-45ef-9a96-33ae4c3b6991\") "
Jul 24 16:36:19.899559 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899492    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1727dc08-95a6-4a3e-9406-b1e84ab9d242-openshift-service-ca\") pod \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\" (UID: \"1727dc08-95a6-4a3e-9406-b1e84ab9d242\") "
Jul 24 16:36:19.899559 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899518    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f450370f-6f6f-42fc-9771-aa91a34510fa-plugins-config-volume\") pod \"f450370f-6f6f-42fc-9771-aa91a34510fa\" (UID: \"f450370f-6f6f-42fc-9771-aa91a34510fa\") "
Jul 24 16:36:19.899559 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899553    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dz8t\" (UniqueName: \"kubernetes.io/projected/f450370f-6f6f-42fc-9771-aa91a34510fa-kube-api-access-4dz8t\") pod \"f450370f-6f6f-42fc-9771-aa91a34510fa\" (UID: \"f450370f-6f6f-42fc-9771-aa91a34510fa\") "
Jul 24 16:36:19.899976 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899916    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1727dc08-95a6-4a3e-9406-b1e84ab9d242-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1727dc08-95a6-4a3e-9406-b1e84ab9d242" (UID: "1727dc08-95a6-4a3e-9406-b1e84ab9d242"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:19.899976 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899931    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29add0e-0856-45ef-9a96-33ae4c3b6991-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b29add0e-0856-45ef-9a96-33ae4c3b6991" (UID: "b29add0e-0856-45ef-9a96-33ae4c3b6991"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:19.899976 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.899934    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f450370f-6f6f-42fc-9771-aa91a34510fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f450370f-6f6f-42fc-9771-aa91a34510fa" (UID: "f450370f-6f6f-42fc-9771-aa91a34510fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:19.901777 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.901756    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1727dc08-95a6-4a3e-9406-b1e84ab9d242" (UID: "1727dc08-95a6-4a3e-9406-b1e84ab9d242"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:36:19.901896 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.901883    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f450370f-6f6f-42fc-9771-aa91a34510fa-kube-api-access-4dz8t" (OuterVolumeSpecName: "kube-api-access-4dz8t") pod "f450370f-6f6f-42fc-9771-aa91a34510fa" (UID: "f450370f-6f6f-42fc-9771-aa91a34510fa"). InnerVolumeSpecName "kube-api-access-4dz8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:19.902092 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.902069    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1727dc08-95a6-4a3e-9406-b1e84ab9d242-kube-api-access-xr8tb" (OuterVolumeSpecName: "kube-api-access-xr8tb") pod "1727dc08-95a6-4a3e-9406-b1e84ab9d242" (UID: "1727dc08-95a6-4a3e-9406-b1e84ab9d242"). InnerVolumeSpecName "kube-api-access-xr8tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:19.902092 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:19.902079    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29add0e-0856-45ef-9a96-33ae4c3b6991-kube-api-access-m4mgd" (OuterVolumeSpecName: "kube-api-access-m4mgd") pod "b29add0e-0856-45ef-9a96-33ae4c3b6991" (UID: "b29add0e-0856-45ef-9a96-33ae4c3b6991"). InnerVolumeSpecName "kube-api-access-m4mgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:20.001168 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.001109    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4mgd\" (UniqueName: \"kubernetes.io/projected/b29add0e-0856-45ef-9a96-33ae4c3b6991-kube-api-access-m4mgd\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:20.001168 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.001131    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr8tb\" (UniqueName: \"kubernetes.io/projected/1727dc08-95a6-4a3e-9406-b1e84ab9d242-kube-api-access-xr8tb\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:20.001168 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.001141    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1727dc08-95a6-4a3e-9406-b1e84ab9d242-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:20.001168 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.001151    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29add0e-0856-45ef-9a96-33ae4c3b6991-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:20.001168 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.001160    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1727dc08-95a6-4a3e-9406-b1e84ab9d242-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:20.001168 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.001169    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f450370f-6f6f-42fc-9771-aa91a34510fa-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:20.001429 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.001177    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dz8t\" (UniqueName: \"kubernetes.io/projected/f450370f-6f6f-42fc-9771-aa91a34510fa-kube-api-access-4dz8t\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:20.403330 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.403254    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0948c40-06a0-4ee1-8559-cd91ac31363d" path="/var/lib/kubelet/pods/d0948c40-06a0-4ee1-8559-cd91ac31363d/volumes"
Jul 24 16:36:20.730807 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.730785    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"
Jul 24 16:36:20.731243 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.730820    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j" event={"ID":"1727dc08-95a6-4a3e-9406-b1e84ab9d242","Type":"ContainerDied","Data":"1acbe63aab7415152c312e348ac894f46407b793fd02dda7a77b23f609ea3107"}
Jul 24 16:36:20.731243 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.730886    2600 scope.go:117] "RemoveContainer" containerID="cc803056a09cde0ba1ba3213b64aee31476f8119004d6312a363fe98df575959"
Jul 24 16:36:20.732307 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.732290    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"
Jul 24 16:36:20.732410 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.732302    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l" event={"ID":"f450370f-6f6f-42fc-9771-aa91a34510fa","Type":"ContainerDied","Data":"8bb1fbd774aa42fed2ad7b7ea6d4ed2aa0249bc6235dbcff9f240082cfc9f68a"}
Jul 24 16:36:20.733864 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.733843    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf" event={"ID":"b29add0e-0856-45ef-9a96-33ae4c3b6991","Type":"ContainerDied","Data":"f4accfcb6c39b6b18dad750242051a0890d038d809eeb88011a43a922810ec58"}
Jul 24 16:36:20.733864 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.733855    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"
Jul 24 16:36:20.740289 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.740268    2600 scope.go:117] "RemoveContainer" containerID="f61a1b35ca9fc6b0dd50a822852bde32c45999c776172157efcf516646957b4c"
Jul 24 16:36:20.747924 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.747907    2600 scope.go:117] "RemoveContainer" containerID="6bb6c97e5df7d3e3166a0cb7767ae1ed691a6819374427c5d833a156d8b4e92e"
Jul 24 16:36:20.754710 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.754684    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"]
Jul 24 16:36:20.760813 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.760792    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-764b09-77df88c8b6-q6d9j"]
Jul 24 16:36:20.770714 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.770694    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"]
Jul 24 16:36:20.774728 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.774708    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-764b09-5b5df8c66b-4rp4l"]
Jul 24 16:36:20.785164 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.785106    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"]
Jul 24 16:36:20.786796 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:20.786780    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-764b09-7548dff7b4-hc9kf"]
Jul 24 16:36:22.403231 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:22.403198    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1727dc08-95a6-4a3e-9406-b1e84ab9d242" path="/var/lib/kubelet/pods/1727dc08-95a6-4a3e-9406-b1e84ab9d242/volumes"
Jul 24 16:36:22.403756 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:22.403735    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b29add0e-0856-45ef-9a96-33ae4c3b6991" path="/var/lib/kubelet/pods/b29add0e-0856-45ef-9a96-33ae4c3b6991/volumes"
Jul 24 16:36:22.404130 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:22.404113    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f450370f-6f6f-42fc-9771-aa91a34510fa" path="/var/lib/kubelet/pods/f450370f-6f6f-42fc-9771-aa91a34510fa/volumes"
Jul 24 16:36:22.590386 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:22.585943    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:36:23.790261 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:23.790229    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:24.203314 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:24.203281    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:26.745756 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:26.745731    2600 scope.go:117] "RemoveContainer" containerID="6f45f0c409b4cf7daa883fcad74d2278b40bf010cac8e9379026bf51279ee19d"
Jul 24 16:36:30.081227 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.081190    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:30.147852 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.147806    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:30.347407 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.347299    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:30.591823 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.591795    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:30.713368 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713331    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"]
Jul 24 16:36:30.713751 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713735    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1727dc08-95a6-4a3e-9406-b1e84ab9d242" containerName="maas-api"
Jul 24 16:36:30.713846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713755    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1727dc08-95a6-4a3e-9406-b1e84ab9d242" containerName="maas-api"
Jul 24 16:36:30.713846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713774    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e5a09c8-d9be-4ac3-b84f-0cc68973c5af" containerName="payload-pre-processing"
Jul 24 16:36:30.713846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713782    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5a09c8-d9be-4ac3-b84f-0cc68973c5af" containerName="payload-pre-processing"
Jul 24 16:36:30.713846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713794    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f450370f-6f6f-42fc-9771-aa91a34510fa" containerName="payload-processing"
Jul 24 16:36:30.713846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713802    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="f450370f-6f6f-42fc-9771-aa91a34510fa" containerName="payload-processing"
Jul 24 16:36:30.713846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713813    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e700a7-adcf-4909-8c1c-ec9f01e44ac0" containerName="maas-api"
Jul 24 16:36:30.713846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713823    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e700a7-adcf-4909-8c1c-ec9f01e44ac0" containerName="maas-api"
Jul 24 16:36:30.713846 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713840    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85c94f13-c030-4e7a-a8c2-9bbfbaa8607d" containerName="revoke-keys"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713850    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="85c94f13-c030-4e7a-a8c2-9bbfbaa8607d" containerName="revoke-keys"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713861    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29add0e-0856-45ef-9a96-33ae4c3b6991" containerName="payload-pre-processing"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713869    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29add0e-0856-45ef-9a96-33ae4c3b6991" containerName="payload-pre-processing"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713945    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e5a09c8-d9be-4ac3-b84f-0cc68973c5af" containerName="payload-pre-processing"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713960    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29add0e-0856-45ef-9a96-33ae4c3b6991" containerName="payload-pre-processing"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713969    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e700a7-adcf-4909-8c1c-ec9f01e44ac0" containerName="maas-api"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713978    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="85c94f13-c030-4e7a-a8c2-9bbfbaa8607d" containerName="revoke-keys"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713988    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="1727dc08-95a6-4a3e-9406-b1e84ab9d242" containerName="maas-api"
Jul 24 16:36:30.714251 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.713999    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="f450370f-6f6f-42fc-9771-aa91a34510fa" containerName="payload-processing"
Jul 24 16:36:30.718828 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.718808    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"
Jul 24 16:36:30.721548 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.721525    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kv2w9\""
Jul 24 16:36:30.724064 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.724042    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"]
Jul 24 16:36:30.882362 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.882333    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4ebad6-6461-426d-85ca-336fea5f9937-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-82adcb-667sp\" (UID: \"4d4ebad6-6461-426d-85ca-336fea5f9937\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"
Jul 24 16:36:30.983524 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.983456    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4ebad6-6461-426d-85ca-336fea5f9937-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-82adcb-667sp\" (UID: \"4d4ebad6-6461-426d-85ca-336fea5f9937\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"
Jul 24 16:36:30.984115 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:30.984097    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4ebad6-6461-426d-85ca-336fea5f9937-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-82adcb-667sp\" (UID: \"4d4ebad6-6461-426d-85ca-336fea5f9937\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"
Jul 24 16:36:31.039180 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:31.039160    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"
Jul 24 16:36:31.169274 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:31.169251    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"]
Jul 24 16:36:31.171240 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:36:31.171212    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4ebad6_6461_426d_85ca_336fea5f9937.slice/crio-461647ce47e1f29d0d5d61164ff6e6c4cdec74a8f5d83fbcf907b935ab1d73ae WatchSource:0}: Error finding container 461647ce47e1f29d0d5d61164ff6e6c4cdec74a8f5d83fbcf907b935ab1d73ae: Status 404 returned error can't find the container with id 461647ce47e1f29d0d5d61164ff6e6c4cdec74a8f5d83fbcf907b935ab1d73ae
Jul 24 16:36:31.793465 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:31.793387    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp" event={"ID":"4d4ebad6-6461-426d-85ca-336fea5f9937","Type":"ContainerStarted","Data":"a80585737e06e4782ba4da5d117d91c74d03043b8bfe50f49ae12b65385b1172"}
Jul 24 16:36:31.793465 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:31.793445    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp" event={"ID":"4d4ebad6-6461-426d-85ca-336fea5f9937","Type":"ContainerStarted","Data":"461647ce47e1f29d0d5d61164ff6e6c4cdec74a8f5d83fbcf907b935ab1d73ae"}
Jul 24 16:36:31.809501 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:31.809454    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp" podStartSLOduration=1.80944031 podStartE2EDuration="1.80944031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:36:31.80744195 +0000 UTC m=+3065.965308651" watchObservedRunningTime="2026-07-24 16:36:31.80944031 +0000 UTC m=+3065.967307009"
Jul 24 16:36:32.799657 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:32.799598    2600 generic.go:356] "Generic (PLEG): container finished" podID="4d4ebad6-6461-426d-85ca-336fea5f9937" containerID="a80585737e06e4782ba4da5d117d91c74d03043b8bfe50f49ae12b65385b1172" exitCode=0
Jul 24 16:36:32.800038 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:32.799716    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp" event={"ID":"4d4ebad6-6461-426d-85ca-336fea5f9937","Type":"ContainerDied","Data":"a80585737e06e4782ba4da5d117d91c74d03043b8bfe50f49ae12b65385b1172"}
Jul 24 16:36:33.932838 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:33.932816    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"
Jul 24 16:36:34.107733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:34.107661    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4ebad6-6461-426d-85ca-336fea5f9937-maas-api-service-ca\") pod \"4d4ebad6-6461-426d-85ca-336fea5f9937\" (UID: \"4d4ebad6-6461-426d-85ca-336fea5f9937\") "
Jul 24 16:36:34.108035 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:34.108009    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d4ebad6-6461-426d-85ca-336fea5f9937-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d4ebad6-6461-426d-85ca-336fea5f9937" (UID: "4d4ebad6-6461-426d-85ca-336fea5f9937"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:34.208325 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:34.208296    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4ebad6-6461-426d-85ca-336fea5f9937-maas-api-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:34.810117 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:34.810082    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp" event={"ID":"4d4ebad6-6461-426d-85ca-336fea5f9937","Type":"ContainerDied","Data":"461647ce47e1f29d0d5d61164ff6e6c4cdec74a8f5d83fbcf907b935ab1d73ae"}
Jul 24 16:36:34.810269 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:34.810134    2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="461647ce47e1f29d0d5d61164ff6e6c4cdec74a8f5d83fbcf907b935ab1d73ae"
Jul 24 16:36:34.810269 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:34.810096    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"
Jul 24 16:36:41.094903 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.094867    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"]
Jul 24 16:36:41.095338 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.095177    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc" podUID="2319138c-fe27-4f8b-b2fa-64da016e6fae" containerName="maas-api" containerID="cri-o://55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5" gracePeriod=30
Jul 24 16:36:41.124635 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.124583    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"]
Jul 24 16:36:41.126357 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.126329    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-82adcb-29748510-l2nzm"]
Jul 24 16:36:41.136090 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.136068    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:41.165698 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.165673    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"]
Jul 24 16:36:41.165939 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.165902    2600 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl" podUID="a24db291-dae7-40d5-b9e4-1567a7b9be26" containerName="payload-pre-processing" containerID="cri-o://c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5" gracePeriod=30
Jul 24 16:36:41.237082 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.237052    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:41.339316 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.339214    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:41.431630 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.431595    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:36:41.438040 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.438017    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:36:41.567364 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.567339    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2319138c-fe27-4f8b-b2fa-64da016e6fae-maas-api-tls\") pod \"2319138c-fe27-4f8b-b2fa-64da016e6fae\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") "
Jul 24 16:36:41.567536 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.567386    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7mxs\" (UniqueName: \"kubernetes.io/projected/2319138c-fe27-4f8b-b2fa-64da016e6fae-kube-api-access-t7mxs\") pod \"2319138c-fe27-4f8b-b2fa-64da016e6fae\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") "
Jul 24 16:36:41.567536 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.567430    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2mbx\" (UniqueName: \"kubernetes.io/projected/a24db291-dae7-40d5-b9e4-1567a7b9be26-kube-api-access-x2mbx\") pod \"a24db291-dae7-40d5-b9e4-1567a7b9be26\" (UID: \"a24db291-dae7-40d5-b9e4-1567a7b9be26\") "
Jul 24 16:36:41.567536 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.567464    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24db291-dae7-40d5-b9e4-1567a7b9be26-plugins-config-volume\") pod \"a24db291-dae7-40d5-b9e4-1567a7b9be26\" (UID: \"a24db291-dae7-40d5-b9e4-1567a7b9be26\") "
Jul 24 16:36:41.567536 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.567487    2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2319138c-fe27-4f8b-b2fa-64da016e6fae-openshift-service-ca\") pod \"2319138c-fe27-4f8b-b2fa-64da016e6fae\" (UID: \"2319138c-fe27-4f8b-b2fa-64da016e6fae\") "
Jul 24 16:36:41.567953 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.567904    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2319138c-fe27-4f8b-b2fa-64da016e6fae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2319138c-fe27-4f8b-b2fa-64da016e6fae" (UID: "2319138c-fe27-4f8b-b2fa-64da016e6fae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:41.567953 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.567908    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a24db291-dae7-40d5-b9e4-1567a7b9be26-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a24db291-dae7-40d5-b9e4-1567a7b9be26" (UID: "a24db291-dae7-40d5-b9e4-1567a7b9be26"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:41.569424 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.569404    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2319138c-fe27-4f8b-b2fa-64da016e6fae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2319138c-fe27-4f8b-b2fa-64da016e6fae" (UID: "2319138c-fe27-4f8b-b2fa-64da016e6fae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:36:41.569601 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.569584    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24db291-dae7-40d5-b9e4-1567a7b9be26-kube-api-access-x2mbx" (OuterVolumeSpecName: "kube-api-access-x2mbx") pod "a24db291-dae7-40d5-b9e4-1567a7b9be26" (UID: "a24db291-dae7-40d5-b9e4-1567a7b9be26"). InnerVolumeSpecName "kube-api-access-x2mbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:41.569669 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.569590    2600 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2319138c-fe27-4f8b-b2fa-64da016e6fae-kube-api-access-t7mxs" (OuterVolumeSpecName: "kube-api-access-t7mxs") pod "2319138c-fe27-4f8b-b2fa-64da016e6fae" (UID: "2319138c-fe27-4f8b-b2fa-64da016e6fae"). InnerVolumeSpecName "kube-api-access-t7mxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:41.668733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.668682    2600 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2319138c-fe27-4f8b-b2fa-64da016e6fae-maas-api-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:41.668733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.668702    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7mxs\" (UniqueName: \"kubernetes.io/projected/2319138c-fe27-4f8b-b2fa-64da016e6fae-kube-api-access-t7mxs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:41.668733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.668712    2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2mbx\" (UniqueName: \"kubernetes.io/projected/a24db291-dae7-40d5-b9e4-1567a7b9be26-kube-api-access-x2mbx\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:41.668733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.668722    2600 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a24db291-dae7-40d5-b9e4-1567a7b9be26-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:41.668733 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.668731    2600 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2319138c-fe27-4f8b-b2fa-64da016e6fae-openshift-service-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Jul 24 16:36:41.843706 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.843681    2600 generic.go:356] "Generic (PLEG): container finished" podID="2319138c-fe27-4f8b-b2fa-64da016e6fae" containerID="55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5" exitCode=0
Jul 24 16:36:41.843811 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.843723    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"
Jul 24 16:36:41.843811 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.843773    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc" event={"ID":"2319138c-fe27-4f8b-b2fa-64da016e6fae","Type":"ContainerDied","Data":"55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5"}
Jul 24 16:36:41.843919 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.843835    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc" event={"ID":"2319138c-fe27-4f8b-b2fa-64da016e6fae","Type":"ContainerDied","Data":"0f30f24d335aab69537489af97c8df0f439c900152c62f6a2a93a3e51245c363"}
Jul 24 16:36:41.843919 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.843867    2600 scope.go:117] "RemoveContainer" containerID="55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5"
Jul 24 16:36:41.845081 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.845059    2600 generic.go:356] "Generic (PLEG): container finished" podID="a24db291-dae7-40d5-b9e4-1567a7b9be26" containerID="c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5" exitCode=0
Jul 24 16:36:41.845157 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.845096    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl" event={"ID":"a24db291-dae7-40d5-b9e4-1567a7b9be26","Type":"ContainerDied","Data":"c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5"}
Jul 24 16:36:41.845157 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.845114    2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"
Jul 24 16:36:41.845157 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.845131    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl" event={"ID":"a24db291-dae7-40d5-b9e4-1567a7b9be26","Type":"ContainerDied","Data":"74c27a125db2d64727fdc2ae865aab08f16bf35e36f5cb5da47b5bf3798f1578"}
Jul 24 16:36:41.852558 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.852542    2600 scope.go:117] "RemoveContainer" containerID="55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5"
Jul 24 16:36:41.852856 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:36:41.852839    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5\": container with ID starting with 55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5 not found: ID does not exist" containerID="55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5"
Jul 24 16:36:41.852927 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.852866    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5"} err="failed to get container status \"55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5\": rpc error: code = NotFound desc = could not find container \"55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5\": container with ID starting with 55b382368252c50bad93ae6b3e673f0e368f18e89ffe7056d1e13d6c1af954b5 not found: ID does not exist"
Jul 24 16:36:41.852927 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.852883    2600 scope.go:117] "RemoveContainer" containerID="c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5"
Jul 24 16:36:41.860703 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.860687    2600 scope.go:117] "RemoveContainer" containerID="c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5"
Jul 24 16:36:41.860921 ip-10-0-134-8 kubenswrapper[2600]: E0724 16:36:41.860904    2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5\": container with ID starting with c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5 not found: ID does not exist" containerID="c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5"
Jul 24 16:36:41.860980 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.860926    2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5"} err="failed to get container status \"c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5\": rpc error: code = NotFound desc = could not find container \"c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5\": container with ID starting with c3b9c2deec596a73a16b45363fd6e5b09ab2cc554f90799e73c70008a60087a5 not found: ID does not exist"
Jul 24 16:36:41.868172 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.868153    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"]
Jul 24 16:36:41.872442 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.872420    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82adcb-59b68c9759-tx2jc"]
Jul 24 16:36:41.881888 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.881868    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"]
Jul 24 16:36:41.886068 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:41.886050    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-82adcb-5dc68dcf76-n2qgl"]
Jul 24 16:36:42.403529 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:42.403466    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2319138c-fe27-4f8b-b2fa-64da016e6fae" path="/var/lib/kubelet/pods/2319138c-fe27-4f8b-b2fa-64da016e6fae/volumes"
Jul 24 16:36:42.403850 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:42.403765    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95853010-a2ea-48f2-ba81-d6e369f92016" path="/var/lib/kubelet/pods/95853010-a2ea-48f2-ba81-d6e369f92016/volumes"
Jul 24 16:36:42.404045 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:42.404030    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24db291-dae7-40d5-b9e4-1567a7b9be26" path="/var/lib/kubelet/pods/a24db291-dae7-40d5-b9e4-1567a7b9be26/volumes"
Jul 24 16:36:44.179916 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:44.179881    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5rwjv"]
Jul 24 16:36:45.782833 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:45.782790    2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"]
Jul 24 16:36:45.784766 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:45.784746    2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-82adcb-667sp"]
Jul 24 16:36:45.790094 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:45.790057    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:46.180210 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:46.180177    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:46.402851 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:46.402814    2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d4ebad6-6461-426d-85ca-336fea5f9937" path="/var/lib/kubelet/pods/4d4ebad6-6461-426d-85ca-336fea5f9937/volumes"
Jul 24 16:36:51.970451 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:51.970418    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:52.036877 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:52.036846    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:52.254261 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:52.254157    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:52.519171 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:52.519087    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:36:59.160987 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:59.160952    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d995667b8-bdgnv_158a1b97-1248-4d5b-9d7d-e615605045bd/copy-manifests/0.log"
Jul 24 16:36:59.168463 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:36:59.168409    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d995667b8-bdgnv_158a1b97-1248-4d5b-9d7d-e615605045bd/manager/0.log"
Jul 24 16:37:00.040742 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:00.040707    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748495-zgqgl_98c83b28-b7b4-4563-8c30-eb7eb72c7eae/cleanup/0.log"
Jul 24 16:37:00.163662 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:00.163637    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748510-pmq7n_9b806668-c479-4a81-ae6e-94ccda7fb499/cleanup/0.log"
Jul 24 16:37:02.407369 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:02.407336    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5rwjv_dc51cf1f-8a3c-4bb8-ad3a-c35a75399049/limitador/0.log"
Jul 24 16:37:03.058397 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:03.058358    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-g64v4_16075471-127b-49d3-9cf0-f5310b19be34/discovery/0.log"
Jul 24 16:37:03.557939 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:03.557910    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-nw6k6_563709b3-f8ea-4ded-ba70-5b747361af15/payload-pre-processing/0.log"
Jul 24 16:37:04.179111 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:04.179077    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9wjc8_8c03b3da-6711-4f53-92ec-4fba4db7ad5a/main/0.log"
Jul 24 16:37:04.683064 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:04.683036    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-x7gd9_4763a2cd-8bb9-4799-aced-6e03e192cc43/main/0.log"
Jul 24 16:37:10.631137 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:10.631104    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:37:10.730532 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:10.730494    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:37:13.478262 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:13.478221    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9x7gq_498b446f-d1a3-4f46-ae0a-489ed8f0fa92/global-pull-secret-syncer/0.log"
Jul 24 16:37:13.622856 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:13.622825    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log"
Jul 24 16:37:13.770956 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:13.770889    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-8.ec2.internal_5b4c93f4e70558b77ddac96ac849afbc/haproxy/0.log"
Jul 24 16:37:19.469216 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:19.469181    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5rwjv_dc51cf1f-8a3c-4bb8-ad3a-c35a75399049/limitador/0.log"
Jul 24 16:37:21.574804 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:21.574777    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65575967c9-cm682_a6b709c2-0d67-4164-891e-356c13a7e160/metrics-server/0.log"
Jul 24 16:37:21.707790 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:21.707767    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6xpk_8d68260c-fc8c-49b2-9a6c-a6537eba1e1a/node-exporter/0.log"
Jul 24 16:37:21.728542 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:21.728521    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6xpk_8d68260c-fc8c-49b2-9a6c-a6537eba1e1a/kube-rbac-proxy/0.log"
Jul 24 16:37:21.749872 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:21.749849    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6xpk_8d68260c-fc8c-49b2-9a6c-a6537eba1e1a/init-textfile/0.log"
Jul 24 16:37:21.935557 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:21.935523    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de901c5b-d08f-4ecf-89f5-9a7975a72066/prometheus/0.log"
Jul 24 16:37:21.957360 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:21.957342    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de901c5b-d08f-4ecf-89f5-9a7975a72066/config-reloader/0.log"
Jul 24 16:37:21.978456 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:21.978394    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de901c5b-d08f-4ecf-89f5-9a7975a72066/thanos-sidecar/0.log"
Jul 24 16:37:21.998469 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:21.998443    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de901c5b-d08f-4ecf-89f5-9a7975a72066/kube-rbac-proxy-web/0.log"
Jul 24 16:37:22.024517 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:22.024498    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de901c5b-d08f-4ecf-89f5-9a7975a72066/kube-rbac-proxy/0.log"
Jul 24 16:37:22.045043 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:22.045023    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de901c5b-d08f-4ecf-89f5-9a7975a72066/kube-rbac-proxy-thanos/0.log"
Jul 24 16:37:22.065594 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:22.065573    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de901c5b-d08f-4ecf-89f5-9a7975a72066/init-config-reloader/0.log"
Jul 24 16:37:22.094336 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:22.094317    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-p7ggw_8e0e2c51-36e6-4e07-9022-738f36cf31f9/prometheus-operator/0.log"
Jul 24 16:37:22.110769 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:22.110752    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-p7ggw_8e0e2c51-36e6-4e07-9022-738f36cf31f9/kube-rbac-proxy/0.log"
Jul 24 16:37:22.134320 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:22.134296    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-qnlqt_d354d76a-9037-4f01-940f-e0a6bdd985be/prometheus-operator-admission-webhook/0.log"
Jul 24 16:37:23.814280 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.814243    2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"]
Jul 24 16:37:23.815412 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815361    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2319138c-fe27-4f8b-b2fa-64da016e6fae" containerName="maas-api"
Jul 24 16:37:23.815624 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815427    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="2319138c-fe27-4f8b-b2fa-64da016e6fae" containerName="maas-api"
Jul 24 16:37:23.815624 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815520    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24db291-dae7-40d5-b9e4-1567a7b9be26" containerName="payload-pre-processing"
Jul 24 16:37:23.815624 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815532    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24db291-dae7-40d5-b9e4-1567a7b9be26" containerName="payload-pre-processing"
Jul 24 16:37:23.815624 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815544    2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d4ebad6-6461-426d-85ca-336fea5f9937" containerName="revoke-keys"
Jul 24 16:37:23.815624 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815553    2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d4ebad6-6461-426d-85ca-336fea5f9937" containerName="revoke-keys"
Jul 24 16:37:23.815880 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815794    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="2319138c-fe27-4f8b-b2fa-64da016e6fae" containerName="maas-api"
Jul 24 16:37:23.815880 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815819    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d4ebad6-6461-426d-85ca-336fea5f9937" containerName="revoke-keys"
Jul 24 16:37:23.815880 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.815830    2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24db291-dae7-40d5-b9e4-1567a7b9be26" containerName="payload-pre-processing"
Jul 24 16:37:23.822239 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.820276    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.824587 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.824557    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f8c76\"/\"kube-root-ca.crt\""
Jul 24 16:37:23.824587 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.824581    2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f8c76\"/\"default-dockercfg-6svfq\""
Jul 24 16:37:23.825005 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.824985    2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f8c76\"/\"openshift-service-ca.crt\""
Jul 24 16:37:23.825549 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.825524    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"]
Jul 24 16:37:23.890202 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.890176    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-proc\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.890333 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.890220    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-lib-modules\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.890333 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.890250    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-podres\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.890460 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.890338    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zndtx\" (UniqueName: \"kubernetes.io/projected/92829db1-5654-4a16-a14e-f39cb53ee18e-kube-api-access-zndtx\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.890460 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.890379    2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-sys\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991410 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991388    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-lib-modules\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991535 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991418    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-podres\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991535 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991446    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zndtx\" (UniqueName: \"kubernetes.io/projected/92829db1-5654-4a16-a14e-f39cb53ee18e-kube-api-access-zndtx\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991535 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991471    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-sys\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991535 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991508    2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-proc\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991794 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991560    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-proc\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991794 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991561    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-lib-modules\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991794 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991560    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-podres\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:23.991794 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:23.991638    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92829db1-5654-4a16-a14e-f39cb53ee18e-sys\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:24.000331 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:24.000309    2600 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zndtx\" (UniqueName: \"kubernetes.io/projected/92829db1-5654-4a16-a14e-f39cb53ee18e-kube-api-access-zndtx\") pod \"perf-node-gather-daemonset-smx4s\" (UID: \"92829db1-5654-4a16-a14e-f39cb53ee18e\") " pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:24.134171 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:24.134108    2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:24.262720 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:24.262696    2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"]
Jul 24 16:37:24.265130 ip-10-0-134-8 kubenswrapper[2600]: W0724 16:37:24.265101    2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92829db1_5654_4a16_a14e_f39cb53ee18e.slice/crio-efceb4251f1879da80a7bb8ebee85837f958ec040940f8155b8723f024d2a256 WatchSource:0}: Error finding container efceb4251f1879da80a7bb8ebee85837f958ec040940f8155b8723f024d2a256: Status 404 returned error can't find the container with id efceb4251f1879da80a7bb8ebee85837f958ec040940f8155b8723f024d2a256
Jul 24 16:37:24.734588 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:24.734557    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-rxjjs_2e14f60f-5082-4447-8d5e-a1927cbcc4d5/download-server/0.log"
Jul 24 16:37:25.042570 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:25.042481    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s" event={"ID":"92829db1-5654-4a16-a14e-f39cb53ee18e","Type":"ContainerStarted","Data":"42054ebaf009cfc7727a07199c70068d32cf8bee2c221ea5792a85f75ba37354"}
Jul 24 16:37:25.042570 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:25.042541    2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s" event={"ID":"92829db1-5654-4a16-a14e-f39cb53ee18e","Type":"ContainerStarted","Data":"efceb4251f1879da80a7bb8ebee85837f958ec040940f8155b8723f024d2a256"}
Jul 24 16:37:25.043004 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:25.042571    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:25.058601 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:25.058549    2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s" podStartSLOduration=2.058533857 podStartE2EDuration="2.058533857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:37:25.05794339 +0000 UTC m=+3119.215810125" watchObservedRunningTime="2026-07-24 16:37:25.058533857 +0000 UTC m=+3119.216400602"
Jul 24 16:37:26.455723 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:26.455690    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rvkc6_98efb8c4-0bf4-4f4c-9018-69c95f0d2f01/dns/0.log"
Jul 24 16:37:26.476484 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:26.476454    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rvkc6_98efb8c4-0bf4-4f4c-9018-69c95f0d2f01/kube-rbac-proxy/0.log"
Jul 24 16:37:26.547085 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:26.547061    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ssqh6_0fe8b2ac-a6c5-4c58-82dd-29dbfa62c4f9/dns-node-resolver/0.log"
Jul 24 16:37:26.782544 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:26.782482    2600 scope.go:117] "RemoveContainer" containerID="c71e35b62add8c8ae260b93bed7d22b1526429926f15321fcc8b7ae103982a98"
Jul 24 16:37:26.869151 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:26.869128    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:37:26.924359 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:26.924333    2600 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4lh6_0e0f870c-5c0e-49e2-a6ff-b7ebdff6ace1/konnectivity-agent/0.log" limit=1024
Jul 24 16:37:27.116090 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:27.116026    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ftg7x_458477e6-def3-441c-9cdd-59e70e711840/node-ca/0.log"
Jul 24 16:37:28.323225 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:28.323195    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-g64v4_16075471-127b-49d3-9cf0-f5310b19be34/discovery/0.log"
Jul 24 16:37:28.492766 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:28.492739    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-nw6k6_563709b3-f8ea-4ded-ba70-5b747361af15/payload-pre-processing/0.log"
Jul 24 16:37:29.392313 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:29.392270    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jpwf4_8d17eeb9-14fd-4d1a-a01f-5fe3c11b472c/serve-healthcheck-canary/0.log"
Jul 24 16:37:29.912539 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:29.912513    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4f88q_bc886a86-467f-4220-b0ba-2a3319fc7d6e/kube-rbac-proxy/0.log"
Jul 24 16:37:29.938300 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:29.938273    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4f88q_bc886a86-467f-4220-b0ba-2a3319fc7d6e/exporter/0.log"
Jul 24 16:37:29.963955 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:29.963933    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4f88q_bc886a86-467f-4220-b0ba-2a3319fc7d6e/extractor/0.log"
Jul 24 16:37:31.056851 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:31.056825    2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f8c76/perf-node-gather-daemonset-smx4s"
Jul 24 16:37:33.258480 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:33.258450    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d995667b8-bdgnv_158a1b97-1248-4d5b-9d7d-e615605045bd/manager/0.log"
Jul 24 16:37:33.286790 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:33.286760    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d995667b8-bdgnv_158a1b97-1248-4d5b-9d7d-e615605045bd/copy-manifests/0.log"
Jul 24 16:37:34.522372 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:34.522335    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-g64v4_16075471-127b-49d3-9cf0-f5310b19be34/discovery/0.log"
Jul 24 16:37:34.637368 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:34.637333    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-nw6k6_563709b3-f8ea-4ded-ba70-5b747361af15/payload-pre-processing/0.log"
Jul 24 16:37:34.884584 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:34.884551    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57bd9ccdc-lg2v7_93ee9026-cef2-46a4-9c8f-2e8f372afbc2/manager/0.log"
Jul 24 16:37:36.429776 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:36.429745    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-g64v4_16075471-127b-49d3-9cf0-f5310b19be34/discovery/0.log"
Jul 24 16:37:36.576195 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:36.576168    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-nw6k6_563709b3-f8ea-4ded-ba70-5b747361af15/payload-pre-processing/0.log"
Jul 24 16:37:41.430475 ip-10-0-134-8 kubenswrapper[2600]: I0724 16:37:41.430446    2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2tmk5_fce065fc-79ff-415b-8a02-6f87c9099f68/kube-multus/0.log"