Sep 11 12:45:05.068816 ip-10-0-128-225 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 12:45:05.068827 ip-10-0-128-225 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 12:45:05.068837 ip-10-0-128-225 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 12:45:05.069373 ip-10-0-128-225 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 12:45:15.206855 ip-10-0-128-225 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 12:45:15.206873 ip-10-0-128-225 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 475ec3b2078040859757df5a75d5f963 --
Sep 11 12:47:01.811433 ip-10-0-128-225 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 12:47:02.362239 ip-10-0-128-225 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:47:02.362239 ip-10-0-128-225 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 12:47:02.362239 ip-10-0-128-225 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:47:02.362239 ip-10-0-128-225 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 12:47:02.362239 ip-10-0-128-225 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:47:02.363208 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.363116    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 12:47:02.369330 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369312    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:02.369330 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369327    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:02.369330 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369332    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:02.369330 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369335    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369339    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369342    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369345    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369348    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369350    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369353    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369357    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369361    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369365    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369368    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369371    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369374    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369377    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369381    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369384    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369387    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369390    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369392    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:02.369487 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369395    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369397    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369400    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369402    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369405    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369408    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369410    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369412    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369415    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369418    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369421    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369423    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369426    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369428    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369431    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369434    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369437    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369440    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369442    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369445    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:02.369943 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369447    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369450    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369452    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369455    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369457    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369460    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369462    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369464    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369467    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369470    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369472    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369475    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369477    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369480    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369482    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369485    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369490    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369494    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369497    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:02.370507 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369501    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369504    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369507    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369510    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369512    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369515    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369517    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369520    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369523    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369526    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369528    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369531    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369534    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369536    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369546    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369549    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369552    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369554    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369557    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369560    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:02.370976 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369562    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369565    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369569    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369571    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369574    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369577    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369579    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369582    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369585    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369587    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369590    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369592    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369595    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369597    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369600    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369604    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369607    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.369609    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370293    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370300    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:02.371473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370305    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370308    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370310    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370313    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370316    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370318    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370321    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370324    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370326    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370329    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370331    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370334    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370337    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370340    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370343    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370346    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370348    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370351    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370354    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370356    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:02.371958 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370359    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370361    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370364    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370367    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370369    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370372    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370374    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370377    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370380    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370383    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370385    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370388    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370391    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370394    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370397    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370399    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370402    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370406    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370410    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370413    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:02.372473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370416    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370420    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370424    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370427    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370430    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370433    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370435    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370438    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370442    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370444    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370447    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370449    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370452    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370454    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370457    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370459    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370462    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370464    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370467    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:02.372966 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370469    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370472    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370476    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370478    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370482    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370484    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370487    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370490    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370493    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370495    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370498    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370500    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370503    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370506    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370508    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370511    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370514    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370517    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370519    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:02.373466 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370522    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370525    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370527    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370531    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370534    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370536    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370539    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370541    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370544    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370546    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370551    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370554    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370557    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370560    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370563    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370566    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370568    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370571    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370574    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370941    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:02.373936 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370946    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370949    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370952    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370955    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370958    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370960    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370963    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370965    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370968    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370971    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370973    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370976    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370979    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370981    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370984    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370992    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370996    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.370998    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371001    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371004    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:02.374437 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371007    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371009    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371012    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371019    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371022    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371025    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371028    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371031    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371035    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371038    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371041    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371044    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371047    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371050    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371052    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371055    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371058    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371060    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371063    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:02.374947 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371065    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371068    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371070    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371073    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371075    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371078    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371080    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371083    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371085    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371088    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371090    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371093    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371096    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371098    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371100    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371103    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371105    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371109    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371112    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:02.375429 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371116    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371119    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371122    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371125    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371128    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371130    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371133    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371136    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371139    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371142    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371144    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371147    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371150    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371152    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371155    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371158    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371160    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371163    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371165    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371182    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:02.375880 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371185    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371188    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371190    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371200    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371204    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371207    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371210    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371212    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371215    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371218    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371223    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371225    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371229    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371231    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371234    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371236    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371239    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371242    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371244    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371247    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:02.376412 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371314    2573 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371346    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371359    2573 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371363    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371367    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371370    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371374    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371377    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371380    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371383    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371387    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371390    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371393    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371396    2573 flags.go:64] FLAG: --cgroup-root=""
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371399    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371402    2573 flags.go:64] FLAG: --client-ca-file=""
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371405    2573 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371408    2573 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371415    2573 flags.go:64] FLAG: --cluster-domain=""
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371418    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371421    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371424    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371429    2573 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371432    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 12:47:02.376893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371435    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371438    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371441    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371444    2573 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371447    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371450    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371453    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371456    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371459    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371464    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371467    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371470    2573 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371473    2573 flags.go:64] FLAG: --enable-server="true"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371476    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371481    2573 flags.go:64] FLAG: --event-burst="100"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371484    2573 flags.go:64] FLAG: --event-qps="50"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371487    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371490    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371492    2573 flags.go:64] FLAG: --eviction-hard=""
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371496    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371499    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371501    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371504    2573 flags.go:64] FLAG: --eviction-soft=""
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371507    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371510    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 12:47:02.377485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371514    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371517    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371520    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371523    2573 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371525    2573 flags.go:64] FLAG: --feature-gates=""
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371532    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371535    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371538    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371541    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371544    2573 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371547    2573 flags.go:64] FLAG: --help="false"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371549    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371552    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371555    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371558    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371561    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371565    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371568    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371570    2573 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371573    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371576    2573 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371579    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371582    2573 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371584    2573 flags.go:64] FLAG: --kube-reserved=""
Sep 11 12:47:02.378499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371587    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371590    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371593    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371595    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371598    2573 flags.go:64] FLAG: --lock-file=""
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371601    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371603    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371606    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371611    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371615    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371618    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371620    2573 flags.go:64] FLAG: --logging-format="text"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371623    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371627    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371630    2573 flags.go:64] FLAG: --manifest-url=""
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371633    2573 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371637    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371639    2573 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371643    2573 flags.go:64] FLAG: --max-pods="110"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371646    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371649    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371652    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371655    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371658    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371661    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 12:47:02.379541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371663    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371670    2573 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371673    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371676    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371680    2573 flags.go:64] FLAG: --pod-cidr=""
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371683    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371687    2573 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371690    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371693    2573 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371696    2573 flags.go:64] FLAG: --port="10250"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371699    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371702    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ccded16eee3f7715"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371705    2573 flags.go:64] FLAG: --qos-reserved=""
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371707    2573 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371710    2573 flags.go:64] FLAG: --register-node="true"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371713    2573 flags.go:64] FLAG: --register-with-taints=""
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371716    2573 flags.go:64] FLAG: --registry-burst="10"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371720    2573 flags.go:64] FLAG: --registry-qps="5"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371722    2573 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371725    2573 flags.go:64] FLAG: --reserved-memory=""
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371729    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371733    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371736    2573 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371738    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371741    2573 flags.go:64] FLAG: --runonce="false"
Sep 11 12:47:02.380336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371744    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371746    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371749    2573 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371752    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371755    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371759    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371761    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371764    2573 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371767    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371770    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371773    2573 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371776    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371779    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371781    2573 flags.go:64] FLAG: --system-cgroups=""
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371784    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371789    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371792    2573 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371794    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371798    2573 flags.go:64] FLAG: --tls-min-version=""
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371801    2573 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371803    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371806    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371809    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371812    2573 flags.go:64] FLAG: --v="2"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371815    2573 flags.go:64] FLAG: --version="false"
Sep 11 12:47:02.381006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371820    2573 flags.go:64] FLAG: --vmodule=""
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371823    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.371826    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371928    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371932    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371935    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371939    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371942    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371944    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371947    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371950    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371953    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371955    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371958    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371961    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371965    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371969    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371972    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371975    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:02.381762 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371977    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371980    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371982    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371985    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371988    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371991    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371993    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371996    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.371998    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372001    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372003    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372006    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372008    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372011    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372014    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372016    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372020    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372023    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372026    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372028    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:02.382621 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372031    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372033    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372036    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372038    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372041    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372047    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372050    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372052    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372055    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372057    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372060    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372063    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372065    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372068    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372071    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372073    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372076    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372078    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372081    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372083    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:02.383277 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372086    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372088    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372091    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372094    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372096    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372099    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372102    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372106    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372111    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372114    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372117    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372120    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372123    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372126    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372128    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372131    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372133    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372137    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372141    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:02.384127 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372144    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372147    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372150    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372153    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372156    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372160    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372162    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372165    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372182    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372186    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372190    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372195    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372200    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372203    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372206    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372209    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372211    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372214    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372216    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372219    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:02.384878 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372222    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372226    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372229    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.372231    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.372757    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.379844    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.379861    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.381510    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.381525    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381618    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381626    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381632    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381636    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381641    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381645    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:02.385551 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381649    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381656    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381663    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381667    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381672    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381676    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381680    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381685    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381689    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381693    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381697    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381702    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381706    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381711    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381715    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381718    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381725    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381731    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381736    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:02.385961 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381741    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381745    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381750    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381754    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381759    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381763    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381768    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381772    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381776    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381780    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381784    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381788    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381792    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381796    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381800    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381805    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381809    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381814    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381818    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:02.386473 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381822    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381826    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381831    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381834    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381839    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381844    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381848    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381852    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381856    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381860    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381865    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381869    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381873    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381878    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381882    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381887    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381891    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381896    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381900    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381904    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:02.387013 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381909    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381913    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381917    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381921    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381925    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381929    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381933    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381937    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381942    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381946    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381950    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381954    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381958    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381962    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381968    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381973    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381979    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381984    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381989    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381993    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:02.387592 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.381997    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382002    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382006    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382011    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382015    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382019    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382024    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382029    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382033    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382037    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382041    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382046    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382050    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382054    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382058    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:02.388086 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.382066    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382249    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382259    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382264    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382268    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382275    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382282    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382288    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382293    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382298    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382302    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382307    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382311    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382315    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382319    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382323    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382327    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382332    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382336    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:02.388528 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382340    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382344    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382349    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382353    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382357    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382362    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382366    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382371    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382376    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382380    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382384    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382388    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382393    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382397    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382401    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382405    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382409    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382413    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382417    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382421    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:02.388998 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382425    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382430    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382434    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382438    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382442    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382446    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382450    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382454    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382459    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382463    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382467    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382471    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382476    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382480    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382484    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382488    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382493    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382498    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382502    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:02.389884 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382507    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382513    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382519    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382524    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382529    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382534    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382538    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382542    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382549    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382554    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382559    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382564    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382568    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382572    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382576    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382580    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382584    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382588    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382593    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:02.390552 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382597    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382601    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382605    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382609    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382613    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382617    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382621    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382625    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382629    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382633    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382637    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382641    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382646    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382651    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382655    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382659    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382664    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382668    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382672    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382676    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:02.391038 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382681    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382685    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:02.382689    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.382697    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.382827    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.385412    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.386458    2573 server.go:1019] "Starting client certificate rotation"
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.386713    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.387430    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:47:02.391546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.389678    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:47:02.394409 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.394391    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:47:02.404127 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.404110    2573 log.go:25] "Validated CRI v1 runtime API"
Sep 11 12:47:02.407164 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.407144    2573 log.go:25] "Validated CRI v1 image API"
Sep 11 12:47:02.407971 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.407956    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 12:47:02.411138 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.411119    2573 fs.go:135] Filesystem UUIDs: map[4fe5d488-778e-4527-8b74-82a5c534cbe2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b7548339-aab9-4fb5-a9b3-f6f7cbcf52ee:/dev/nvme0n1p4]
Sep 11 12:47:02.411205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.411142    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 12:47:02.417414 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.417397    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:47:02.417975 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.417864    2573 manager.go:216] Machine: {Timestamp:2026-09-11 12:47:02.414983618 +0000 UTC m=+0.489446373 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099157 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec3ccc246f9cd49d110467df51787 SystemUUID:ec2ec3cc-c246-f9cd-49d1-10467df51787 BootID:475ec3b2-0780-4085-9757-df5a75d5f963 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:07:36:77:0f:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:07:36:77:0f:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:c6:f9:68:75:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 12:47:02.417975 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.417973    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 12:47:02.418076 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.418065    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 12:47:02.420916 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.420896    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 12:47:02.421045 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.420919    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 12:47:02.422109 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.422099    2573 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 12:47:02.422147 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.422112    2573 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 12:47:02.422147 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.422119    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:47:02.422645 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.422635    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:47:02.423451 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.423443    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 12:47:02.426281 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426271    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:47:02.426392 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426383    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 12:47:02.426421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426412    2573 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 12:47:02.426447 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426425    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 12:47:02.426447 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426444    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 12:47:02.426505 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426456    2573 kubelet.go:398] "Adding apiserver pod source"
Sep 11 12:47:02.426505 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426468    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 12:47:02.426813 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426801    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:47:02.426848 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.426823    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:47:02.428852 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.428826    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 12:47:02.431021 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.431007    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 12:47:02.431088 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.431037    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 12:47:02.432723 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432705    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 12:47:02.432799 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432732    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 12:47:02.432799 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432741    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 12:47:02.432799 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432749    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 12:47:02.432799 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432762    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 12:47:02.432799 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432771    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 12:47:02.432799 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432790    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 12:47:02.432799 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432798    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 12:47:02.432997 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432817    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 12:47:02.432997 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432825    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 12:47:02.432997 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432836    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 12:47:02.432997 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.432844    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 12:47:02.433640 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.433628    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 12:47:02.433680 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.433640    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 12:47:02.434512 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.434485    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 12:47:02.434804 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.434761    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 12:47:02.437398 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.437386    2573 server.go:1268] "Started kubelet"
Sep 11 12:47:02.437478 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.437453    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 12:47:02.438105 ip-10-0-128-225 systemd[1]: Started Kubernetes Kubelet.
Sep 11 12:47:02.440684 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.437797    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 12:47:02.441051 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.441028    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 12:47:02.441196 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.440679    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 12:47:02.442196 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.442141    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 12:47:02.442291 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.442205    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 12:47:02.442513 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.442498    2573 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 12:47:02.447184 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.447153    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 12:47:02.447257 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.447194    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 12:47:02.447317 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.447260    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:02.447860 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.447843    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 12:47:02.447860 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.447848    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 12:47:02.448008 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.447878    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 12:47:02.448008 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.447922    2573 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 12:47:02.448008 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.447931    2573 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 12:47:02.448340 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.448320    2573 factory.go:55] Registering systemd factory
Sep 11 12:47:02.448407 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.448343    2573 factory.go:223] Registration of the systemd container factory successfully
Sep 11 12:47:02.449012 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.448999    2573 factory.go:153] Registering CRI-O factory
Sep 11 12:47:02.449112 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.449095    2573 factory.go:223] Registration of the crio container factory successfully
Sep 11 12:47:02.449204 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.449156    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 12:47:02.449204 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.449196    2573 factory.go:103] Registering Raw factory
Sep 11 12:47:02.449274 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.449212    2573 manager.go:1196] Started watching for new ooms in manager
Sep 11 12:47:02.450195 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.450161    2573 manager.go:349] Starting recovery of all containers
Sep 11 12:47:02.455062 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.455041    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 12:47:02.455540 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.455512    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 12:47:02.456441 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.455542    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-225.ec2.internal.18d44500f814d46e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-225.ec2.internal,UID:ip-10-0-128-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-225.ec2.internal,},FirstTimestamp:2026-09-11 12:47:02.43736075 +0000 UTC m=+0.511823505,LastTimestamp:2026-09-11 12:47:02.43736075 +0000 UTC m=+0.511823505,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-225.ec2.internal,}"
Sep 11 12:47:02.461011 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.460997    2573 manager.go:354] Recovery completed
Sep 11 12:47:02.466094 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.466081    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:02.467814 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.467794    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:02.467875 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.467828    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:02.467875 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.467842    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:02.468403 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.468385    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9dwdr"
Sep 11 12:47:02.468491 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.468437    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 12:47:02.468491 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.468448    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 12:47:02.468491 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.468460    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:47:02.468491 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.468441    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:02.469398 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.469378    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:02.469467 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.469414    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:02.469467 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.469369    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-225.ec2.internal.18d44500f9e5852c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-225.ec2.internal,UID:ip-10-0-128-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-225.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-225.ec2.internal,},FirstTimestamp:2026-09-11 12:47:02.4678147 +0000 UTC m=+0.542277454,LastTimestamp:2026-09-11 12:47:02.4678147 +0000 UTC m=+0.542277454,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-225.ec2.internal,}"
Sep 11 12:47:02.469467 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.469433    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:02.469670 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.469658    2573 policy_none.go:49] "None policy: Start"
Sep 11 12:47:02.469710 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.469674    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 12:47:02.469710 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.469684    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 12:47:02.470888 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.470876    2573 policy_none.go:47] "Start"
Sep 11 12:47:02.476619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.476603    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9dwdr"
Sep 11 12:47:02.478527 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.478421    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-225.ec2.internal.18d44500f9e5d475  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-225.ec2.internal,UID:ip-10-0-128-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-225.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-225.ec2.internal,},FirstTimestamp:2026-09-11 12:47:02.467834997 +0000 UTC m=+0.542297754,LastTimestamp:2026-09-11 12:47:02.467834997 +0000 UTC m=+0.542297754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-225.ec2.internal,}"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.509291    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.509754    2573 manager.go:337] "Starting Device Plugin manager"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.509785    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.509798    2573 server.go:87] "Starting device plugin registration server"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.510023    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.510034    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.510136    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.510240    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.510250    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.510746    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.510799    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.510823    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.510864    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.511755    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.511807    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:02.518720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.514289    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:02.610766 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.610750    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:02.610946 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.610929    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal"]
Sep 11 12:47:02.610997 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.610988    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:02.611591 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.611572    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:02.611668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.611577    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:02.611668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.611602    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:02.611668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.611616    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:02.611668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.611641    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.611668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.611616    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:02.611835 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.611699    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:02.612874 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.612828    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:02.612989 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.612976    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.613027 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.613003    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:02.613546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.613522    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:02.613608 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.613557    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:02.613608 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.613573    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:02.613608 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.613584    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:02.613608 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.613601    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:02.613724 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.613616    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:02.615194 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.615162    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.615244 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.615211    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:02.615940 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.615922    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:02.616029 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.615951    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:02.616029 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.615961    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:02.618499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.618479    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.618575 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.618504    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-225.ec2.internal\": node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:02.641842 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.641816    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-225.ec2.internal\" not found" node="ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.646507 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.646493    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-225.ec2.internal\" not found" node="ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.648774 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.648759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9ec5a36a4072dcc75611810c0d28d1c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-225.ec2.internal\" (UID: \"a9ec5a36a4072dcc75611810c0d28d1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.648824 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.648782    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce10356a9962d8b5a65baf0be87d57d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal\" (UID: \"ce10356a9962d8b5a65baf0be87d57d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.648824 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.648799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce10356a9962d8b5a65baf0be87d57d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal\" (UID: \"ce10356a9962d8b5a65baf0be87d57d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.653431 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.653414    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:02.749630 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.749602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce10356a9962d8b5a65baf0be87d57d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal\" (UID: \"ce10356a9962d8b5a65baf0be87d57d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.749630 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.749631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce10356a9962d8b5a65baf0be87d57d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal\" (UID: \"ce10356a9962d8b5a65baf0be87d57d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.749781 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.749646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9ec5a36a4072dcc75611810c0d28d1c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-225.ec2.internal\" (UID: \"a9ec5a36a4072dcc75611810c0d28d1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.749781 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.749679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9ec5a36a4072dcc75611810c0d28d1c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-225.ec2.internal\" (UID: \"a9ec5a36a4072dcc75611810c0d28d1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.749781 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.749711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce10356a9962d8b5a65baf0be87d57d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal\" (UID: \"ce10356a9962d8b5a65baf0be87d57d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.749781 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.749727    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce10356a9962d8b5a65baf0be87d57d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal\" (UID: \"ce10356a9962d8b5a65baf0be87d57d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.753725 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.753712    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:02.854210 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.854188    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:02.944693 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.944635    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.949549 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:02.949526    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:02.955234 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:02.955213    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:03.055755 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.055725    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:03.156215 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.156192    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:03.256785 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.256726    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-225.ec2.internal\" not found"
Sep 11 12:47:03.259765 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.259746    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:03.347851 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.347824    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:03.354392 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.354371    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:03.361095 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.361075    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:47:03.362784 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.362763    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal"
Sep 11 12:47:03.369900 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.369882    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:47:03.385983 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.385963    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 12:47:03.386100 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.386083    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:47:03.386153 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.386106    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:47:03.386153 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.386113    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:47:03.427306 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.427278    2573 apiserver.go:52] "Watching apiserver"
Sep 11 12:47:03.441348 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.441326    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 12:47:03.441677 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.441651    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-7hnc6","kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9","openshift-cluster-node-tuning-operator/tuned-kmkmd","openshift-dns/node-resolver-wztjz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal","openshift-multus/network-metrics-daemon-b42r4","openshift-network-diagnostics/network-check-target-9rcdd","kube-system/global-pull-secret-syncer-mtkkj","openshift-image-registry/node-ca-btzwl","openshift-multus/multus-4h2dq","openshift-multus/multus-additional-cni-plugins-x7m6g","openshift-network-operator/iptables-alerter-8qb7p","openshift-ovn-kubernetes/ovnkube-node-fn6l6"]
Sep 11 12:47:03.443280 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.443258    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:03.444835 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.444814    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.445098 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.445076    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 12:47:03.445317 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.445300    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bnkbp\""
Sep 11 12:47:03.445398 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.445369    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 12:47:03.447016 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.446434    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.447482 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.447459    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 12:47:03.447587 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.447520    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 12:47:03.447587 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.447532    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 12:47:03.447786 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.447768    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 12:47:03.447957 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.447768    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lk9c9\""
Sep 11 12:47:03.448323 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.448305    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:47:03.448413 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.448399    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cxqnl\""
Sep 11 12:47:03.448645 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.448621    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.448780 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.448763    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 12:47:03.449728 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.449711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:03.449844 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.449822    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:03.450804 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.450787    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 12:47:03.450875 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.450819    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 12:47:03.450910 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.450873    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ckzwv\""
Sep 11 12:47:03.451367 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.451335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:03.451426 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.451410    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:03.452509 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.452490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.452587 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.452556    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:03.453330 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.453375 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-systemd\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453375 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-var-lib-kubelet\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453435 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-host\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453435 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7p4k\" (UniqueName: \"kubernetes.io/projected/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-kube-api-access-n7p4k\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:03.453435 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.453523 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-device-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.453523 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-lib-modules\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453523 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bngg9\" (UniqueName: \"kubernetes.io/projected/75f1bbc8-1630-41c8-8039-e43598efb150-kube-api-access-bngg9\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453621 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8d9c1b8-bbbe-4d59-9dca-740badddfb6f-agent-certs\") pod \"konnectivity-agent-7hnc6\" (UID: \"e8d9c1b8-bbbe-4d59-9dca-740badddfb6f\") " pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:03.453621 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453561    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.453621 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-modprobe-d\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453621 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e22d30-dab1-41df-a83d-2530f9f9cfba-tmp-dir\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.453621 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:03.453757 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysconfig\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453757 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8d9c1b8-bbbe-4d59-9dca-740badddfb6f-konnectivity-ca\") pod \"konnectivity-agent-7hnc6\" (UID: \"e8d9c1b8-bbbe-4d59-9dca-740badddfb6f\") " pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:03.453757 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsvm8\" (UniqueName: \"kubernetes.io/projected/040eca42-314a-403a-ac5c-7cbdaca15ba7-kube-api-access-gsvm8\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.453757 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysctl-conf\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453757 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-sys\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453757 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-kubernetes\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f1bbc8-1630-41c8-8039-e43598efb150-tmp\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.453954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.453954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.453954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-run\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.453954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75f1bbc8-1630-41c8-8039-e43598efb150-etc-tuned\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.454201 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.453969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysctl-d\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.454201 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.454000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13e22d30-dab1-41df-a83d-2530f9f9cfba-hosts-file\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.454201 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.454054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp5zn\" (UniqueName: \"kubernetes.io/projected/13e22d30-dab1-41df-a83d-2530f9f9cfba-kube-api-access-zp5zn\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.455152 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.455134    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.455644 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.455625    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mhld2\""
Sep 11 12:47:03.455644 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.455636    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 12:47:03.455778 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.455626    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 12:47:03.455834 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.455819    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 12:47:03.456464 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.456449    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.457680 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.457663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.458131 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.458104    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 12:47:03.458256 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.458234    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 12:47:03.458329 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.458254    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cwfkk\""
Sep 11 12:47:03.458329 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.458295    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 12:47:03.458423 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.458351    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 12:47:03.458629 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.458608    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s9vt6\""
Sep 11 12:47:03.458725 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.458667    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 12:47:03.458939 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.458921    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 12:47:03.459191 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.459147    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.459618 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.459601    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:47:03.459724 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.459709    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 12:47:03.459797 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.459734    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 12:47:03.460002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.459986    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9pcqx\""
Sep 11 12:47:03.460085 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.460064    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:47:03.462610 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.462593    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 12:47:03.462777 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.462763    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 12:47:03.462857 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.462793    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 12:47:03.462913 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.462897    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 12:47:03.462964 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.462930    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jkqzh\""
Sep 11 12:47:03.463013 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.462966    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 12:47:03.463125 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.463110    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 12:47:03.479992 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.479781    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 12:42:02 +0000 UTC" deadline="2028-03-20 20:04:28.4606086 +0000 UTC"
Sep 11 12:47:03.479992 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.479986    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13351h17m24.980627349s"
Sep 11 12:47:03.494266 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.494236    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce10356a9962d8b5a65baf0be87d57d9.slice/crio-81e888b6620be70aa661fd9004442c8019dce96730c0388497edf0315995154d WatchSource:0}: Error finding container 81e888b6620be70aa661fd9004442c8019dce96730c0388497edf0315995154d: Status 404 returned error can't find the container with id 81e888b6620be70aa661fd9004442c8019dce96730c0388497edf0315995154d
Sep 11 12:47:03.494449 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.494432    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ec5a36a4072dcc75611810c0d28d1c.slice/crio-5c959bd75781742a00261a13c15be9468a0041969535a2ea3985c3a2f7628d55 WatchSource:0}: Error finding container 5c959bd75781742a00261a13c15be9468a0041969535a2ea3985c3a2f7628d55: Status 404 returned error can't find the container with id 5c959bd75781742a00261a13c15be9468a0041969535a2ea3985c3a2f7628d55
Sep 11 12:47:03.499422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.499403    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:47:03.514774 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.514729    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal" event={"ID":"a9ec5a36a4072dcc75611810c0d28d1c","Type":"ContainerStarted","Data":"5c959bd75781742a00261a13c15be9468a0041969535a2ea3985c3a2f7628d55"}
Sep 11 12:47:03.516089 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.516066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal" event={"ID":"ce10356a9962d8b5a65baf0be87d57d9","Type":"ContainerStarted","Data":"81e888b6620be70aa661fd9004442c8019dce96730c0388497edf0315995154d"}
Sep 11 12:47:03.549059 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.549042    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 12:47:03.549546 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.549523    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s8blg"
Sep 11 12:47:03.554798 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-kubernetes\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.554861 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-ovn\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.554861 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv56d\" (UniqueName: \"kubernetes.io/projected/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-kube-api-access-rv56d\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.554861 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-hostroot\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.554861 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.554991 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75f1bbc8-1630-41c8-8039-e43598efb150-etc-tuned\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.554991 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554896    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-cni-netd\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.554991 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.554991 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554956    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-kubernetes\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555156 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.554989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovnkube-config\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.555156 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-netns\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.555156 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555087    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysctl-d\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555156 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13e22d30-dab1-41df-a83d-2530f9f9cfba-hosts-file\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-env-overrides\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-cni-bin\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555208    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysctl-d\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13e22d30-dab1-41df-a83d-2530f9f9cfba-hosts-file\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-systemd\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-var-lib-kubelet\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7p4k\" (UniqueName: \"kubernetes.io/projected/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-kube-api-access-n7p4k\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555334    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555338    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-systemd\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555351    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-systemd-units\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-var-lib-kubelet\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-etc-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555401    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-system-cni-dir\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555410    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-modprobe-d\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555496    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555555    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-serviceca\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555566    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-modprobe-d\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.555572    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-system-cni-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.555616    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:04.055601905 +0000 UTC m=+2.130064648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-cnibin\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovn-node-metrics-cert\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.555775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmtzc\" (UniqueName: \"kubernetes.io/projected/156b3b9a-0a65-47e2-afb5-9422e6d35b87-kube-api-access-xmtzc\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8d9c1b8-bbbe-4d59-9dca-740badddfb6f-konnectivity-ca\") pod \"konnectivity-agent-7hnc6\" (UID: \"e8d9c1b8-bbbe-4d59-9dca-740badddfb6f\") " pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsvm8\" (UniqueName: \"kubernetes.io/projected/040eca42-314a-403a-ac5c-7cbdaca15ba7-kube-api-access-gsvm8\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysctl-conf\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555795    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-kubelet\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f1bbc8-1630-41c8-8039-e43598efb150-tmp\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-socket-dir-parent\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhf5t\" (UniqueName: \"kubernetes.io/projected/e06bf42c-d569-41bd-9e77-d76937bac19d-kube-api-access-fhf5t\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555895    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysctl-conf\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-run\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.555975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00207c1c-888a-415e-8ed8-ed3758102a85-kubelet-config\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-host-slash\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-cni-bin\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556066    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-run\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.556567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cnibin\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp5zn\" (UniqueName: \"kubernetes.io/projected/13e22d30-dab1-41df-a83d-2530f9f9cfba-kube-api-access-zp5zn\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-host\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e06bf42c-d569-41bd-9e77-d76937bac19d-cni-binary-copy\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556224    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8d9c1b8-bbbe-4d59-9dca-740badddfb6f-konnectivity-ca\") pod \"konnectivity-agent-7hnc6\" (UID: \"e8d9c1b8-bbbe-4d59-9dca-740badddfb6f\") " pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-multus-certs\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-host\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00207c1c-888a-415e-8ed8-ed3758102a85-dbus\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-systemd\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqk7r\" (UniqueName: \"kubernetes.io/projected/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-kube-api-access-cqk7r\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556403    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-host\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-k8s-cni-cncf-io\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-cni-multus\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-node-log\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-log-socket\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.557259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556557    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-device-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-lib-modules\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/040eca42-314a-403a-ac5c-7cbdaca15ba7-device-dir\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bngg9\" (UniqueName: \"kubernetes.io/projected/75f1bbc8-1630-41c8-8039-e43598efb150-kube-api-access-bngg9\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-slash\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556768    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-lib-modules\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8d9c1b8-bbbe-4d59-9dca-740badddfb6f-agent-certs\") pod \"konnectivity-agent-7hnc6\" (UID: \"e8d9c1b8-bbbe-4d59-9dca-740badddfb6f\") " pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e22d30-dab1-41df-a83d-2530f9f9cfba-tmp-dir\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ldsl\" (UniqueName: \"kubernetes.io/projected/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-kube-api-access-4ldsl\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556942    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.556981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovnkube-script-lib\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-daemon-config\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.558031 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysconfig\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-iptables-alerter-script\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-etc-sysconfig\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557248    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e22d30-dab1-41df-a83d-2530f9f9cfba-tmp-dir\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557311    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-sys\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557336    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-run-netns\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557400    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75f1bbc8-1630-41c8-8039-e43598efb150-sys\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557450    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-var-lib-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-cni-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-kubelet\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-conf-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-etc-kubernetes\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.558551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.557650    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s8blg"
Sep 11 12:47:03.559089 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.559072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75f1bbc8-1630-41c8-8039-e43598efb150-etc-tuned\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.559127 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.559114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f1bbc8-1630-41c8-8039-e43598efb150-tmp\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.559186 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.559158    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8d9c1b8-bbbe-4d59-9dca-740badddfb6f-agent-certs\") pod \"konnectivity-agent-7hnc6\" (UID: \"e8d9c1b8-bbbe-4d59-9dca-740badddfb6f\") " pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:03.563704 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.563680    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7p4k\" (UniqueName: \"kubernetes.io/projected/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-kube-api-access-n7p4k\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:03.564059 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.564038    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsvm8\" (UniqueName: \"kubernetes.io/projected/040eca42-314a-403a-ac5c-7cbdaca15ba7-kube-api-access-gsvm8\") pod \"aws-ebs-csi-driver-node-x5pg9\" (UID: \"040eca42-314a-403a-ac5c-7cbdaca15ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.564431 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.564412    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp5zn\" (UniqueName: \"kubernetes.io/projected/13e22d30-dab1-41df-a83d-2530f9f9cfba-kube-api-access-zp5zn\") pod \"node-resolver-wztjz\" (UID: \"13e22d30-dab1-41df-a83d-2530f9f9cfba\") " pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.564596 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.564579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bngg9\" (UniqueName: \"kubernetes.io/projected/75f1bbc8-1630-41c8-8039-e43598efb150-kube-api-access-bngg9\") pod \"tuned-kmkmd\" (UID: \"75f1bbc8-1630-41c8-8039-e43598efb150\") " pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.657875 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-env-overrides\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.657875 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-cni-bin\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-systemd-units\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-etc-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-system-cni-dir\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-cni-bin\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657971    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-serviceca\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-systemd-units\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.657996    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-etc-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-system-cni-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.658065 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-cnibin\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658086    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-system-cni-dir\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658071    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-system-cni-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovn-node-metrics-cert\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-cnibin\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658141    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmtzc\" (UniqueName: \"kubernetes.io/projected/156b3b9a-0a65-47e2-afb5-9422e6d35b87-kube-api-access-xmtzc\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-kubelet\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-socket-dir-parent\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhf5t\" (UniqueName: \"kubernetes.io/projected/e06bf42c-d569-41bd-9e77-d76937bac19d-kube-api-access-fhf5t\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658278    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-kubelet\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00207c1c-888a-415e-8ed8-ed3758102a85-kubelet-config\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-host-slash\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00207c1c-888a-415e-8ed8-ed3758102a85-kubelet-config\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-cni-bin\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-serviceca\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cnibin\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.658632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-host-slash\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658401    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-socket-dir-parent\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-host\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658440    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-env-overrides\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-cni-bin\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cnibin\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658453    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e06bf42c-d569-41bd-9e77-d76937bac19d-cni-binary-copy\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-host\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-multus-certs\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-multus-certs\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00207c1c-888a-415e-8ed8-ed3758102a85-dbus\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-systemd\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqk7r\" (UniqueName: \"kubernetes.io/projected/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-kube-api-access-cqk7r\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-k8s-cni-cncf-io\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-systemd\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658748    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-k8s-cni-cncf-io\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.659480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-cni-multus\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/156b3b9a-0a65-47e2-afb5-9422e6d35b87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-node-log\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658812    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00207c1c-888a-415e-8ed8-ed3758102a85-dbus\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-log-socket\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-node-log\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658840    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-cni-multus\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-slash\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658870    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-log-socket\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ldsl\" (UniqueName: \"kubernetes.io/projected/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-kube-api-access-4ldsl\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658907    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-slash\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovnkube-script-lib\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-daemon-config\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.660205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.658981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-iptables-alerter-script\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-run-netns\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-var-lib-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-cni-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-kubelet\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-conf-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-etc-kubernetes\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-ovn\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv56d\" (UniqueName: \"kubernetes.io/projected/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-kube-api-access-rv56d\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-hostroot\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-cni-netd\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovnkube-config\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-netns\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.660811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659474    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-run-netns\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659512    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-daemon-config\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659533    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-cni-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659532    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovnkube-script-lib\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659560    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-host-var-lib-kubelet\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.659597    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/156b3b9a-0a65-47e2-afb5-9422e6d35b87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659612    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-run-netns\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659618    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-multus-conf-dir\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659654    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-var-lib-openvswitch\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-host-cni-netd\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.659692    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret podName:00207c1c-888a-415e-8ed8-ed3758102a85 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:04.159673144 +0000 UTC m=+2.234135904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret") pod "global-pull-secret-syncer-mtkkj" (UID: "00207c1c-888a-415e-8ed8-ed3758102a85") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659699    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-etc-kubernetes\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659718    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e06bf42c-d569-41bd-9e77-d76937bac19d-hostroot\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e06bf42c-d569-41bd-9e77-d76937bac19d-cni-binary-copy\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659740    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-run-ovn\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.661341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.659815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-iptables-alerter-script\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.661846 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.660103    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovnkube-config\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.661846 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.660512    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-ovn-node-metrics-cert\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.665390 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.665367    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:03.665390 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.665387    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:03.665500 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.665399    2573 projected.go:196] Error preparing data for projected volume kube-api-access-27gwj for pod openshift-network-diagnostics/network-check-target-9rcdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:03.665500 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:03.665452    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj podName:99f5a587-7798-4edb-80c1-df45c93fa5c8 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:04.165437377 +0000 UTC m=+2.239900123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-27gwj" (UniqueName: "kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj") pod "network-check-target-9rcdd" (UID: "99f5a587-7798-4edb-80c1-df45c93fa5c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:03.667479 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.667461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ldsl\" (UniqueName: \"kubernetes.io/projected/ffd6b354-e29c-41c8-a11f-ef93cabc7e23-kube-api-access-4ldsl\") pod \"iptables-alerter-8qb7p\" (UID: \"ffd6b354-e29c-41c8-a11f-ef93cabc7e23\") " pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.667570 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.667497    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmtzc\" (UniqueName: \"kubernetes.io/projected/156b3b9a-0a65-47e2-afb5-9422e6d35b87-kube-api-access-xmtzc\") pod \"multus-additional-cni-plugins-x7m6g\" (UID: \"156b3b9a-0a65-47e2-afb5-9422e6d35b87\") " pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.667570 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.667513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhf5t\" (UniqueName: \"kubernetes.io/projected/e06bf42c-d569-41bd-9e77-d76937bac19d-kube-api-access-fhf5t\") pod \"multus-4h2dq\" (UID: \"e06bf42c-d569-41bd-9e77-d76937bac19d\") " pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.668481 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.668459    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv56d\" (UniqueName: \"kubernetes.io/projected/5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476-kube-api-access-rv56d\") pod \"ovnkube-node-fn6l6\" (UID: \"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.668679 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.668663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqk7r\" (UniqueName: \"kubernetes.io/projected/a3ab1a90-bc67-4d9d-9c80-0559e467e1d1-kube-api-access-cqk7r\") pod \"node-ca-btzwl\" (UID: \"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1\") " pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.770482 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.770437    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:03.778649 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.778631    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9"
Sep 11 12:47:03.779153 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.779133    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d9c1b8_bbbe_4d59_9dca_740badddfb6f.slice/crio-344b023350d02da76d755204182429f612db00d629430a7469e8be9ea9c8c241 WatchSource:0}: Error finding container 344b023350d02da76d755204182429f612db00d629430a7469e8be9ea9c8c241: Status 404 returned error can't find the container with id 344b023350d02da76d755204182429f612db00d629430a7469e8be9ea9c8c241
Sep 11 12:47:03.786320 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.786299    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040eca42_314a_403a_ac5c_7cbdaca15ba7.slice/crio-e0460444ba274def2e3a1b6e35bd8b59e0f0d71c009e9a1555a9fdf42754af55 WatchSource:0}: Error finding container e0460444ba274def2e3a1b6e35bd8b59e0f0d71c009e9a1555a9fdf42754af55: Status 404 returned error can't find the container with id e0460444ba274def2e3a1b6e35bd8b59e0f0d71c009e9a1555a9fdf42754af55
Sep 11 12:47:03.805129 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.805112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kmkmd"
Sep 11 12:47:03.805129 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.805122    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:03.808868 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.808847    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wztjz"
Sep 11 12:47:03.811877 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.811858    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f1bbc8_1630_41c8_8039_e43598efb150.slice/crio-b6e865afd563d731a67c0d8443c35995dec52d529cceffcab2c155e236a34af3 WatchSource:0}: Error finding container b6e865afd563d731a67c0d8443c35995dec52d529cceffcab2c155e236a34af3: Status 404 returned error can't find the container with id b6e865afd563d731a67c0d8443c35995dec52d529cceffcab2c155e236a34af3
Sep 11 12:47:03.812514 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.812494    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-btzwl"
Sep 11 12:47:03.817727 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.817705    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e22d30_dab1_41df_a83d_2530f9f9cfba.slice/crio-78ad2f8c29e1bdaf27357deb25e64abe8cae91498497d9c665107c672c596a6f WatchSource:0}: Error finding container 78ad2f8c29e1bdaf27357deb25e64abe8cae91498497d9c665107c672c596a6f: Status 404 returned error can't find the container with id 78ad2f8c29e1bdaf27357deb25e64abe8cae91498497d9c665107c672c596a6f
Sep 11 12:47:03.817806 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.817774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4h2dq"
Sep 11 12:47:03.822503 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.822480    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ab1a90_bc67_4d9d_9c80_0559e467e1d1.slice/crio-6d86a474b47e49c5bf2aa6248cd909982895fb0dc2b7f1fcff2fdb2e0debfaef WatchSource:0}: Error finding container 6d86a474b47e49c5bf2aa6248cd909982895fb0dc2b7f1fcff2fdb2e0debfaef: Status 404 returned error can't find the container with id 6d86a474b47e49c5bf2aa6248cd909982895fb0dc2b7f1fcff2fdb2e0debfaef
Sep 11 12:47:03.825460 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.825442    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06bf42c_d569_41bd_9e77_d76937bac19d.slice/crio-4f1bab145baf285ecc732d3f23bcf6e661957104956347d5f502b2d1e24a390e WatchSource:0}: Error finding container 4f1bab145baf285ecc732d3f23bcf6e661957104956347d5f502b2d1e24a390e: Status 404 returned error can't find the container with id 4f1bab145baf285ecc732d3f23bcf6e661957104956347d5f502b2d1e24a390e
Sep 11 12:47:03.825727 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.825715    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x7m6g"
Sep 11 12:47:03.832399 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.832380    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8qb7p"
Sep 11 12:47:03.833217 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.833198    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156b3b9a_0a65_47e2_afb5_9422e6d35b87.slice/crio-2267de0f9df12efaa036128d80362c572e08c5a737425f1928bfb30f2f6d6c54 WatchSource:0}: Error finding container 2267de0f9df12efaa036128d80362c572e08c5a737425f1928bfb30f2f6d6c54: Status 404 returned error can't find the container with id 2267de0f9df12efaa036128d80362c572e08c5a737425f1928bfb30f2f6d6c54
Sep 11 12:47:03.836517 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:03.836498    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:03.839711 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.839691    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd6b354_e29c_41c8_a11f_ef93cabc7e23.slice/crio-5f0db4e7ebdf8b88c7d12d1f68f48119a2456fdbe90a7e11ae53f7bd4fdcdbd6 WatchSource:0}: Error finding container 5f0db4e7ebdf8b88c7d12d1f68f48119a2456fdbe90a7e11ae53f7bd4fdcdbd6: Status 404 returned error can't find the container with id 5f0db4e7ebdf8b88c7d12d1f68f48119a2456fdbe90a7e11ae53f7bd4fdcdbd6
Sep 11 12:47:03.844370 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:03.844351    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8a0fa2_9918_4049_a1ba_d0aa7f1dc476.slice/crio-3beaa5114c39e99ef4bedb08f7bf8a6e0cf6aff9e9abafc095607eb2d1af5221 WatchSource:0}: Error finding container 3beaa5114c39e99ef4bedb08f7bf8a6e0cf6aff9e9abafc095607eb2d1af5221: Status 404 returned error can't find the container with id 3beaa5114c39e99ef4bedb08f7bf8a6e0cf6aff9e9abafc095607eb2d1af5221
Sep 11 12:47:04.062481 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.062422    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:04.062570 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:04.062536    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:04.062625 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:04.062593    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:05.062575691 +0000 UTC m=+3.137038439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:04.162970 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.162936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:04.163104 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:04.163042    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:04.163104 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:04.163098    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret podName:00207c1c-888a-415e-8ed8-ed3758102a85 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:05.163077821 +0000 UTC m=+3.237540581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret") pod "global-pull-secret-syncer-mtkkj" (UID: "00207c1c-888a-415e-8ed8-ed3758102a85") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:04.263668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.263619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:04.264022 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:04.263761    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:04.264022 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:04.263779    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:04.264022 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:04.263788    2573 projected.go:196] Error preparing data for projected volume kube-api-access-27gwj for pod openshift-network-diagnostics/network-check-target-9rcdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:04.264022 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:04.263846    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj podName:99f5a587-7798-4edb-80c1-df45c93fa5c8 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:05.263827287 +0000 UTC m=+3.338290035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-27gwj" (UniqueName: "kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj") pod "network-check-target-9rcdd" (UID: "99f5a587-7798-4edb-80c1-df45c93fa5c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:04.551388 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.550729    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kmkmd" event={"ID":"75f1bbc8-1630-41c8-8039-e43598efb150","Type":"ContainerStarted","Data":"b6e865afd563d731a67c0d8443c35995dec52d529cceffcab2c155e236a34af3"}
Sep 11 12:47:04.563486 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.563430    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:42:04 +0000 UTC" deadline="2028-05-16 00:43:09.910042959 +0000 UTC"
Sep 11 12:47:04.563486 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.563486    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14699h56m5.346561634s"
Sep 11 12:47:04.575398 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.575361    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"3beaa5114c39e99ef4bedb08f7bf8a6e0cf6aff9e9abafc095607eb2d1af5221"}
Sep 11 12:47:04.578935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.578908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8qb7p" event={"ID":"ffd6b354-e29c-41c8-a11f-ef93cabc7e23","Type":"ContainerStarted","Data":"5f0db4e7ebdf8b88c7d12d1f68f48119a2456fdbe90a7e11ae53f7bd4fdcdbd6"}
Sep 11 12:47:04.589480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.589451    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4h2dq" event={"ID":"e06bf42c-d569-41bd-9e77-d76937bac19d","Type":"ContainerStarted","Data":"4f1bab145baf285ecc732d3f23bcf6e661957104956347d5f502b2d1e24a390e"}
Sep 11 12:47:04.604815 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.604784    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-btzwl" event={"ID":"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1","Type":"ContainerStarted","Data":"6d86a474b47e49c5bf2aa6248cd909982895fb0dc2b7f1fcff2fdb2e0debfaef"}
Sep 11 12:47:04.633425 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.633400    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:04.640434 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.640407    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9" event={"ID":"040eca42-314a-403a-ac5c-7cbdaca15ba7","Type":"ContainerStarted","Data":"e0460444ba274def2e3a1b6e35bd8b59e0f0d71c009e9a1555a9fdf42754af55"}
Sep 11 12:47:04.649157 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.649129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7hnc6" event={"ID":"e8d9c1b8-bbbe-4d59-9dca-740badddfb6f","Type":"ContainerStarted","Data":"344b023350d02da76d755204182429f612db00d629430a7469e8be9ea9c8c241"}
Sep 11 12:47:04.656970 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.656849    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerStarted","Data":"2267de0f9df12efaa036128d80362c572e08c5a737425f1928bfb30f2f6d6c54"}
Sep 11 12:47:04.683520 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:04.683491    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wztjz" event={"ID":"13e22d30-dab1-41df-a83d-2530f9f9cfba","Type":"ContainerStarted","Data":"78ad2f8c29e1bdaf27357deb25e64abe8cae91498497d9c665107c672c596a6f"}
Sep 11 12:47:05.070732 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:05.070057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:05.070732 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.070238    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:05.070732 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.070307    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:07.070286409 +0000 UTC m=+5.144749159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:05.170781 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:05.170744    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:05.170986 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.170904    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:05.170986 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.170969    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret podName:00207c1c-888a-415e-8ed8-ed3758102a85 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:07.170949955 +0000 UTC m=+5.245412703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret") pod "global-pull-secret-syncer-mtkkj" (UID: "00207c1c-888a-415e-8ed8-ed3758102a85") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:05.271183 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:05.271147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:05.271373 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.271359    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:05.271442 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.271382    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:05.271442 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.271397    2573 projected.go:196] Error preparing data for projected volume kube-api-access-27gwj for pod openshift-network-diagnostics/network-check-target-9rcdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:05.271568 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.271455    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj podName:99f5a587-7798-4edb-80c1-df45c93fa5c8 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:07.27143654 +0000 UTC m=+5.345899288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-27gwj" (UniqueName: "kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj") pod "network-check-target-9rcdd" (UID: "99f5a587-7798-4edb-80c1-df45c93fa5c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:05.511867 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:05.511774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:05.512021 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.511907    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:05.512389 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:05.512345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:05.512508 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.512445    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:05.512590 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:05.512508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:05.512651 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:05.512616    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:05.563720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:05.563679    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:42:04 +0000 UTC" deadline="2028-06-01 03:32:23.874581812 +0000 UTC"
Sep 11 12:47:05.563720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:05.563719    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15086h45m18.310868012s"
Sep 11 12:47:06.026199 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:06.026163    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:06.220357 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:06.220324    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:07.088316 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:07.086677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:07.088316 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.086907    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:07.088316 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.086980    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:11.086958476 +0000 UTC m=+9.161421231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:07.188080 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:07.187397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:07.188080 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.187620    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:07.188080 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.187691    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret podName:00207c1c-888a-415e-8ed8-ed3758102a85 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:11.187670868 +0000 UTC m=+9.262133621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret") pod "global-pull-secret-syncer-mtkkj" (UID: "00207c1c-888a-415e-8ed8-ed3758102a85") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:07.288621 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:07.287965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:07.288621 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.288139    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:07.288621 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.288163    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:07.288621 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.288177    2573 projected.go:196] Error preparing data for projected volume kube-api-access-27gwj for pod openshift-network-diagnostics/network-check-target-9rcdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:07.288621 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.288262    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj podName:99f5a587-7798-4edb-80c1-df45c93fa5c8 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:11.288240516 +0000 UTC m=+9.362703287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-27gwj" (UniqueName: "kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj") pod "network-check-target-9rcdd" (UID: "99f5a587-7798-4edb-80c1-df45c93fa5c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:07.511097 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:07.511015    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:07.511300 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.511169    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:07.511300 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:07.511266    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:07.511461 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.511416    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:07.511539 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:07.511472    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:07.511602 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:07.511556    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:09.511660 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:09.511623    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:09.512123 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:09.511641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:09.512123 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:09.511765    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:09.512123 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:09.511760    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:09.512123 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:09.511843    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:09.512123 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:09.511911    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:11.121299 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:11.120740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:11.121299 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.120910    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:11.121299 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.120970    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:19.120951972 +0000 UTC m=+17.195414717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:11.221462 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:11.221417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:11.221616 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.221568    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:11.221663 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.221628    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret podName:00207c1c-888a-415e-8ed8-ed3758102a85 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:19.221609865 +0000 UTC m=+17.296072627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret") pod "global-pull-secret-syncer-mtkkj" (UID: "00207c1c-888a-415e-8ed8-ed3758102a85") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:11.322608 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:11.322575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:11.322792 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.322771    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:11.322871 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.322803    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:11.322871 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.322815    2573 projected.go:196] Error preparing data for projected volume kube-api-access-27gwj for pod openshift-network-diagnostics/network-check-target-9rcdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:11.322975 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.322879    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj podName:99f5a587-7798-4edb-80c1-df45c93fa5c8 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:19.322858193 +0000 UTC m=+17.397320960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-27gwj" (UniqueName: "kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj") pod "network-check-target-9rcdd" (UID: "99f5a587-7798-4edb-80c1-df45c93fa5c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:11.511686 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:11.511653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:11.511686 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:11.511688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:11.511926 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.511798    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:11.511926 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.511843    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:11.511926 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:11.511893    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:11.512076 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:11.511960    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:13.512107 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:13.512060    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:13.512516 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:13.512211    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:13.512713 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:13.512685    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:13.512823 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:13.512791    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:13.512888 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:13.512860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:13.512988 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:13.512966    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:15.511042 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:15.510997    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:15.511425 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:15.511102    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:15.511425 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:15.511114    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:15.511425 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:15.511127    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:15.511425 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:15.511210    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:15.511425 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:15.511289    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:17.511461 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:17.511429    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:17.511461 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:17.511450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:17.511895 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:17.511439    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:17.511895 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:17.511546    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:17.511895 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:17.511692    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:17.511895 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:17.511810    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:19.179651 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:19.179623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:19.180157 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.179767    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:19.180157 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.179836    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:35.179816945 +0000 UTC m=+33.254279688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:19.280248 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:19.280215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:19.280445 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.280377    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:19.280505 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.280449    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret podName:00207c1c-888a-415e-8ed8-ed3758102a85 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:35.28043047 +0000 UTC m=+33.354893231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret") pod "global-pull-secret-syncer-mtkkj" (UID: "00207c1c-888a-415e-8ed8-ed3758102a85") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:19.380599 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:19.380559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:19.380770 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.380743    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:19.380770 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.380772    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:19.380917 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.380785    2573 projected.go:196] Error preparing data for projected volume kube-api-access-27gwj for pod openshift-network-diagnostics/network-check-target-9rcdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:19.380917 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.380844    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj podName:99f5a587-7798-4edb-80c1-df45c93fa5c8 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:35.380826302 +0000 UTC m=+33.455289062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-27gwj" (UniqueName: "kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj") pod "network-check-target-9rcdd" (UID: "99f5a587-7798-4edb-80c1-df45c93fa5c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:19.511916 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:19.511829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:19.511916 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:19.511875    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:19.512111 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:19.511938    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:19.512111 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.511954    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:19.512111 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.512017    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:19.512264 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:19.512139    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:21.511383 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:21.511338    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:21.511383 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:21.511370    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:21.512014 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:21.511456    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:21.512014 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:21.511501    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:21.512014 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:21.511583    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:21.512014 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:21.511643    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:23.511163 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:23.511130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:23.511533 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:23.511184    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:23.511533 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:23.511126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:23.511533 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:23.511257    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:23.511533 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:23.511334    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:23.511533 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:23.511409    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:24.731206 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.731000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7hnc6" event={"ID":"e8d9c1b8-bbbe-4d59-9dca-740badddfb6f","Type":"ContainerStarted","Data":"3993d247377766c0eb41b018c15e82f512bf1efc2299751fc09ddff095f45c07"}
Sep 11 12:47:24.732540 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.732518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal" event={"ID":"a9ec5a36a4072dcc75611810c0d28d1c","Type":"ContainerStarted","Data":"df616a475f3916fff4641b17b0687db0cd62d0b1d6443463ece38f4d4f1653db"}
Sep 11 12:47:24.733898 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.733876    2573 generic.go:356] "Generic (PLEG): container finished" podID="ce10356a9962d8b5a65baf0be87d57d9" containerID="fb47373740ddaf6f1dd1d4fd8b505894b1bae906e5fc3195b1b9758694a1e935" exitCode=0
Sep 11 12:47:24.733972 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.733933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal" event={"ID":"ce10356a9962d8b5a65baf0be87d57d9","Type":"ContainerDied","Data":"fb47373740ddaf6f1dd1d4fd8b505894b1bae906e5fc3195b1b9758694a1e935"}
Sep 11 12:47:24.735426 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.735403    2573 generic.go:356] "Generic (PLEG): container finished" podID="156b3b9a-0a65-47e2-afb5-9422e6d35b87" containerID="697ce63a5537ad7e4b3d6ae24ac9ee3c673c8186dd6309b7ab35edd3b81d3bdf" exitCode=0
Sep 11 12:47:24.735513 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.735468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerDied","Data":"697ce63a5537ad7e4b3d6ae24ac9ee3c673c8186dd6309b7ab35edd3b81d3bdf"}
Sep 11 12:47:24.737062 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.737021    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wztjz" event={"ID":"13e22d30-dab1-41df-a83d-2530f9f9cfba","Type":"ContainerStarted","Data":"0ab8a1abd6ba24715835a81b2acfb2c657b0a2c0b0a4e863990ef6387a875286"}
Sep 11 12:47:24.738699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.738657    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kmkmd" event={"ID":"75f1bbc8-1630-41c8-8039-e43598efb150","Type":"ContainerStarted","Data":"26e255013b17d78495bbd575b69f8be71c6ff45d9836a6742515a7a3a6773995"}
Sep 11 12:47:24.741747 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.741731    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 12:47:24.742085 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.742064    2573 generic.go:356] "Generic (PLEG): container finished" podID="5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476" containerID="1395e6606a32ce3d297ae7b009049eca02ecd9bddf6956127b7ed38a54757cdb" exitCode=1
Sep 11 12:47:24.742146 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.742131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"163e36ed64105ebfd43a2e863d8868f1dc181cf5033040ebb384d7f4e7518b0c"}
Sep 11 12:47:24.742225 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.742209    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"de698c3f0bd17e3207fbf4ad3ec59503e9f14895450bce1f57d58568181cc376"}
Sep 11 12:47:24.742281 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.742252    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"ce8bb6aaf8e5a058d7b9a7d7256ec6b4d4fbdddcd538447bd926344fc8d4c7c9"}
Sep 11 12:47:24.742319 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.742288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"7c3689265967b13b07ea7b2cd73f5b4165e59f5c3bb1c94f02d32e30c40197a0"}
Sep 11 12:47:24.742373 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.742361    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerDied","Data":"1395e6606a32ce3d297ae7b009049eca02ecd9bddf6956127b7ed38a54757cdb"}
Sep 11 12:47:24.742417 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.742406    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"0059b85a4656d4e0041f249ad3f28fae642b33428feeffec9f23a9f26a948b94"}
Sep 11 12:47:24.743637 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.743615    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4h2dq" event={"ID":"e06bf42c-d569-41bd-9e77-d76937bac19d","Type":"ContainerStarted","Data":"db1555f27e920dec29cf4e8e87632d37fa0386d679f518f798db6e3b8177dd5e"}
Sep 11 12:47:24.745130 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.745114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-btzwl" event={"ID":"a3ab1a90-bc67-4d9d-9c80-0559e467e1d1","Type":"ContainerStarted","Data":"827147c11b445d2b6349700be7b6fbe15f886203fd95e68492bf4f9c84898adf"}
Sep 11 12:47:24.746604 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.746589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9" event={"ID":"040eca42-314a-403a-ac5c-7cbdaca15ba7","Type":"ContainerStarted","Data":"c7d967a8f5ac8f8289697f74e24fb7025fd5e50ab107b1ed5925fdb403be3b4e"}
Sep 11 12:47:24.749727 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.749687    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7hnc6" podStartSLOduration=5.556109125 podStartE2EDuration="21.749676221s" totalImagesPullingTime="16.193567096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:24.749361109 +0000 UTC m=+22.823823871" watchObservedRunningTime="2026-09-11 12:47:24.749676221 +0000 UTC m=+22.824138985"
Sep 11 12:47:24.764858 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.764827    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kmkmd" podStartSLOduration=1.856623145 podStartE2EDuration="21.764817007s" totalImagesPullingTime="19.908193862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:24.764321031 +0000 UTC m=+22.838783794" watchObservedRunningTime="2026-09-11 12:47:24.764817007 +0000 UTC m=+22.839279770"
Sep 11 12:47:24.792516 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.792471    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wztjz" podStartSLOduration=1.892815626 podStartE2EDuration="21.792460346s" totalImagesPullingTime="19.89964472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:24.792121505 +0000 UTC m=+22.866584269" watchObservedRunningTime="2026-09-11 12:47:24.792460346 +0000 UTC m=+22.866923110"
Sep 11 12:47:24.792693 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.792668    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-btzwl" podStartSLOduration=1.9296883839999999 podStartE2EDuration="21.792659921s" totalImagesPullingTime="19.862971537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:24.777823832 +0000 UTC m=+22.852286596" watchObservedRunningTime="2026-09-11 12:47:24.792659921 +0000 UTC m=+22.867122681"
Sep 11 12:47:24.818683 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:24.818645    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4h2dq" podStartSLOduration=1.479343828 podStartE2EDuration="21.818634149s" totalImagesPullingTime="20.339290321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:24.81857738 +0000 UTC m=+22.893040143" watchObservedRunningTime="2026-09-11 12:47:24.818634149 +0000 UTC m=+22.893096913"
Sep 11 12:47:25.511858 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.511818    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:25.512207 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:25.511927    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:25.512207 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.511837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:25.512207 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.511959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:25.512207 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:25.512050    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:25.512207 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:25.512133    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:25.687870 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.687690    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 12:47:25.749532 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.749499    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8qb7p" event={"ID":"ffd6b354-e29c-41c8-a11f-ef93cabc7e23","Type":"ContainerStarted","Data":"997162dfad28c7b5eb37d8257db88d2688768dacf985c855d0084e1c96c485f6"}
Sep 11 12:47:25.751307 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.751273    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9" event={"ID":"040eca42-314a-403a-ac5c-7cbdaca15ba7","Type":"ContainerStarted","Data":"cf634ef0598cfed19fc8604722c9843fe9d5dba1346dd3fd30f54898bb27793f"}
Sep 11 12:47:25.764365 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.764291    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8qb7p" podStartSLOduration=2.970120858 podStartE2EDuration="22.764277768s" totalImagesPullingTime="19.79415691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:25.764043722 +0000 UTC m=+23.838506485" watchObservedRunningTime="2026-09-11 12:47:25.764277768 +0000 UTC m=+23.838740531"
Sep 11 12:47:25.764518 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.764500    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-225.ec2.internal" podStartSLOduration=22.76449541 podStartE2EDuration="22.76449541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:24.856246736 +0000 UTC m=+22.930709500" watchObservedRunningTime="2026-09-11 12:47:25.76449541 +0000 UTC m=+23.838958177"
Sep 11 12:47:25.887753 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.887727    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:25.888322 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:25.888302    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:26.522350 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:26.522257    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T12:47:25.687867476Z","UUID":"e52da0db-ff7e-4b2a-bcc7-3ac4ce31ada0","Handler":null,"Name":"","Endpoint":""}
Sep 11 12:47:26.523904 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:26.523885    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 12:47:26.524029 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:26.523915    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 12:47:26.754939 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:26.754911    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal" event={"ID":"ce10356a9962d8b5a65baf0be87d57d9","Type":"ContainerStarted","Data":"9386719f7eb8d15ee9a4bf2375d14b193222fa4b9d06c82ca62343465451a55f"}
Sep 11 12:47:26.772283 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:26.772247    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-225.ec2.internal" podStartSLOduration=23.772232017 podStartE2EDuration="23.772232017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:26.772114946 +0000 UTC m=+24.846577710" watchObservedRunningTime="2026-09-11 12:47:26.772232017 +0000 UTC m=+24.846694780"
Sep 11 12:47:27.511037 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:27.511008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:27.511166 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:27.511114    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:27.511166 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:27.511122    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:27.511269 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:27.511217    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:27.511269 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:27.511123    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:27.511332 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:27.511308    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:27.759246 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:27.759224    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 12:47:27.759605 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:27.759549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"6af95a5a6daac1211f53042752142c6147626a8e3d1c6551a2d7fabb6761b195"}
Sep 11 12:47:27.761350 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:27.761290    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9" event={"ID":"040eca42-314a-403a-ac5c-7cbdaca15ba7","Type":"ContainerStarted","Data":"f047c13e17a05b580414afd42ab9046e7be84e275e704ce4e749af209d6f89a4"}
Sep 11 12:47:27.761350 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:27.761312    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 12:47:27.778732 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:27.778693    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5pg9" podStartSLOduration=2.601597937 podStartE2EDuration="24.778682803s" totalImagesPullingTime="22.177084866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:27.778090028 +0000 UTC m=+25.852552792" watchObservedRunningTime="2026-09-11 12:47:27.778682803 +0000 UTC m=+25.853145567"
Sep 11 12:47:29.511039 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:29.511005    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:29.511039 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:29.511022    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:29.511514 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:29.511029    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:29.511514 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:29.511141    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:29.511514 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:29.511255    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:29.511514 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:29.511353    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:30.772826 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:30.772632    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 12:47:30.773302 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:30.773278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"6f4998022df546a24137cfc32cc7a4778abdad55d7b2247f28b0ff9618cf4ec9"}
Sep 11 12:47:30.773550 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:30.773510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:30.773612 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:30.773601    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:30.773712 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:30.773691    2573 scope.go:117] "RemoveContainer" containerID="1395e6606a32ce3d297ae7b009049eca02ecd9bddf6956127b7ed38a54757cdb"
Sep 11 12:47:30.775730 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:30.775702    2573 generic.go:356] "Generic (PLEG): container finished" podID="156b3b9a-0a65-47e2-afb5-9422e6d35b87" containerID="4c11ac33850f39d008e3edf243fcd9285427f1db1841c7c2bb65b055051bc3fc" exitCode=0
Sep 11 12:47:30.775822 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:30.775745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerDied","Data":"4c11ac33850f39d008e3edf243fcd9285427f1db1841c7c2bb65b055051bc3fc"}
Sep 11 12:47:30.792049 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:30.792023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:31.440322 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.440294    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:31.440479 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.440424    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 12:47:31.441218 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.441193    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7hnc6"
Sep 11 12:47:31.511276 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.511249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:31.511402 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.511249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:31.511402 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:31.511385    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:31.511513 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.511263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:31.511513 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:31.511412    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:31.511513 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:31.511491    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:31.781690 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.781632    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 12:47:31.782267 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.782022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" event={"ID":"5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476","Type":"ContainerStarted","Data":"4e7a3776ed3cc5dc54fcec8717ce49c06130a3f361501978612001e263f400de"}
Sep 11 12:47:31.782267 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.782207    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:31.796184 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.796154    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:47:31.814712 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.814668    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6" podStartSLOduration=8.906856622 podStartE2EDuration="28.814656379s" totalImagesPullingTime="19.907799757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:31.813907176 +0000 UTC m=+29.888369940" watchObservedRunningTime="2026-09-11 12:47:31.814656379 +0000 UTC m=+29.889119143"
Sep 11 12:47:31.968109 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.968078    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtkkj"]
Sep 11 12:47:31.968264 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.968249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:31.968380 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:31.968359    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:31.971050 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.971027    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9rcdd"]
Sep 11 12:47:31.971139 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.971125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:31.971236 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:31.971220    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:31.971779 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.971758    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b42r4"]
Sep 11 12:47:31.971881 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:31.971868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:31.972044 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:31.971982    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:32.786492 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:32.786459    2573 generic.go:356] "Generic (PLEG): container finished" podID="156b3b9a-0a65-47e2-afb5-9422e6d35b87" containerID="d27d61e72671abbb3e7cef6b7ddd4803eaa54f0ce770da11ca1561ff8118589d" exitCode=0
Sep 11 12:47:32.787016 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:32.786553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerDied","Data":"d27d61e72671abbb3e7cef6b7ddd4803eaa54f0ce770da11ca1561ff8118589d"}
Sep 11 12:47:33.512139 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:33.511959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:33.512275 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:33.511960    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:33.512275 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:33.512246    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:33.512386 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:33.512002    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:33.512386 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:33.512311    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:33.512478 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:33.512417    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:33.794318 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:33.794287    2573 generic.go:356] "Generic (PLEG): container finished" podID="156b3b9a-0a65-47e2-afb5-9422e6d35b87" containerID="d1986c7f509070327b9cb2116a00a6001427e6505f014f33b4dc458b462090d2" exitCode=0
Sep 11 12:47:33.794693 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:33.794371    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerDied","Data":"d1986c7f509070327b9cb2116a00a6001427e6505f014f33b4dc458b462090d2"}
Sep 11 12:47:35.205375 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:35.205339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:35.205794 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.205506    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:35.205794 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.205589    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:48:07.205567694 +0000 UTC m=+65.280030453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:35.305726 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:35.305687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:35.305855 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.305819    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:35.305924 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.305882    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret podName:00207c1c-888a-415e-8ed8-ed3758102a85 nodeName:}" failed. No retries permitted until 2026-09-11 12:48:07.305866225 +0000 UTC m=+65.380328981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret") pod "global-pull-secret-syncer-mtkkj" (UID: "00207c1c-888a-415e-8ed8-ed3758102a85") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:35.406407 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:35.406340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:35.406501 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.406489    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:35.406547 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.406506    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:35.406547 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.406518    2573 projected.go:196] Error preparing data for projected volume kube-api-access-27gwj for pod openshift-network-diagnostics/network-check-target-9rcdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:35.406607 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.406570    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj podName:99f5a587-7798-4edb-80c1-df45c93fa5c8 nodeName:}" failed. No retries permitted until 2026-09-11 12:48:07.406554721 +0000 UTC m=+65.481017478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-27gwj" (UniqueName: "kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj") pod "network-check-target-9rcdd" (UID: "99f5a587-7798-4edb-80c1-df45c93fa5c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:35.511943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:35.511916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:35.511943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:35.511942    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:35.512114 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:35.511916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:35.512114 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.512018    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:47:35.512114 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.512092    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtkkj" podUID="00207c1c-888a-415e-8ed8-ed3758102a85"
Sep 11 12:47:35.512288 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:35.512159    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rcdd" podUID="99f5a587-7798-4edb-80c1-df45c93fa5c8"
Sep 11 12:47:36.788783 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.788746    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-225.ec2.internal" event="NodeReady"
Sep 11 12:47:36.789248 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.788878    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 12:47:36.822757 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.822730    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"]
Sep 11 12:47:36.888625 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.888559    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"]
Sep 11 12:47:36.888625 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.888600    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"]
Sep 11 12:47:36.888814 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.888687    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:36.890984 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.890958    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 12:47:36.891101 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.891082    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wqf2z\""
Sep 11 12:47:36.891165 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.891144    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 12:47:36.891281 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.891268    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 12:47:36.897515 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.897005    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 12:47:36.900535 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.900518    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9qsb6"]
Sep 11 12:47:36.900638 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.900625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:36.902606 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.902588    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 12:47:36.902717 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.902641    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-96f9t\""
Sep 11 12:47:36.902717 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.902707    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 12:47:36.918859 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.918839    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d65zw"]
Sep 11 12:47:36.919040 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.919022    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9qsb6"
Sep 11 12:47:36.921046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.921023    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 12:47:36.921046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.921041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 12:47:36.921362 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.921332    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ss7sh\""
Sep 11 12:47:36.921362 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.921337    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 12:47:36.945072 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.945049    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"]
Sep 11 12:47:36.945156 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.945084    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d65zw"]
Sep 11 12:47:36.945156 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.945115    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9qsb6"]
Sep 11 12:47:36.945252 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.945224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:36.947256 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.947237    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 12:47:36.947358 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.947267    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 12:47:36.947513 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.947499    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2v8d4\""
Sep 11 12:47:36.980103 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:36.980079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:37.015531 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.015619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-installation-pull-secrets\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.015619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjg2\" (UniqueName: \"kubernetes.io/projected/2c2e050e-3b78-4c92-a219-9ca503b9d674-kube-api-access-xcjg2\") pod \"ingress-canary-9qsb6\" (UID: \"2c2e050e-3b78-4c92-a219-9ca503b9d674\") " pod="openshift-ingress-canary/ingress-canary-9qsb6"
Sep 11 12:47:37.015619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fa467b7-52a9-468c-9be9-916acfc8541d-config-volume\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.015619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fa467b7-52a9-468c-9be9-916acfc8541d-tmp-dir\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.015768 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:37.015768 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.015768 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6f7l\" (UniqueName: \"kubernetes.io/projected/5fa467b7-52a9-468c-9be9-916acfc8541d-kube-api-access-s6f7l\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.015768 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ff2549-92ac-4ba9-8499-186df7c6ce8a-ca-trust-extracted\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.015768 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-trusted-ca\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.015951 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-image-registry-private-configuration\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.015951 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-certificates\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.015951 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015867    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-bound-sa-token\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.015951 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhwn\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-kube-api-access-pmhwn\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.015951 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:37.015951 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.015926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c2e050e-3b78-4c92-a219-9ca503b9d674-cert\") pod \"ingress-canary-9qsb6\" (UID: \"2c2e050e-3b78-4c92-a219-9ca503b9d674\") " pod="openshift-ingress-canary/ingress-canary-9qsb6"
Sep 11 12:47:37.068765 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.068738    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:37.116639 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.116620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.116748 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.116648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-installation-pull-secrets\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.116748 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.116667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjg2\" (UniqueName: \"kubernetes.io/projected/2c2e050e-3b78-4c92-a219-9ca503b9d674-kube-api-access-xcjg2\") pod \"ingress-canary-9qsb6\" (UID: \"2c2e050e-3b78-4c92-a219-9ca503b9d674\") " pod="openshift-ingress-canary/ingress-canary-9qsb6"
Sep 11 12:47:37.116748 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.116684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fa467b7-52a9-468c-9be9-916acfc8541d-config-volume\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.116748 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.116701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fa467b7-52a9-468c-9be9-916acfc8541d-tmp-dir\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.116888 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.116778    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:37.116888 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.116832    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:47:37.616816491 +0000 UTC m=+35.691279234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117043    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fa467b7-52a9-468c-9be9-916acfc8541d-tmp-dir\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117074    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6f7l\" (UniqueName: \"kubernetes.io/projected/5fa467b7-52a9-468c-9be9-916acfc8541d-kube-api-access-s6f7l\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ff2549-92ac-4ba9-8499-186df7c6ce8a-ca-trust-extracted\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-trusted-ca\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.117206    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.117221    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-image-registry-private-configuration\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-certificates\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-bound-sa-token\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhwn\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-kube-api-access-pmhwn\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117336    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c2e050e-3b78-4c92-a219-9ca503b9d674-cert\") pod \"ingress-canary-9qsb6\" (UID: \"2c2e050e-3b78-4c92-a219-9ca503b9d674\") " pod="openshift-ingress-canary/ingress-canary-9qsb6"
Sep 11 12:47:37.117807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117392    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fa467b7-52a9-468c-9be9-916acfc8541d-config-volume\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.118641 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ff2549-92ac-4ba9-8499-186df7c6ce8a-ca-trust-extracted\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.118641 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.117816    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:37.118641 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.117853    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:47:37.617831019 +0000 UTC m=+35.692293767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:47:37.118641 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.117935    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:47:37.118641 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.117979    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:37.617966152 +0000 UTC m=+35.692428908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:47:37.118641 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.118331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-certificates\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.118938 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.118645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-trusted-ca\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.121975 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.121956    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c2e050e-3b78-4c92-a219-9ca503b9d674-cert\") pod \"ingress-canary-9qsb6\" (UID: \"2c2e050e-3b78-4c92-a219-9ca503b9d674\") " pod="openshift-ingress-canary/ingress-canary-9qsb6"
Sep 11 12:47:37.122060 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.121962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-image-registry-private-configuration\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.122786 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.122767    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-installation-pull-secrets\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.125150 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.125125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjg2\" (UniqueName: \"kubernetes.io/projected/2c2e050e-3b78-4c92-a219-9ca503b9d674-kube-api-access-xcjg2\") pod \"ingress-canary-9qsb6\" (UID: \"2c2e050e-3b78-4c92-a219-9ca503b9d674\") " pod="openshift-ingress-canary/ingress-canary-9qsb6"
Sep 11 12:47:37.125657 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.125636    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6f7l\" (UniqueName: \"kubernetes.io/projected/5fa467b7-52a9-468c-9be9-916acfc8541d-kube-api-access-s6f7l\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.126503 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.126480    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhwn\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-kube-api-access-pmhwn\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.126603 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.126542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-bound-sa-token\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.228265 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.228217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9qsb6"
Sep 11 12:47:37.511767 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.511695    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:47:37.511767 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.511714    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:47:37.511948 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.511916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:47:37.514371 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.514231    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:47:37.514371 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.514283    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86zcf\""
Sep 11 12:47:37.514371 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.514233    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:47:37.514371 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.514233    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kdd4\""
Sep 11 12:47:37.514805 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.514504    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:47:37.514805 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.514594    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:47:37.530534 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.530318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9qsb6"]
Sep 11 12:47:37.533813 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:47:37.533791    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2e050e_3b78_4c92_a219_9ca503b9d674.slice/crio-7e056029cf80be52998cd2a5ad3428a6c6e36aa42d0e2ff6498db499f00ddcf0 WatchSource:0}: Error finding container 7e056029cf80be52998cd2a5ad3428a6c6e36aa42d0e2ff6498db499f00ddcf0: Status 404 returned error can't find the container with id 7e056029cf80be52998cd2a5ad3428a6c6e36aa42d0e2ff6498db499f00ddcf0
Sep 11 12:47:37.620830 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.620794    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:37.620935 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.620918    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:47:37.620935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.620922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:37.621043 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.620937    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:47:37.621043 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.620977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:37.621043 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.621000    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:47:38.620981079 +0000 UTC m=+36.695443843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:47:37.621192 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.621064    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:37.621192 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.621124    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:47:38.621109613 +0000 UTC m=+36.695572373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:37.621305 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.621209    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:47:37.621305 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:37.621255    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:38.62124229 +0000 UTC m=+36.695705037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:47:37.804768 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.804733    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9qsb6" event={"ID":"2c2e050e-3b78-4c92-a219-9ca503b9d674","Type":"ContainerStarted","Data":"7e056029cf80be52998cd2a5ad3428a6c6e36aa42d0e2ff6498db499f00ddcf0"}
Sep 11 12:47:37.847777 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:37.847740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:38.603430 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:38.603390    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:38.628222 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:38.628191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:38.628370 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:38.628245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:38.628370 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:38.628294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:38.628370 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:38.628350    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:47:38.628524 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:38.628413    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:38.628524 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:38.628428    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:40.628406781 +0000 UTC m=+38.702869547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:47:38.628524 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:38.628453    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:47:38.628524 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:38.628468    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:47:40.628450343 +0000 UTC m=+38.702913109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:38.628524 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:38.628472    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:47:38.628524 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:38.628520    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:47:40.628508947 +0000 UTC m=+38.702971688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:47:38.702104 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:38.702072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:39.548738 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:39.548701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:39.602144 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:39.602090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:39.814915 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:39.814839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerStarted","Data":"65b9822d33538c7a368b0b469322fdf537eb360ca5acd30be6986f28017d295a"}
Sep 11 12:47:40.494723 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:40.494684    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:40.555184 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:40.555151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:40.646434 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:40.646402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:40.646615 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:40.646473    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:40.646615 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:40.646518    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:40.646615 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:40.646574    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:47:40.646615 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:40.646598    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:40.646809 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:40.646651    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:47:44.646631393 +0000 UTC m=+42.721094147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:40.646809 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:40.646669    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:44.64665974 +0000 UTC m=+42.721122483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:47:40.646809 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:40.646678    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:47:40.646809 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:40.646692    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:47:40.646809 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:40.646740    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:47:44.646724499 +0000 UTC m=+42.721187261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:47:40.821658 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:40.821623    2573 generic.go:356] "Generic (PLEG): container finished" podID="156b3b9a-0a65-47e2-afb5-9422e6d35b87" containerID="65b9822d33538c7a368b0b469322fdf537eb360ca5acd30be6986f28017d295a" exitCode=0
Sep 11 12:47:40.821821 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:40.821703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerDied","Data":"65b9822d33538c7a368b0b469322fdf537eb360ca5acd30be6986f28017d295a"}
Sep 11 12:47:41.827142 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:41.826915    2573 generic.go:356] "Generic (PLEG): container finished" podID="156b3b9a-0a65-47e2-afb5-9422e6d35b87" containerID="23bef1b592dbd05fa547f16dd741fcf1a3b6f2ae4d57502dad9783d2c2e0ca46" exitCode=0
Sep 11 12:47:41.827750 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:41.826991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerDied","Data":"23bef1b592dbd05fa547f16dd741fcf1a3b6f2ae4d57502dad9783d2c2e0ca46"}
Sep 11 12:47:41.828750 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:41.828725    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9qsb6" event={"ID":"2c2e050e-3b78-4c92-a219-9ca503b9d674","Type":"ContainerStarted","Data":"703db7bfa84ae84c8a43311f6879c886fc10bdad439ed5848f93ffa4af84dc7f"}
Sep 11 12:47:41.860362 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:41.860196    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9qsb6" podStartSLOduration=1.858980955 podStartE2EDuration="5.860159094s" totalImagesPullingTime="4.001178139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:41.859070068 +0000 UTC m=+39.933532832" watchObservedRunningTime="2026-09-11 12:47:41.860159094 +0000 UTC m=+39.934621862"
Sep 11 12:47:42.378713 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:42.378677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:42.428220 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:42.428199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:42.491230 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:42.491204    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:42.835136 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:42.835088    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" event={"ID":"156b3b9a-0a65-47e2-afb5-9422e6d35b87","Type":"ContainerStarted","Data":"469f5d11b8f4b738972756d33d800a7adf9365b9261cccc7c28b61af1335723b"}
Sep 11 12:47:42.856713 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:42.856669    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x7m6g" podStartSLOduration=7.016842444 podStartE2EDuration="39.856652841s" totalImagesPullingTime="32.839810397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:42.85583216 +0000 UTC m=+40.930294924" watchObservedRunningTime="2026-09-11 12:47:42.856652841 +0000 UTC m=+40.931115583"
Sep 11 12:47:42.976462 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:42.976425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:43.077258 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:43.077227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:44.674681 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:44.674641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:44.674681 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:44.674687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:44.675094 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:44.674717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:44.675094 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:44.674796    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:47:44.675094 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:44.674829    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:44.675094 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:44.674833    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:47:44.675094 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:44.674852    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:47:44.675094 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:44.674874    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:52.674853313 +0000 UTC m=+50.749316093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:47:44.675094 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:44.674890    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:47:52.674883561 +0000 UTC m=+50.749346304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:44.675094 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:44.674902    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:47:52.674896264 +0000 UTC m=+50.749359006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:47:47.422079 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:47.422049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:50.492780 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:50.492745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:50.592740 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:50.592681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:50.942948 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:50.942916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:51.046391 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:51.046366    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:51.359847 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:51.359817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:51.460416 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:51.460387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:52.730034 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:52.730001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:52.730044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:52.730068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:52.730147    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:52.730157    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:52.730153    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:52.730194    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:52.730232    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:48:08.73021856 +0000 UTC m=+66.804681302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:52.730244    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:48:08.730238835 +0000 UTC m=+66.804701577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:47:52.730445 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:47:52.730254    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:48:08.730248889 +0000 UTC m=+66.804711631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:52.820500 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:52.820456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:54.981579 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:54.981533    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:55.646539 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:55.646485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:55.706418 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:47:55.706381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:03.805580 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:03.805549    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn6l6"
Sep 11 12:48:03.954884 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:03.954854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:04.054843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:04.054816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:07.228311 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.228257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:48:07.230531 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.230512    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:48:07.239227 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:07.239204    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 12:48:07.239280 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:07.239265    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:49:11.239249384 +0000 UTC m=+129.313712126 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : secret "metrics-daemon-secret" not found
Sep 11 12:48:07.329195 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.329140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:48:07.331872 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.331852    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:48:07.343160 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.343127    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00207c1c-888a-415e-8ed8-ed3758102a85-original-pull-secret\") pod \"global-pull-secret-syncer-mtkkj\" (UID: \"00207c1c-888a-415e-8ed8-ed3758102a85\") " pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:48:07.429811 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.429771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:48:07.432129 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.432110    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:48:07.442784 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.442761    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:48:07.453792 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.453763    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27gwj\" (UniqueName: \"kubernetes.io/projected/99f5a587-7798-4edb-80c1-df45c93fa5c8-kube-api-access-27gwj\") pod \"network-check-target-9rcdd\" (UID: \"99f5a587-7798-4edb-80c1-df45c93fa5c8\") " pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:48:07.524640 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.524565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkkj"
Sep 11 12:48:07.546695 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.546676    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kdd4\""
Sep 11 12:48:07.555149 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.555126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:48:07.794190 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.794138    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtkkj"]
Sep 11 12:48:07.798781 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:48:07.798754    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00207c1c_888a_415e_8ed8_ed3758102a85.slice/crio-6feac268f0356a2d21a3bcc1a8ed55ff040e465a886c249c69d846c389b0949a WatchSource:0}: Error finding container 6feac268f0356a2d21a3bcc1a8ed55ff040e465a886c249c69d846c389b0949a: Status 404 returned error can't find the container with id 6feac268f0356a2d21a3bcc1a8ed55ff040e465a886c249c69d846c389b0949a
Sep 11 12:48:07.826995 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.826968    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9rcdd"]
Sep 11 12:48:07.830140 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:48:07.830117    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f5a587_7798_4edb_80c1_df45c93fa5c8.slice/crio-f0956c040dcc6070b7ba0a958b83ae62cd9cd7f72742ca60637b6054104f94fd WatchSource:0}: Error finding container f0956c040dcc6070b7ba0a958b83ae62cd9cd7f72742ca60637b6054104f94fd: Status 404 returned error can't find the container with id f0956c040dcc6070b7ba0a958b83ae62cd9cd7f72742ca60637b6054104f94fd
Sep 11 12:48:07.890213 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.890159    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9rcdd" event={"ID":"99f5a587-7798-4edb-80c1-df45c93fa5c8","Type":"ContainerStarted","Data":"f0956c040dcc6070b7ba0a958b83ae62cd9cd7f72742ca60637b6054104f94fd"}
Sep 11 12:48:07.891396 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:07.891370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtkkj" event={"ID":"00207c1c-888a-415e-8ed8-ed3758102a85","Type":"ContainerStarted","Data":"6feac268f0356a2d21a3bcc1a8ed55ff040e465a886c249c69d846c389b0949a"}
Sep 11 12:48:08.740626 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:08.740573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:08.740652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:08.740717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:08.740746    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:08.740794    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:08.740809    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:08.740823    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:48:40.74080031 +0000 UTC m=+98.815263071 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:08.740832    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:08.740844    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:48:40.740833017 +0000 UTC m=+98.815295772 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:48:08.741166 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:08.740874    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:48:40.740862565 +0000 UTC m=+98.815325320 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:48:12.906822 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:12.906738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9rcdd" event={"ID":"99f5a587-7798-4edb-80c1-df45c93fa5c8","Type":"ContainerStarted","Data":"9b35f9423f80b83b08a71a5563ee9e565285481139613967ee7c255379270c89"}
Sep 11 12:48:12.907252 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:12.906829    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:48:12.908435 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:12.908415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtkkj" event={"ID":"00207c1c-888a-415e-8ed8-ed3758102a85","Type":"ContainerStarted","Data":"a306dbf3becea378b129832b865950ef09880572c0e22f51115afbb7d4a63d01"}
Sep 11 12:48:12.921843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:12.921802    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9rcdd" podStartSLOduration=65.14567114 podStartE2EDuration="1m9.921790027s" totalImagesPullingTime="4.776118887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:48:12.921337144 +0000 UTC m=+70.995799909" watchObservedRunningTime="2026-09-11 12:48:12.921790027 +0000 UTC m=+70.996252790"
Sep 11 12:48:12.941277 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:12.941240    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mtkkj" podStartSLOduration=65.1265009 podStartE2EDuration="1m9.941228338s" totalImagesPullingTime="4.814727438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:48:12.941210484 +0000 UTC m=+71.015673245" watchObservedRunningTime="2026-09-11 12:48:12.941228338 +0000 UTC m=+71.015691102"
Sep 11 12:48:12.965982 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:12.965953    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:13.018843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:13.018814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:16.576919 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:16.576881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:16.640217 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:16.640162    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:16.700446 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:16.700410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:40.754792 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:40.754662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:48:40.754792 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:40.754728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:48:40.754792 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:40.754757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:48:40.755338 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:40.754838    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:48:40.755338 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:40.754853    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:48:40.755338 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:40.754865    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:48:40.755338 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:40.754878    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:48:40.755338 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:40.754925    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:49:44.754909399 +0000 UTC m=+162.829372142 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:48:40.755338 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:40.754939    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:49:44.754932014 +0000 UTC m=+162.829394756 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:48:40.755338 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:48:40.754948    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:49:44.754943259 +0000 UTC m=+162.829406000 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:48:41.092345 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:41.092302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:41.221463 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:41.221430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:43.913622 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:48:43.913589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9rcdd"
Sep 11 12:49:11.266376 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:49:11.266332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:49:11.266880 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:11.266488    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 12:49:11.266880 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:11.266578    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:13.266561015 +0000 UTC m=+251.341023757 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : secret "metrics-daemon-secret" not found
Sep 11 12:49:39.900698 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:39.900640    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8" podUID="91ff2549-92ac-4ba9-8499-186df7c6ce8a"
Sep 11 12:49:39.910817 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:39.910779    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc" podUID="78459e83-a7f9-49d2-8c93-6c8a4fdf4737"
Sep 11 12:49:39.954136 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:39.954111    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d65zw" podUID="5fa467b7-52a9-468c-9be9-916acfc8541d"
Sep 11 12:49:40.116588 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:49:40.116564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:49:40.533316 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:40.533282    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:49:44.798964 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:49:44.798917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:49:44.798964 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:49:44.798973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:49:44.799509 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:49:44.798998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:49:44.799509 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:44.799090    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:49:44.799509 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:44.799112    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:49:44.799509 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:44.799096    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:49:44.799509 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:44.799210    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f66b7b9bf-9xrw8: secret "image-registry-tls" not found
Sep 11 12:49:44.799509 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:44.799202    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert podName:78459e83-a7f9-49d2-8c93-6c8a4fdf4737 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:46.799163622 +0000 UTC m=+284.873626364 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-pr4pc" (UID: "78459e83-a7f9-49d2-8c93-6c8a4fdf4737") : secret "networking-console-plugin-cert" not found
Sep 11 12:49:44.799509 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:44.799273    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls podName:5fa467b7-52a9-468c-9be9-916acfc8541d nodeName:}" failed. No retries permitted until 2026-09-11 12:51:46.799258845 +0000 UTC m=+284.873721587 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls") pod "dns-default-d65zw" (UID: "5fa467b7-52a9-468c-9be9-916acfc8541d") : secret "dns-default-metrics-tls" not found
Sep 11 12:49:44.799509 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:49:44.799283    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls podName:91ff2549-92ac-4ba9-8499-186df7c6ce8a nodeName:}" failed. No retries permitted until 2026-09-11 12:51:46.799277604 +0000 UTC m=+284.873740346 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls") pod "image-registry-6f66b7b9bf-9xrw8" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a") : secret "image-registry-tls" not found
Sep 11 12:49:50.512002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:49:50.511961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:49:52.512229 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:49:52.512189    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:49:54.511864 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:49:54.511783    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d65zw"
Sep 11 12:51:13.303353 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:13.303302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:51:13.303826 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:13.303451    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 12:51:13.303826 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:13.303529    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs podName:a0a3aa5e-7557-48d8-8eb1-c2d0178b3609 nodeName:}" failed. No retries permitted until 2026-09-11 12:53:15.303512003 +0000 UTC m=+373.377974761 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs") pod "network-metrics-daemon-b42r4" (UID: "a0a3aa5e-7557-48d8-8eb1-c2d0178b3609") : secret "metrics-daemon-secret" not found
Sep 11 12:51:20.026436 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.026405    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq"]
Sep 11 12:51:20.028145 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.028127    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-587cc5f64b-ntxkx"]
Sep 11 12:51:20.028288 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.028264    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq"
Sep 11 12:51:20.029836 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.029817    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"]
Sep 11 12:51:20.029997 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.029974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.032385 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.032358    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 12:51:20.032692 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.032366    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:51:20.033466 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.033445    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 12:51:20.035404 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.035379    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-79vjd\""
Sep 11 12:51:20.035976 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.035947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.040832 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.040813    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 12:51:20.040919 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.040878    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 12:51:20.040919 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.040894    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 12:51:20.041043 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.041027    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5zs24\""
Sep 11 12:51:20.041264 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.041248    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 12:51:20.041516 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.041499    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 12:51:20.041560 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.041530    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tpz8r\""
Sep 11 12:51:20.041601 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.041579    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 12:51:20.041601 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.041581    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 12:51:20.041696 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.041585    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 12:51:20.043395 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.043375    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 12:51:20.049600 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.049575    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq"]
Sep 11 12:51:20.055929 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.055906    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"]
Sep 11 12:51:20.057883 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.057861    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-587cc5f64b-ntxkx"]
Sep 11 12:51:20.113751 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.113729    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ljjvs"]
Sep 11 12:51:20.115414 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.115399    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.125525 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.125509    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 12:51:20.125525 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.125523    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cjf26\""
Sep 11 12:51:20.125667 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.125657    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:51:20.126200 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.126186    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 12:51:20.130441 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.130426    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 12:51:20.132548 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.132531    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 12:51:20.137536 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.137520    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ljjvs"]
Sep 11 12:51:20.146834 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.146813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nchvr\" (UniqueName: \"kubernetes.io/projected/97fb5f2f-400c-4d0b-ba77-572577ce7daa-kube-api-access-nchvr\") pod \"volume-data-source-validator-86695b7cc7-ptvlq\" (UID: \"97fb5f2f-400c-4d0b-ba77-572577ce7daa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq"
Sep 11 12:51:20.146936 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.146846    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.146936 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.146861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-stats-auth\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.146936 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.146878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxn24\" (UniqueName: \"kubernetes.io/projected/1d3447b5-569c-4668-8694-213ff5c1d709-kube-api-access-rxn24\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.146936 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.146930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-default-certificate\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.147091 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.146960    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.147091 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.146977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q72lm\" (UniqueName: \"kubernetes.io/projected/c515922d-1ac8-45d8-8528-7d96eb381c55-kube-api-access-q72lm\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.147091 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.146999    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c515922d-1ac8-45d8-8528-7d96eb381c55-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.147091 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.147023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.247981 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.247961    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxn24\" (UniqueName: \"kubernetes.io/projected/1d3447b5-569c-4668-8694-213ff5c1d709-kube-api-access-rxn24\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.248092 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ada48c-34c3-47d4-b837-ed9d3823c489-serving-cert\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.248092 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ada48c-34c3-47d4-b837-ed9d3823c489-config\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.248234 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-default-certificate\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.248234 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.248234 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72lm\" (UniqueName: \"kubernetes.io/projected/c515922d-1ac8-45d8-8528-7d96eb381c55-kube-api-access-q72lm\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.248234 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c515922d-1ac8-45d8-8528-7d96eb381c55-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.248440 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcsdz\" (UniqueName: \"kubernetes.io/projected/55ada48c-34c3-47d4-b837-ed9d3823c489-kube-api-access-qcsdz\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.248440 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.248295    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:20.248440 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.248440 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.248369    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls podName:c515922d-1ac8-45d8-8528-7d96eb381c55 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:20.748349053 +0000 UTC m=+258.822811795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qv4lt" (UID: "c515922d-1ac8-45d8-8528-7d96eb381c55") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:20.248440 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248404    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/55ada48c-34c3-47d4-b837-ed9d3823c489-trusted-ca\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.248440 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.248418    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:51:20.248737 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nchvr\" (UniqueName: \"kubernetes.io/projected/97fb5f2f-400c-4d0b-ba77-572577ce7daa-kube-api-access-nchvr\") pod \"volume-data-source-validator-86695b7cc7-ptvlq\" (UID: \"97fb5f2f-400c-4d0b-ba77-572577ce7daa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq"
Sep 11 12:51:20.248737 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.248486    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:20.748473173 +0000 UTC m=+258.822935915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : secret "router-metrics-certs-default" not found
Sep 11 12:51:20.248737 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.248737 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-stats-auth\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.248737 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.248664    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:20.748647485 +0000 UTC m=+258.823110227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : configmap references non-existent config key: service-ca.crt
Sep 11 12:51:20.249192 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.248974    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c515922d-1ac8-45d8-8528-7d96eb381c55-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.250679 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.250660    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-default-certificate\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.250813 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.250798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-stats-auth\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.261994 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.261967    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q72lm\" (UniqueName: \"kubernetes.io/projected/c515922d-1ac8-45d8-8528-7d96eb381c55-kube-api-access-q72lm\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.264407 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.264381    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxn24\" (UniqueName: \"kubernetes.io/projected/1d3447b5-569c-4668-8694-213ff5c1d709-kube-api-access-rxn24\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.264824 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.264791    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nchvr\" (UniqueName: \"kubernetes.io/projected/97fb5f2f-400c-4d0b-ba77-572577ce7daa-kube-api-access-nchvr\") pod \"volume-data-source-validator-86695b7cc7-ptvlq\" (UID: \"97fb5f2f-400c-4d0b-ba77-572577ce7daa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq"
Sep 11 12:51:20.330665 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.330638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:20.344046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.344032    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq"
Sep 11 12:51:20.348767 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.348745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcsdz\" (UniqueName: \"kubernetes.io/projected/55ada48c-34c3-47d4-b837-ed9d3823c489-kube-api-access-qcsdz\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.348842 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.348782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/55ada48c-34c3-47d4-b837-ed9d3823c489-trusted-ca\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.348901 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.348890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ada48c-34c3-47d4-b837-ed9d3823c489-serving-cert\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.348960 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.348922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ada48c-34c3-47d4-b837-ed9d3823c489-config\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.349643 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.349607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ada48c-34c3-47d4-b837-ed9d3823c489-config\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.349786 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.349766    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/55ada48c-34c3-47d4-b837-ed9d3823c489-trusted-ca\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.351616 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.351599    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ada48c-34c3-47d4-b837-ed9d3823c489-serving-cert\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.366894 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.366873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcsdz\" (UniqueName: \"kubernetes.io/projected/55ada48c-34c3-47d4-b837-ed9d3823c489-kube-api-access-qcsdz\") pod \"console-operator-696884fb9c-ljjvs\" (UID: \"55ada48c-34c3-47d4-b837-ed9d3823c489\") " pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.415709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.415680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:20.423608 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.423591    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:20.611408 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.611340    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq"]
Sep 11 12:51:20.614741 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:20.614716    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fb5f2f_400c_4d0b_ba77_572577ce7daa.slice/crio-ed288041afb3ee46f316d5dc92fec3f83e36a3eb59d316d2989974d4c79d706e WatchSource:0}: Error finding container ed288041afb3ee46f316d5dc92fec3f83e36a3eb59d316d2989974d4c79d706e: Status 404 returned error can't find the container with id ed288041afb3ee46f316d5dc92fec3f83e36a3eb59d316d2989974d4c79d706e
Sep 11 12:51:20.688894 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.688871    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ljjvs"]
Sep 11 12:51:20.691568 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:20.691545    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ada48c_34c3_47d4_b837_ed9d3823c489.slice/crio-99f3aa704bafb8b74791047e19cde3eab164adb0464cf2ba2deb4fd900b5b60c WatchSource:0}: Error finding container 99f3aa704bafb8b74791047e19cde3eab164adb0464cf2ba2deb4fd900b5b60c: Status 404 returned error can't find the container with id 99f3aa704bafb8b74791047e19cde3eab164adb0464cf2ba2deb4fd900b5b60c
Sep 11 12:51:20.750882 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.750857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:20.750964 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.750888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.750964 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:20.750936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:20.751036 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.751003    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:20.751080 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.751068    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls podName:c515922d-1ac8-45d8-8528-7d96eb381c55 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:21.751050282 +0000 UTC m=+259.825513039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qv4lt" (UID: "c515922d-1ac8-45d8-8528-7d96eb381c55") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:20.751116 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.751080    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:51:20.751147 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.751086    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:21.751080418 +0000 UTC m=+259.825543159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : configmap references non-existent config key: service-ca.crt
Sep 11 12:51:20.751147 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:20.751140    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:21.751122075 +0000 UTC m=+259.825584829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : secret "router-metrics-certs-default" not found
Sep 11 12:51:21.355052 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:21.354972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq" event={"ID":"97fb5f2f-400c-4d0b-ba77-572577ce7daa","Type":"ContainerStarted","Data":"ed288041afb3ee46f316d5dc92fec3f83e36a3eb59d316d2989974d4c79d706e"}
Sep 11 12:51:21.356550 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:21.356515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" event={"ID":"55ada48c-34c3-47d4-b837-ed9d3823c489","Type":"ContainerStarted","Data":"99f3aa704bafb8b74791047e19cde3eab164adb0464cf2ba2deb4fd900b5b60c"}
Sep 11 12:51:21.763637 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:21.758997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:21.763637 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:21.759061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:21.763637 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:21.759122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:21.763637 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:21.759369    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:23.759348735 +0000 UTC m=+261.833811494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : configmap references non-existent config key: service-ca.crt
Sep 11 12:51:21.763637 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:21.759475    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:21.763637 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:21.759519    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls podName:c515922d-1ac8-45d8-8528-7d96eb381c55 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:23.759506837 +0000 UTC m=+261.833969593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qv4lt" (UID: "c515922d-1ac8-45d8-8528-7d96eb381c55") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:21.763637 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:21.759590    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:51:21.763637 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:21.759630    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:23.759610934 +0000 UTC m=+261.834073681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : secret "router-metrics-certs-default" not found
Sep 11 12:51:22.361096 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:22.361058    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq" event={"ID":"97fb5f2f-400c-4d0b-ba77-572577ce7daa","Type":"ContainerStarted","Data":"a0f93f37023296fbdc81337152faec180fa13e30aea5c86599bd9b7e421337cb"}
Sep 11 12:51:22.390318 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:22.390260    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ptvlq" podStartSLOduration=2.262394151 podStartE2EDuration="3.390241247s" totalImagesPullingTime="1.127847096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:22.388201671 +0000 UTC m=+260.462664432" watchObservedRunningTime="2026-09-11 12:51:22.390241247 +0000 UTC m=+260.464704012"
Sep 11 12:51:22.532111 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:22.532077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:22.628992 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:22.628921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:23.365692 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:23.365666    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/0.log"
Sep 11 12:51:23.366087 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:23.365708    2573 generic.go:356] "Generic (PLEG): container finished" podID="55ada48c-34c3-47d4-b837-ed9d3823c489" containerID="192cbfcb4dd86dbb65ca2154c6d73fb326f798103181feccbf97ff73a8aeccbf" exitCode=255
Sep 11 12:51:23.366087 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:23.365745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" event={"ID":"55ada48c-34c3-47d4-b837-ed9d3823c489","Type":"ContainerDied","Data":"192cbfcb4dd86dbb65ca2154c6d73fb326f798103181feccbf97ff73a8aeccbf"}
Sep 11 12:51:23.366087 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:23.365995    2573 scope.go:117] "RemoveContainer" containerID="192cbfcb4dd86dbb65ca2154c6d73fb326f798103181feccbf97ff73a8aeccbf"
Sep 11 12:51:23.774720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:23.774633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:23.774720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:23.774691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:23.774915 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:23.774749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:23.774915 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:23.774775    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:23.774915 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:23.774845    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls podName:c515922d-1ac8-45d8-8528-7d96eb381c55 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:27.774827488 +0000 UTC m=+265.849290229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qv4lt" (UID: "c515922d-1ac8-45d8-8528-7d96eb381c55") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:23.774915 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:23.774845    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:51:23.774915 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:23.774915    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:27.774897372 +0000 UTC m=+265.849360174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : secret "router-metrics-certs-default" not found
Sep 11 12:51:23.775099 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:23.774933    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:27.77492669 +0000 UTC m=+265.849389431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : configmap references non-existent config key: service-ca.crt
Sep 11 12:51:24.375193 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:24.375114    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/1.log"
Sep 11 12:51:24.375575 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:24.375560    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/0.log"
Sep 11 12:51:24.375616 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:24.375593    2573 generic.go:356] "Generic (PLEG): container finished" podID="55ada48c-34c3-47d4-b837-ed9d3823c489" containerID="18f26cc81439e98c810a146a5d8ec9f6ed788b55c39ce120b09acc94ffcb4946" exitCode=255
Sep 11 12:51:24.375680 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:24.375660    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" event={"ID":"55ada48c-34c3-47d4-b837-ed9d3823c489","Type":"ContainerDied","Data":"18f26cc81439e98c810a146a5d8ec9f6ed788b55c39ce120b09acc94ffcb4946"}
Sep 11 12:51:24.375784 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:24.375748    2573 scope.go:117] "RemoveContainer" containerID="192cbfcb4dd86dbb65ca2154c6d73fb326f798103181feccbf97ff73a8aeccbf"
Sep 11 12:51:24.375950 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:24.375936    2573 scope.go:117] "RemoveContainer" containerID="18f26cc81439e98c810a146a5d8ec9f6ed788b55c39ce120b09acc94ffcb4946"
Sep 11 12:51:24.376123 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:24.376104    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ljjvs_openshift-console-operator(55ada48c-34c3-47d4-b837-ed9d3823c489)\"" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" podUID="55ada48c-34c3-47d4-b837-ed9d3823c489"
Sep 11 12:51:24.913070 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:24.913028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:25.106274 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.106243    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-79xvb"]
Sep 11 12:51:25.109067 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.109046    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.114484 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.114457    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 12:51:25.114484 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.114475    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 12:51:25.115612 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.115583    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 12:51:25.115745 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.115646    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 12:51:25.115745 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.115666    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqv5f\""
Sep 11 12:51:25.125954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.125928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:25.154752 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.154721    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79xvb"]
Sep 11 12:51:25.285251 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.285224    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.285368 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.285259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsl7m\" (UniqueName: \"kubernetes.io/projected/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-api-access-fsl7m\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.285368 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.285339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.285496 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.285434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a390ebca-bf3b-48c2-a476-74680b3e4c51-crio-socket\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.285496 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.285481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a390ebca-bf3b-48c2-a476-74680b3e4c51-data-volume\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.297687 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.297656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:25.380839 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.380814    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/1.log"
Sep 11 12:51:25.381267 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.381109    2573 scope.go:117] "RemoveContainer" containerID="18f26cc81439e98c810a146a5d8ec9f6ed788b55c39ce120b09acc94ffcb4946"
Sep 11 12:51:25.381324 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.381287    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ljjvs_openshift-console-operator(55ada48c-34c3-47d4-b837-ed9d3823c489)\"" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" podUID="55ada48c-34c3-47d4-b837-ed9d3823c489"
Sep 11 12:51:25.386057 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.386039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.386101 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.386067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsl7m\" (UniqueName: \"kubernetes.io/projected/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-api-access-fsl7m\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.386219 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.386195    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:25.386307 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.386238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.386307 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.386263    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:25.886245872 +0000 UTC m=+263.960708614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:25.386440 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.386343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a390ebca-bf3b-48c2-a476-74680b3e4c51-crio-socket\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.386440 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.386350    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:25.386440 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.386381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a390ebca-bf3b-48c2-a476-74680b3e4c51-data-volume\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.386440 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.386432    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:25.886409869 +0000 UTC m=+263.960872647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:25.386587 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.386467    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a390ebca-bf3b-48c2-a476-74680b3e4c51-crio-socket\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.386728 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.386703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a390ebca-bf3b-48c2-a476-74680b3e4c51-data-volume\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.401092 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.401067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsl7m\" (UniqueName: \"kubernetes.io/projected/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-api-access-fsl7m\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.730485 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.730381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:25.830515 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.830477    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:25.891687 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.891662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.891785 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.891761    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:25.891837 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.891794    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:25.891873 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.891848    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:25.891873 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.891863    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:26.891848478 +0000 UTC m=+264.966311264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:25.891945 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:25.891888    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:26.891875955 +0000 UTC m=+264.966338696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:25.960638 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:25.960610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:26.101300 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:26.101245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:26.464217 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:26.464127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:26.571970 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:26.571936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:26.898715 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:26.898680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:26.898900 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:26.898811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:26.898900 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:26.898862    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:26.898900 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:26.898898    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:26.898998 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:26.898935    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:28.898916521 +0000 UTC m=+266.973379283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:26.898998 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:26.898950    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:28.898943195 +0000 UTC m=+266.973405937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:27.142559 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:27.142530    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wztjz_13e22d30-dab1-41df-a83d-2530f9f9cfba/dns-node-resolver/0.log"
Sep 11 12:51:27.597390 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:27.597360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:27.715886 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:27.715858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:27.742829 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:27.742810    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-btzwl_a3ab1a90-bc67-4d9d-9c80-0559e467e1d1/node-ca/0.log"
Sep 11 12:51:27.807358 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:27.807323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:27.807471 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:27.807417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:27.807471 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:27.807454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:27.807546 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:27.807508    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:35.807489944 +0000 UTC m=+273.881952704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : configmap references non-existent config key: service-ca.crt
Sep 11 12:51:27.807599 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:27.807552    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:27.807599 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:27.807557    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:51:27.807711 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:27.807617    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:35.807605346 +0000 UTC m=+273.882068109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : secret "router-metrics-certs-default" not found
Sep 11 12:51:27.807711 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:27.807629    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls podName:c515922d-1ac8-45d8-8528-7d96eb381c55 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:35.807623368 +0000 UTC m=+273.882086110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qv4lt" (UID: "c515922d-1ac8-45d8-8528-7d96eb381c55") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:28.052242 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.052212    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-d7cds"]
Sep 11 12:51:28.054256 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.054240    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.057191 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.057155    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 12:51:28.057548 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.057530    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 12:51:28.057631 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.057546    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 12:51:28.057631 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.057565    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-59vrc\""
Sep 11 12:51:28.057631 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.057581    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 12:51:28.068941 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.068920    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-d7cds"]
Sep 11 12:51:28.142068 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.142039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:28.209946 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.209924    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw6qh\" (UniqueName: \"kubernetes.io/projected/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-kube-api-access-fw6qh\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.210046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.209977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-signing-cabundle\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.210046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.210002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-signing-key\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.245883 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.245852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:28.310314 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.310262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-signing-cabundle\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.310314 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.310291    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-signing-key\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.310536 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.310515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw6qh\" (UniqueName: \"kubernetes.io/projected/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-kube-api-access-fw6qh\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.310962 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.310907    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-signing-cabundle\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.312738 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.312712    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-signing-key\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.320279 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.320252    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw6qh\" (UniqueName: \"kubernetes.io/projected/7d19e2d5-91a3-4255-ae10-ad2bbfe24865-kube-api-access-fw6qh\") pod \"service-ca-568869fdc5-d7cds\" (UID: \"7d19e2d5-91a3-4255-ae10-ad2bbfe24865\") " pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.362794 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.362759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-d7cds"
Sep 11 12:51:28.542933 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.542901    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9qsb6_2c2e050e-3b78-4c92-a219-9ca503b9d674/serve-healthcheck-canary/0.log"
Sep 11 12:51:28.631367 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.631295    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-d7cds"]
Sep 11 12:51:28.634524 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:28.634495    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d19e2d5_91a3_4255_ae10_ad2bbfe24865.slice/crio-2b9a611f7315f23848a1bf0f883f7006088ad0299b3ae0296961b474d1208886 WatchSource:0}: Error finding container 2b9a611f7315f23848a1bf0f883f7006088ad0299b3ae0296961b474d1208886: Status 404 returned error can't find the container with id 2b9a611f7315f23848a1bf0f883f7006088ad0299b3ae0296961b474d1208886
Sep 11 12:51:28.916157 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.916077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:28.916157 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:28.916129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:28.916355 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:28.916217    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:28.916355 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:28.916259    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:28.916355 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:28.916281    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:32.916266211 +0000 UTC m=+270.990728954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:28.916355 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:28.916300    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:32.916288566 +0000 UTC m=+270.990751331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:29.294985 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:29.294942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:29.397947 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:29.397908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-d7cds" event={"ID":"7d19e2d5-91a3-4255-ae10-ad2bbfe24865","Type":"ContainerStarted","Data":"2b9a611f7315f23848a1bf0f883f7006088ad0299b3ae0296961b474d1208886"}
Sep 11 12:51:30.424124 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:30.424096    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:30.424503 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:30.424156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:30.424503 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:30.424488    2573 scope.go:117] "RemoveContainer" containerID="18f26cc81439e98c810a146a5d8ec9f6ed788b55c39ce120b09acc94ffcb4946"
Sep 11 12:51:30.424670 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:30.424648    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ljjvs_openshift-console-operator(55ada48c-34c3-47d4-b837-ed9d3823c489)\"" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" podUID="55ada48c-34c3-47d4-b837-ed9d3823c489"
Sep 11 12:51:31.405345 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:31.405307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-d7cds" event={"ID":"7d19e2d5-91a3-4255-ae10-ad2bbfe24865","Type":"ContainerStarted","Data":"d729791d91d884a443d15ee6d6ee55986c0fe8281225ab44a587d34ad2fa3a1d"}
Sep 11 12:51:31.855727 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:31.855688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:32.087759 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:32.087719    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:32.208583 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:32.208517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:32.322703 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:32.322674    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:32.504476 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:32.504397    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:32.952372 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:32.952333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:32.952726 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:32.952395    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:32.952726 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:32.952476    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:32.952726 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:32.952485    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:32.952726 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:32.952558    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:40.952537395 +0000 UTC m=+279.027000148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:32.952726 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:32.952583    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:40.952573478 +0000 UTC m=+279.027036224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:33.475484 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:33.475451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:33.664687 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:33.664640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:33.960538 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:33.960511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:34.076370 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:34.076342    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:34.495272 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:34.495236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:34.808258 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:34.808229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:35.062416 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:35.062327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:35.313828 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:35.313751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:35.664309 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:35.664230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:35.770637 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:35.770605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:35.872222 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:35.872187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:35.872364 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:35.872250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:35.872364 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:35.872282    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:51:35.872364 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:35.872317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:35.872364 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:35.872351    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:51.872331885 +0000 UTC m=+289.946794650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : secret "router-metrics-certs-default" not found
Sep 11 12:51:35.872512 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:35.872394    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle podName:1d3447b5-569c-4668-8694-213ff5c1d709 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:51.87238251 +0000 UTC m=+289.946845266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle") pod "router-default-587cc5f64b-ntxkx" (UID: "1d3447b5-569c-4668-8694-213ff5c1d709") : configmap references non-existent config key: service-ca.crt
Sep 11 12:51:35.872512 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:35.872393    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:35.872512 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:35.872439    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls podName:c515922d-1ac8-45d8-8528-7d96eb381c55 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:51.872428513 +0000 UTC m=+289.946891256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qv4lt" (UID: "c515922d-1ac8-45d8-8528-7d96eb381c55") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:51:35.874419 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:35.874394    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:36.477662 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:36.477622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:36.885733 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:36.885693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:37.253688 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:37.253598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:37.650713 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:37.650677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:37.958990 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:37.958899    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:38.059981 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:38.059940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:38.160521 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:38.160489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:38.260647 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:38.260558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:38.714896 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:38.714856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:39.291535 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:39.291504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:39.858348 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:39.858305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:40.054855 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:40.054824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:40.288398 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:40.288366    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:40.511681 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:40.511641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:40.617406 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:40.617308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:40.718659 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:40.718617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:41.018300 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:41.018213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:41.018739 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:41.018319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:41.018739 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:41.018364    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:41.018739 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:41.018443    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls podName:a390ebca-bf3b-48c2-a476-74680b3e4c51 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:57.018420777 +0000 UTC m=+295.092883730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79xvb" (UID: "a390ebca-bf3b-48c2-a476-74680b3e4c51") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:41.018892 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:41.018774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a390ebca-bf3b-48c2-a476-74680b3e4c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:41.260653 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:41.260614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:41.448873 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:41.448841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:41.857471 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:41.857428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:42.267979 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:42.267893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:42.448951 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:42.448907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:42.514896 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:42.514877    2573 scope.go:117] "RemoveContainer" containerID="18f26cc81439e98c810a146a5d8ec9f6ed788b55c39ce120b09acc94ffcb4946"
Sep 11 12:51:43.117496 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:43.117453    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc" podUID="78459e83-a7f9-49d2-8c93-6c8a4fdf4737"
Sep 11 12:51:43.442829 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:43.442753    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 12:51:43.443276 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:43.443208    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/1.log"
Sep 11 12:51:43.443276 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:43.443247    2573 generic.go:356] "Generic (PLEG): container finished" podID="55ada48c-34c3-47d4-b837-ed9d3823c489" containerID="a98c4b91adb40fff07bb1d619781e6a743e4b2bc189032aa6d353f8793c29b45" exitCode=255
Sep 11 12:51:43.443405 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:43.443284    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" event={"ID":"55ada48c-34c3-47d4-b837-ed9d3823c489","Type":"ContainerDied","Data":"a98c4b91adb40fff07bb1d619781e6a743e4b2bc189032aa6d353f8793c29b45"}
Sep 11 12:51:43.443405 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:43.443313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:51:43.443405 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:43.443340    2573 scope.go:117] "RemoveContainer" containerID="18f26cc81439e98c810a146a5d8ec9f6ed788b55c39ce120b09acc94ffcb4946"
Sep 11 12:51:43.443711 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:43.443690    2573 scope.go:117] "RemoveContainer" containerID="a98c4b91adb40fff07bb1d619781e6a743e4b2bc189032aa6d353f8793c29b45"
Sep 11 12:51:43.443880 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:43.443860    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-ljjvs_openshift-console-operator(55ada48c-34c3-47d4-b837-ed9d3823c489)\"" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" podUID="55ada48c-34c3-47d4-b837-ed9d3823c489"
Sep 11 12:51:43.459983 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:43.459937    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-d7cds" podStartSLOduration=13.737698863 podStartE2EDuration="15.45992421s" totalImagesPullingTime="1.722225347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:31.428064386 +0000 UTC m=+269.502527150" watchObservedRunningTime="2026-09-11 12:51:43.45992421 +0000 UTC m=+281.534386974"
Sep 11 12:51:44.447547 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:44.447519    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 12:51:46.861760 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:46.861715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:51:46.862141 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:46.861783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:51:46.862141 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:46.861811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:51:46.864283 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:46.864249    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fa467b7-52a9-468c-9be9-916acfc8541d-metrics-tls\") pod \"dns-default-d65zw\" (UID: \"5fa467b7-52a9-468c-9be9-916acfc8541d\") " pod="openshift-dns/dns-default-d65zw"
Sep 11 12:51:46.864410 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:46.864316    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78459e83-a7f9-49d2-8c93-6c8a4fdf4737-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-pr4pc\" (UID: \"78459e83-a7f9-49d2-8c93-6c8a4fdf4737\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:51:46.864410 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:46.864313    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"image-registry-6f66b7b9bf-9xrw8\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") " pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:51:46.915596 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:46.915562    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wqf2z\""
Sep 11 12:51:46.924406 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:46.924383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:51:47.014946 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.014918    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2v8d4\""
Sep 11 12:51:47.022703 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.022683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d65zw"
Sep 11 12:51:47.046753 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.046724    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-96f9t\""
Sep 11 12:51:47.054821 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.054796    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"
Sep 11 12:51:47.207801 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.207730    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"]
Sep 11 12:51:47.210454 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:47.210431    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ff2549_92ac_4ba9_8499_186df7c6ce8a.slice/crio-93bfd5e43098ae3d91f47cdaf642ee923f5b922a2bad3c92bcc27374b8ded4a1 WatchSource:0}: Error finding container 93bfd5e43098ae3d91f47cdaf642ee923f5b922a2bad3c92bcc27374b8ded4a1: Status 404 returned error can't find the container with id 93bfd5e43098ae3d91f47cdaf642ee923f5b922a2bad3c92bcc27374b8ded4a1
Sep 11 12:51:47.296208 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.296162    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d65zw"]
Sep 11 12:51:47.300349 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:47.300320    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa467b7_52a9_468c_9be9_916acfc8541d.slice/crio-86741bc2c9646514ecf678cad75de1c6decd072f975b2169e54e38bc3db7e3f3 WatchSource:0}: Error finding container 86741bc2c9646514ecf678cad75de1c6decd072f975b2169e54e38bc3db7e3f3: Status 404 returned error can't find the container with id 86741bc2c9646514ecf678cad75de1c6decd072f975b2169e54e38bc3db7e3f3
Sep 11 12:51:47.329289 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.329262    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc"]
Sep 11 12:51:47.333081 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:47.333051    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78459e83_a7f9_49d2_8c93_6c8a4fdf4737.slice/crio-687a0e96e98e3adf0e1fabbc9cb8de08c26818e2b1a1b79ac59cc34213c56b29 WatchSource:0}: Error finding container 687a0e96e98e3adf0e1fabbc9cb8de08c26818e2b1a1b79ac59cc34213c56b29: Status 404 returned error can't find the container with id 687a0e96e98e3adf0e1fabbc9cb8de08c26818e2b1a1b79ac59cc34213c56b29
Sep 11 12:51:47.458325 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.458248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8" event={"ID":"91ff2549-92ac-4ba9-8499-186df7c6ce8a","Type":"ContainerStarted","Data":"ecc3e069c3ebfe3631c7b134879947ee0f5073d80343b04a1e317b919dbfe7d9"}
Sep 11 12:51:47.458325 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.458306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8" event={"ID":"91ff2549-92ac-4ba9-8499-186df7c6ce8a","Type":"ContainerStarted","Data":"93bfd5e43098ae3d91f47cdaf642ee923f5b922a2bad3c92bcc27374b8ded4a1"}
Sep 11 12:51:47.458536 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.458350    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:51:47.459572 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.459549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc" event={"ID":"78459e83-a7f9-49d2-8c93-6c8a4fdf4737","Type":"ContainerStarted","Data":"687a0e96e98e3adf0e1fabbc9cb8de08c26818e2b1a1b79ac59cc34213c56b29"}
Sep 11 12:51:47.460607 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.460589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d65zw" event={"ID":"5fa467b7-52a9-468c-9be9-916acfc8541d","Type":"ContainerStarted","Data":"86741bc2c9646514ecf678cad75de1c6decd072f975b2169e54e38bc3db7e3f3"}
Sep 11 12:51:47.484747 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:47.484703    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8" podStartSLOduration=284.484689527 podStartE2EDuration="4m44.484689527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:47.484525383 +0000 UTC m=+285.558988148" watchObservedRunningTime="2026-09-11 12:51:47.484689527 +0000 UTC m=+285.559152290"
Sep 11 12:51:49.469269 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:49.469162    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d65zw" event={"ID":"5fa467b7-52a9-468c-9be9-916acfc8541d","Type":"ContainerStarted","Data":"74047172c7b38b5b90b46d8633d8b7088be9e8912d13b30681c502e7d4ea09f8"}
Sep 11 12:51:49.469696 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:49.469280    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d65zw"
Sep 11 12:51:49.469696 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:49.469305    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d65zw" event={"ID":"5fa467b7-52a9-468c-9be9-916acfc8541d","Type":"ContainerStarted","Data":"a04241cb55cd0ef081c1f04c1d9b5b72f7ec1efcdec371db6d0d6f22e4e405c4"}
Sep 11 12:51:49.470624 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:49.470601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc" event={"ID":"78459e83-a7f9-49d2-8c93-6c8a4fdf4737","Type":"ContainerStarted","Data":"f81ffa352c7a5dd72a8f324d6f6b67a5b954e726aa6f24d473238e49981e10e5"}
Sep 11 12:51:49.496936 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:49.496886    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d65zw" podStartSLOduration=251.739552924 podStartE2EDuration="4m13.496873537s" totalImagesPullingTime="1.757320613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:49.4960471 +0000 UTC m=+287.570509865" watchObservedRunningTime="2026-09-11 12:51:49.496873537 +0000 UTC m=+287.571336300"
Sep 11 12:51:49.517614 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:49.517568    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-pr4pc" podStartSLOduration=266.798234414 podStartE2EDuration="4m28.517555646s" totalImagesPullingTime="1.719321232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:49.516120026 +0000 UTC m=+287.590582790" watchObservedRunningTime="2026-09-11 12:51:49.517555646 +0000 UTC m=+287.592018407"
Sep 11 12:51:50.424007 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:50.423966    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:50.424151 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:50.424027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:51:50.424333 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:50.424319    2573 scope.go:117] "RemoveContainer" containerID="a98c4b91adb40fff07bb1d619781e6a743e4b2bc189032aa6d353f8793c29b45"
Sep 11 12:51:50.424485 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:50.424467    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-ljjvs_openshift-console-operator(55ada48c-34c3-47d4-b837-ed9d3823c489)\"" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" podUID="55ada48c-34c3-47d4-b837-ed9d3823c489"
Sep 11 12:51:51.903363 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:51.903324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:51.903719 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:51.903368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:51.903719 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:51.903563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:51.904140 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:51.904122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d3447b5-569c-4668-8694-213ff5c1d709-service-ca-bundle\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:51.905894 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:51.905872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d3447b5-569c-4668-8694-213ff5c1d709-metrics-certs\") pod \"router-default-587cc5f64b-ntxkx\" (UID: \"1d3447b5-569c-4668-8694-213ff5c1d709\") " pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:51.905983 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:51.905872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c515922d-1ac8-45d8-8528-7d96eb381c55-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qv4lt\" (UID: \"c515922d-1ac8-45d8-8528-7d96eb381c55\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:52.146111 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:52.146074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:52.150835 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:52.150811    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:52.157263 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:52.157238    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"
Sep 11 12:51:52.305403 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:52.305374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:52.440123 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:52.440027    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-587cc5f64b-ntxkx"]
Sep 11 12:51:52.444135 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:52.444107    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3447b5_569c_4668_8694_213ff5c1d709.slice/crio-f01bf7163f446f93004ba7a8801da17235ff8c45e2b01155740bdab15045722d WatchSource:0}: Error finding container f01bf7163f446f93004ba7a8801da17235ff8c45e2b01155740bdab15045722d: Status 404 returned error can't find the container with id f01bf7163f446f93004ba7a8801da17235ff8c45e2b01155740bdab15045722d
Sep 11 12:51:52.451159 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:52.451136    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt"]
Sep 11 12:51:52.452270 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:52.452246    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc515922d_1ac8_45d8_8528_7d96eb381c55.slice/crio-c05fad3e2df5a2580a0bc1ed5bec591ef3ec7dee6cc8e17b5b3971c95fd069cf WatchSource:0}: Error finding container c05fad3e2df5a2580a0bc1ed5bec591ef3ec7dee6cc8e17b5b3971c95fd069cf: Status 404 returned error can't find the container with id c05fad3e2df5a2580a0bc1ed5bec591ef3ec7dee6cc8e17b5b3971c95fd069cf
Sep 11 12:51:52.480862 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:52.480830    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt" event={"ID":"c515922d-1ac8-45d8-8528-7d96eb381c55","Type":"ContainerStarted","Data":"c05fad3e2df5a2580a0bc1ed5bec591ef3ec7dee6cc8e17b5b3971c95fd069cf"}
Sep 11 12:51:52.482154 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:52.482130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-587cc5f64b-ntxkx" event={"ID":"1d3447b5-569c-4668-8694-213ff5c1d709","Type":"ContainerStarted","Data":"f01bf7163f446f93004ba7a8801da17235ff8c45e2b01155740bdab15045722d"}
Sep 11 12:51:53.488259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:53.488221    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-587cc5f64b-ntxkx" event={"ID":"1d3447b5-569c-4668-8694-213ff5c1d709","Type":"ContainerStarted","Data":"a97549b44664ff7fe8c6ad54108d9ad798b7b5e7b11547dd2cc62d2c180397db"}
Sep 11 12:51:53.527249 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:53.527160    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-587cc5f64b-ntxkx" podStartSLOduration=34.527140997 podStartE2EDuration="34.527140997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:53.526600729 +0000 UTC m=+291.601063494" watchObservedRunningTime="2026-09-11 12:51:53.527140997 +0000 UTC m=+291.601603758"
Sep 11 12:51:54.151790 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.151751    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:54.154428 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.154404    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:54.494503 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.494403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt" event={"ID":"c515922d-1ac8-45d8-8528-7d96eb381c55","Type":"ContainerStarted","Data":"d47d55912f4a4d701f408be283ad57afc57ef2cc36ac92677aa9d417093ea4d6"}
Sep 11 12:51:54.494944 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.494654    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:54.495925 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.495893    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-587cc5f64b-ntxkx"
Sep 11 12:51:54.521474 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.521429    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qv4lt" podStartSLOduration=33.798623362 podStartE2EDuration="35.521414029s" totalImagesPullingTime="1.722790667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:54.520986265 +0000 UTC m=+292.595449030" watchObservedRunningTime="2026-09-11 12:51:54.521414029 +0000 UTC m=+292.595876793"
Sep 11 12:51:54.576818 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.576785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:54.704644 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.704606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:54.859048 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:54.859011    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:55.238687 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:55.238593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:55.513213 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:51:55.513104    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b42r4" podUID="a0a3aa5e-7557-48d8-8eb1-c2d0178b3609"
Sep 11 12:51:57.040781 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.040742    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:57.043553 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.043524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a390ebca-bf3b-48c2-a476-74680b3e4c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79xvb\" (UID: \"a390ebca-bf3b-48c2-a476-74680b3e4c51\") " pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:57.218737 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.218713    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79xvb"
Sep 11 12:51:57.502203 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.502088    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79xvb"]
Sep 11 12:51:57.506399 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:57.506366    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda390ebca_bf3b_48c2_a476_74680b3e4c51.slice/crio-89e88551c3b1a4389105d3470528fe6a569f88961b33d1aef729728e106aa363 WatchSource:0}: Error finding container 89e88551c3b1a4389105d3470528fe6a569f88961b33d1aef729728e106aa363: Status 404 returned error can't find the container with id 89e88551c3b1a4389105d3470528fe6a569f88961b33d1aef729728e106aa363
Sep 11 12:51:57.860222 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.860193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:57.916284 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.916248    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"]
Sep 11 12:51:57.919753 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.919735    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:57.922296 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.922276    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 12:51:57.922424 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.922305    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 12:51:57.922424 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.922323    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sjtbq\""
Sep 11 12:51:57.922424 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.922305    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 12:51:57.927216 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.927197    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"]
Sep 11 12:51:57.939889 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:57.939849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:58.048427 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.048402    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzk9f\" (UniqueName: \"kubernetes.io/projected/f662d25b-ee6d-4848-b324-a0235ae400d0-kube-api-access-hzk9f\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.048705 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.048445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f662d25b-ee6d-4848-b324-a0235ae400d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.048705 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.048508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f662d25b-ee6d-4848-b324-a0235ae400d0-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.048705 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.048548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f662d25b-ee6d-4848-b324-a0235ae400d0-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.052086 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.052051    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:58.149771 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.149708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f662d25b-ee6d-4848-b324-a0235ae400d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.149872 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.149782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f662d25b-ee6d-4848-b324-a0235ae400d0-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.149872 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.149832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f662d25b-ee6d-4848-b324-a0235ae400d0-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.149872 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.149865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzk9f\" (UniqueName: \"kubernetes.io/projected/f662d25b-ee6d-4848-b324-a0235ae400d0-kube-api-access-hzk9f\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.150651 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.150628    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f662d25b-ee6d-4848-b324-a0235ae400d0-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.152443 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.152421    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f662d25b-ee6d-4848-b324-a0235ae400d0-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.152653 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.152632    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f662d25b-ee6d-4848-b324-a0235ae400d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.158107 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.158089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzk9f\" (UniqueName: \"kubernetes.io/projected/f662d25b-ee6d-4848-b324-a0235ae400d0-kube-api-access-hzk9f\") pod \"prometheus-operator-68bcd7f987-vskkp\" (UID: \"f662d25b-ee6d-4848-b324-a0235ae400d0\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.229585 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.229560    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"
Sep 11 12:51:58.510932 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.510852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79xvb" event={"ID":"a390ebca-bf3b-48c2-a476-74680b3e4c51","Type":"ContainerStarted","Data":"15871f978da1ab8660a1f7f11fa391d48e7805902aa0d0540567f10b89111b7b"}
Sep 11 12:51:58.520150 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.520117    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79xvb" event={"ID":"a390ebca-bf3b-48c2-a476-74680b3e4c51","Type":"ContainerStarted","Data":"d664a282a579de51ea4a2387e569521ab0a911a077e27b5faf3bc6873822838a"}
Sep 11 12:51:58.520299 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.520219    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vskkp"]
Sep 11 12:51:58.520299 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:58.520257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79xvb" event={"ID":"a390ebca-bf3b-48c2-a476-74680b3e4c51","Type":"ContainerStarted","Data":"89e88551c3b1a4389105d3470528fe6a569f88961b33d1aef729728e106aa363"}
Sep 11 12:51:58.522219 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:51:58.522199    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf662d25b_ee6d_4848_b324_a0235ae400d0.slice/crio-253ea6dd2ae34fde89ac1e76aa8d06f265afcc766e5c1fb91b9d21ade0a2e7fb WatchSource:0}: Error finding container 253ea6dd2ae34fde89ac1e76aa8d06f265afcc766e5c1fb91b9d21ade0a2e7fb: Status 404 returned error can't find the container with id 253ea6dd2ae34fde89ac1e76aa8d06f265afcc766e5c1fb91b9d21ade0a2e7fb
Sep 11 12:51:59.476714 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:59.476685    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d65zw"
Sep 11 12:51:59.515417 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:51:59.515383    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp" event={"ID":"f662d25b-ee6d-4848-b324-a0235ae400d0","Type":"ContainerStarted","Data":"253ea6dd2ae34fde89ac1e76aa8d06f265afcc766e5c1fb91b9d21ade0a2e7fb"}
Sep 11 12:52:00.375416 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:00.375329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:00.520544 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:00.520507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79xvb" event={"ID":"a390ebca-bf3b-48c2-a476-74680b3e4c51","Type":"ContainerStarted","Data":"ef9e71efa806b7c72f3ec642bc099875f735b68b89efbcbcc6f45016b832ce04"}
Sep 11 12:52:00.522473 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:00.522443    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp" event={"ID":"f662d25b-ee6d-4848-b324-a0235ae400d0","Type":"ContainerStarted","Data":"715c8ae22f51d55eda2bbcd227c4d8bf442b4b203bd736c693a82eac4891096f"}
Sep 11 12:52:00.522588 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:00.522494    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp" event={"ID":"f662d25b-ee6d-4848-b324-a0235ae400d0","Type":"ContainerStarted","Data":"8bdd8ca8a0038c88b58f1099e3a3393f8ab7799eaf0c3da32f5daff43210aa96"}
Sep 11 12:52:00.538426 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:00.538380    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-79xvb" podStartSLOduration=33.064571492 podStartE2EDuration="35.538364715s" totalImagesPullingTime="2.473793223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:51:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:00.537621488 +0000 UTC m=+298.612084253" watchObservedRunningTime="2026-09-11 12:52:00.538364715 +0000 UTC m=+298.612827475"
Sep 11 12:52:00.567360 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:00.567319    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vskkp" podStartSLOduration=1.9909871479999999 podStartE2EDuration="3.567303328s" totalImagesPullingTime="1.57631618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:00.566477057 +0000 UTC m=+298.640939811" watchObservedRunningTime="2026-09-11 12:52:00.567303328 +0000 UTC m=+298.641766093"
Sep 11 12:52:02.047145 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.047100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:02.261058 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.261024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:02.333571 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.333490    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wx8vc"]
Sep 11 12:52:02.337288 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.337270    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"]
Sep 11 12:52:02.337422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.337405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.339533 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.339509    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 12:52:02.339663 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.339571    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8ttnf\""
Sep 11 12:52:02.340400 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.340378    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 12:52:02.340528 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.340430    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 12:52:02.340528 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.340472    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.343956 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.343936    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 12:52:02.344809 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.344784    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 12:52:02.344908 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.344825    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 12:52:02.345865 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.345844    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-54tcr\""
Sep 11 12:52:02.356719 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.356698    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"]
Sep 11 12:52:02.371838 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.371813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:02.382907 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.382885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-root\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.383011 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.382940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05b934e5-870f-49ce-a8e2-ad18e7be4201-metrics-client-ca\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.383011 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.382997    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-tls\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.383117 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.383024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.383117 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.383070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-textfile\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.383201 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.383117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-sys\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.383201 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.383163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-wtmp\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.383282 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.383214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78ggk\" (UniqueName: \"kubernetes.io/projected/05b934e5-870f-49ce-a8e2-ad18e7be4201-kube-api-access-78ggk\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.383282 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.383273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-accelerators-collector-config\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.462669 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.462624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:02.468469 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.468443    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 12:52:02.468936 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.468918    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 12:52:02.472784 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.472766    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 12:52:02.473421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.473312    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 12:52:02.482145 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.482130    2573 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 12:52:02.484127 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-root\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484223 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.484223 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484205    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05b934e5-870f-49ce-a8e2-ad18e7be4201-metrics-client-ca\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484319 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484229    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-root\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484319 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-tls\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484319 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484319 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e13922b-e315-44d5-8484-d4ce3dd77558-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.484508 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-textfile\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484508 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484350    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e13922b-e315-44d5-8484-d4ce3dd77558-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.484508 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-sys\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484508 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.484508 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-wtmp\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484508 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78ggk\" (UniqueName: \"kubernetes.io/projected/05b934e5-870f-49ce-a8e2-ad18e7be4201-kube-api-access-78ggk\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484508 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nzzr\" (UniqueName: \"kubernetes.io/projected/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-api-access-6nzzr\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.484839 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.484839 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-sys\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484839 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-accelerators-collector-config\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484839 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484673    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-textfile\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.484839 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-wtmp\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.485051 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.484936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05b934e5-870f-49ce-a8e2-ad18e7be4201-metrics-client-ca\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.486447 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.486424    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 12:52:02.486551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.486454    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 12:52:02.486551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.486513    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 12:52:02.494245 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.494214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78ggk\" (UniqueName: \"kubernetes.io/projected/05b934e5-870f-49ce-a8e2-ad18e7be4201-kube-api-access-78ggk\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.495262 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.495238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-accelerators-collector-config\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.497007 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.496977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-tls\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.497783 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.497764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05b934e5-870f-49ce-a8e2-ad18e7be4201-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wx8vc\" (UID: \"05b934e5-870f-49ce-a8e2-ad18e7be4201\") " pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.585756 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.585701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.585756 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.585761    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e13922b-e315-44d5-8484-d4ce3dd77558-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.587849 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.585791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e13922b-e315-44d5-8484-d4ce3dd77558-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.587849 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.585828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.587849 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.585872    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nzzr\" (UniqueName: \"kubernetes.io/projected/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-api-access-6nzzr\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.587849 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.585896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.587849 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.586151    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e13922b-e315-44d5-8484-d4ce3dd77558-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.587849 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.586615    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e13922b-e315-44d5-8484-d4ce3dd77558-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.589046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.589030    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 12:52:02.589498 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.589484    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 12:52:02.589614 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.589597    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 12:52:02.596115 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:52:02.596094    2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 11 12:52:02.596243 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:52:02.596156    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-tls podName:4e13922b-e315-44d5-8484-d4ce3dd77558 nodeName:}" failed. No retries permitted until 2026-09-11 12:52:03.096138209 +0000 UTC m=+301.170600959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-tqpsw" (UID: "4e13922b-e315-44d5-8484-d4ce3dd77558") : secret "kube-state-metrics-tls" not found
Sep 11 12:52:02.596630 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.596608    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.598154 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.598135    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.598528 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.598509    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nzzr\" (UniqueName: \"kubernetes.io/projected/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-api-access-6nzzr\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:02.652275 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.652257    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8ttnf\""
Sep 11 12:52:02.660106 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.660086    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wx8vc"
Sep 11 12:52:02.675011 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:52:02.674976    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b934e5_870f_49ce_a8e2_ad18e7be4201.slice/crio-56af8622e8a086dc2c6a5fd058cfbbb02ad879aaa9f35a553f23a8ebbaee2471 WatchSource:0}: Error finding container 56af8622e8a086dc2c6a5fd058cfbbb02ad879aaa9f35a553f23a8ebbaee2471: Status 404 returned error can't find the container with id 56af8622e8a086dc2c6a5fd058cfbbb02ad879aaa9f35a553f23a8ebbaee2471
Sep 11 12:52:02.748306 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.748275    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:02.850244 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.850144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:02.948444 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:02.948404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:03.145864 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.145771    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:03.191896 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.191853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:03.194419 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.194400    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13922b-e315-44d5-8484-d4ce3dd77558-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-tqpsw\" (UID: \"4e13922b-e315-44d5-8484-d4ce3dd77558\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:03.257576 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.257532    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-54tcr\""
Sep 11 12:52:03.266253 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.266226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"
Sep 11 12:52:03.291850 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.291812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:03.390322 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.390289    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:03.397571 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.397492    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:52:03.402401 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.402377    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.404493    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.404859    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.405142    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.405376    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w64f9\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.405576    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.405712    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.405861    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.406003    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.406163    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 12:52:03.406943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.406459    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 12:52:03.417952 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.417929    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:52:03.494600 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-config-volume\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.494600 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.494600 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-web-config\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.494898 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-config-out\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.494898 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.494898 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.494898 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494751    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.494898 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nchtw\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-kube-api-access-nchtw\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.494898 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.495196 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.495196 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.495196 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.494993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.495196 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.495056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.535975 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.535933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wx8vc" event={"ID":"05b934e5-870f-49ce-a8e2-ad18e7be4201","Type":"ContainerStarted","Data":"56af8622e8a086dc2c6a5fd058cfbbb02ad879aaa9f35a553f23a8ebbaee2471"}
Sep 11 12:52:03.546325 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.546295    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw"]
Sep 11 12:52:03.549838 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:52:03.549810    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e13922b_e315_44d5_8484_d4ce3dd77558.slice/crio-693d322da80e89ce686a71004a75b55ea96eafba47984770147c2e4a535d3f37 WatchSource:0}: Error finding container 693d322da80e89ce686a71004a75b55ea96eafba47984770147c2e4a535d3f37: Status 404 returned error can't find the container with id 693d322da80e89ce686a71004a75b55ea96eafba47984770147c2e4a535d3f37
Sep 11 12:52:03.552549 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.552527    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:52:03.595745 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.595745 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-config-volume\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-web-config\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-config-out\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nchtw\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-kube-api-access-nchtw\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596002 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.595993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596563 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.596050    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596563 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.596084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596563 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.596164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.596823 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:52:03.596772    2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 11 12:52:03.596916 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:52:03.596840    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls podName:033f9cab-bace-44b3-bcae-2c093f7079f1 nodeName:}" failed. No retries permitted until 2026-09-11 12:52:04.096819686 +0000 UTC m=+302.171282443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1") : secret "alertmanager-main-tls" not found
Sep 11 12:52:03.598289 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.598236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.598649 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.598599    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.601908 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.601829    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.601908 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.601872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.601908 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.601879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.602312 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.602287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-web-config\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.602586 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.602543    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-config-volume\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.603829 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.603805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-config-out\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.604514 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.604491    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.604908 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.604883    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.606452 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.606421    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nchtw\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-kube-api-access-nchtw\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:03.959138 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:03.959105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:04.101272 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:04.101239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:04.104164 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:04.104137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:04.315899 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:04.315866    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:52:04.516743 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:04.516718    2573 scope.go:117] "RemoveContainer" containerID="a98c4b91adb40fff07bb1d619781e6a743e4b2bc189032aa6d353f8793c29b45"
Sep 11 12:52:04.541513 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:04.541468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw" event={"ID":"4e13922b-e315-44d5-8484-d4ce3dd77558","Type":"ContainerStarted","Data":"693d322da80e89ce686a71004a75b55ea96eafba47984770147c2e4a535d3f37"}
Sep 11 12:52:04.543454 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:04.543427    2573 generic.go:356] "Generic (PLEG): container finished" podID="05b934e5-870f-49ce-a8e2-ad18e7be4201" containerID="69685643c64718f7fc70e71777b436373fd0511071a55bbf02515fb343095400" exitCode=0
Sep 11 12:52:04.543572 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:04.543466    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wx8vc" event={"ID":"05b934e5-870f-49ce-a8e2-ad18e7be4201","Type":"ContainerDied","Data":"69685643c64718f7fc70e71777b436373fd0511071a55bbf02515fb343095400"}
Sep 11 12:52:04.603133 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:04.602762    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:52:04.770209 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:52:04.770019    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033f9cab_bace_44b3_bcae_2c093f7079f1.slice/crio-edc3dd70a30ec57545e347209d0dd855fd48fee539234a5a66fc03cacd90eba5 WatchSource:0}: Error finding container edc3dd70a30ec57545e347209d0dd855fd48fee539234a5a66fc03cacd90eba5: Status 404 returned error can't find the container with id edc3dd70a30ec57545e347209d0dd855fd48fee539234a5a66fc03cacd90eba5
Sep 11 12:52:05.275404 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.275306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:05.550780 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.550719    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wx8vc" event={"ID":"05b934e5-870f-49ce-a8e2-ad18e7be4201","Type":"ContainerStarted","Data":"d563fb31716241f2047b3846a89a8e35c353dc62f58519039c2c10b2c3862046"}
Sep 11 12:52:05.550780 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.550781    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wx8vc" event={"ID":"05b934e5-870f-49ce-a8e2-ad18e7be4201","Type":"ContainerStarted","Data":"c8c680dc3ccca9a902f7a4b2f8dcd76894103b9e6946f0e0fe6e09088aecf14b"}
Sep 11 12:52:05.552223 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.552192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerStarted","Data":"edc3dd70a30ec57545e347209d0dd855fd48fee539234a5a66fc03cacd90eba5"}
Sep 11 12:52:05.554386 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.554362    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 12:52:05.554497 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.554472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" event={"ID":"55ada48c-34c3-47d4-b837-ed9d3823c489","Type":"ContainerStarted","Data":"b82d29b54fa31fff7b3db776021efe7b69ba2ffb222e4122ec094f07edfb1014"}
Sep 11 12:52:05.554819 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.554798    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:52:05.557925 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.557901    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw" event={"ID":"4e13922b-e315-44d5-8484-d4ce3dd77558","Type":"ContainerStarted","Data":"b87cc7486d2e10faa125dde3d2b888c2de755cba70109a7b051d8062248a428f"}
Sep 11 12:52:05.558033 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.557956    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw" event={"ID":"4e13922b-e315-44d5-8484-d4ce3dd77558","Type":"ContainerStarted","Data":"6c42067ce8ad42fc21b105d3a6f562feb4f0ae08d2e00bef4849d3205e316c05"}
Sep 11 12:52:05.558033 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.557988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw" event={"ID":"4e13922b-e315-44d5-8484-d4ce3dd77558","Type":"ContainerStarted","Data":"68c53c8024c94e33728dec167e4f22303094a3409813bf8ff0a6700d1dfa2569"}
Sep 11 12:52:05.568593 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.568539    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wx8vc" podStartSLOduration=2.259682633 podStartE2EDuration="3.568519138s" totalImagesPullingTime="1.240036996s" totalInitContainerRuntime="68.799509ms" isStatefulPod=true podCreationTimestamp="2026-09-11 12:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:05.567554838 +0000 UTC m=+303.642017618" watchObservedRunningTime="2026-09-11 12:52:05.568519138 +0000 UTC m=+303.642981955"
Sep 11 12:52:05.586131 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.585893    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs" podStartSLOduration=43.522191387 podStartE2EDuration="45.585874235s" totalImagesPullingTime="2.063682848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:05.585728494 +0000 UTC m=+303.660191257" watchObservedRunningTime="2026-09-11 12:52:05.585874235 +0000 UTC m=+303.660336992"
Sep 11 12:52:05.609995 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.609939    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-tqpsw" podStartSLOduration=2.33831577 podStartE2EDuration="3.609918758s" totalImagesPullingTime="1.271602988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:05.60884253 +0000 UTC m=+303.683305297" watchObservedRunningTime="2026-09-11 12:52:05.609918758 +0000 UTC m=+303.684381545"
Sep 11 12:52:05.610968 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:05.610944    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-ljjvs"
Sep 11 12:52:06.415302 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.415218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:06.514807 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.514768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:06.563302 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.563274    2573 generic.go:356] "Generic (PLEG): container finished" podID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerID="5efdd1585eed9d2682b34dcb2b847db905fdc8d08c9223ec2e5310c1840d7871" exitCode=0
Sep 11 12:52:06.563682 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.563376    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerDied","Data":"5efdd1585eed9d2682b34dcb2b847db905fdc8d08c9223ec2e5310c1840d7871"}
Sep 11 12:52:06.685861 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.685789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:06.758118 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.758093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:06.891464 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.891433    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:06.929049 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.929025    2573 patch_prober.go:28] interesting pod/image-registry-6f66b7b9bf-9xrw8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 12:52:06.929188 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.929077    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8" podUID="91ff2549-92ac-4ba9-8499-186df7c6ce8a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:52:06.991694 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:06.991625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:07.078300 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.078265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:07.138502 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.138425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:07.439963 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.439933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:07.512016 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.511976    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:52:07.545307 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.545255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:07.556709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.556412    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"]
Sep 11 12:52:07.560009 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.559990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.562691 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.562561    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2km2p\""
Sep 11 12:52:07.562691 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.562589    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 12:52:07.562872 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.562851    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 12:52:07.562925 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.562880    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 12:52:07.563071 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.563052    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 12:52:07.563260 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.563247    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 12:52:07.568349 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.568275    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 12:52:07.575913 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.575892    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"]
Sep 11 12:52:07.636371 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.636329    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-secret-telemeter-client\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.636551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.636423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.636551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.636495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.636668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.636590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-metrics-client-ca\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.636668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.636648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-federate-client-tls\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.636784 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.636758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mcv7\" (UniqueName: \"kubernetes.io/projected/686fb87c-8f36-4406-952b-e15842b38c09-kube-api-access-2mcv7\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.636841 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.636822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-telemeter-client-tls\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.636896 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.636866    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-serving-certs-ca-bundle\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.693275 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.693126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:07.738104 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-metrics-client-ca\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.738263 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-federate-client-tls\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.738263 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mcv7\" (UniqueName: \"kubernetes.io/projected/686fb87c-8f36-4406-952b-e15842b38c09-kube-api-access-2mcv7\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.738263 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738233    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-telemeter-client-tls\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.738422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-serving-certs-ca-bundle\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.738422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-secret-telemeter-client\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.738422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.738422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.739143 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.738835    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-metrics-client-ca\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.739293 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.739263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.739765 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.739711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686fb87c-8f36-4406-952b-e15842b38c09-serving-certs-ca-bundle\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.741561 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.741536    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-federate-client-tls\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.741663 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.741646    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.742084 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.742064    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-secret-telemeter-client\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.742516 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.742470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/686fb87c-8f36-4406-952b-e15842b38c09-telemeter-client-tls\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.747719 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.747696    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mcv7\" (UniqueName: \"kubernetes.io/projected/686fb87c-8f36-4406-952b-e15842b38c09-kube-api-access-2mcv7\") pod \"telemeter-client-78f86d4c96-4fwcn\" (UID: \"686fb87c-8f36-4406-952b-e15842b38c09\") " pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:07.871766 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:07.871734    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"
Sep 11 12:52:08.271502 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.271390    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78f86d4c96-4fwcn"]
Sep 11 12:52:08.274135 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:52:08.274113    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686fb87c_8f36_4406_952b_e15842b38c09.slice/crio-2dd8e570273b7baf9ffa2412d91e544b0421efd3a2b3900cf6bfda1e4fc96c3d WatchSource:0}: Error finding container 2dd8e570273b7baf9ffa2412d91e544b0421efd3a2b3900cf6bfda1e4fc96c3d: Status 404 returned error can't find the container with id 2dd8e570273b7baf9ffa2412d91e544b0421efd3a2b3900cf6bfda1e4fc96c3d
Sep 11 12:52:08.439652 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.439617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:08.468632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.468602    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:52:08.573559 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.573479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:08.578676 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.578647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerStarted","Data":"f709ecf01e238b0c74387fd06903cd25ab4bc1b6030a819f6e155228f43affc5"}
Sep 11 12:52:08.578816 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.578722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerStarted","Data":"cb5d9ee0c73b7d65c2efd5ece506efe536f31e15b2d4554864e877b29b5a21f3"}
Sep 11 12:52:08.578816 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.578758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerStarted","Data":"f23ad262d8f44e461b5a153e63a49c26eac548773fc41c0a03b0c4789b30c81c"}
Sep 11 12:52:08.578816 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.578782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerStarted","Data":"ad51d5985728f354e29ea6b0f1a174fc7cbfb432435463cde7aa4db34c1d9e48"}
Sep 11 12:52:08.578816 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.578804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerStarted","Data":"8a24276e2013236b42d166f2cd417d9fa39d8a9f83109eec9889fa56a01578c7"}
Sep 11 12:52:08.579967 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.579942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn" event={"ID":"686fb87c-8f36-4406-952b-e15842b38c09","Type":"ContainerStarted","Data":"2dd8e570273b7baf9ffa2412d91e544b0421efd3a2b3900cf6bfda1e4fc96c3d"}
Sep 11 12:52:08.652539 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.652491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:08.749217 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.749164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:08.822831 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:08.822730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:09.308814 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:09.308777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:09.588737 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:09.588697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerStarted","Data":"4daf41427c8da73e4613ffcc4df980b519b602a37378b98c81cfd619f39c723d"}
Sep 11 12:52:09.625834 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:09.625780    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.106899487 podStartE2EDuration="6.625759969s" totalImagesPullingTime="3.503112033s" totalInitContainerRuntime="15.748449ms" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:09.624576393 +0000 UTC m=+307.699039157" watchObservedRunningTime="2026-09-11 12:52:09.625759969 +0000 UTC m=+307.700222727"
Sep 11 12:52:10.595489 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:10.595450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn" event={"ID":"686fb87c-8f36-4406-952b-e15842b38c09","Type":"ContainerStarted","Data":"aaa0a8b31c8194154aa4e3fdd7e61d66d7978d4309164c0140a92223c64fbdb1"}
Sep 11 12:52:10.595876 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:10.595512    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn" event={"ID":"686fb87c-8f36-4406-952b-e15842b38c09","Type":"ContainerStarted","Data":"0505a98ee5d01d245a8b97434891a31af1f0f88d67fb868ab4a137f18ab73c0c"}
Sep 11 12:52:10.595876 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:10.595534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn" event={"ID":"686fb87c-8f36-4406-952b-e15842b38c09","Type":"ContainerStarted","Data":"5a3789d8d83441ae83d07e9ce32b1d11169effccd20f22f134956416ae3a7bbc"}
Sep 11 12:52:10.618258 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:10.618204    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78f86d4c96-4fwcn" podStartSLOduration=1.773691272 podStartE2EDuration="3.618185247s" totalImagesPullingTime="1.844493975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:10.616050388 +0000 UTC m=+308.690513152" watchObservedRunningTime="2026-09-11 12:52:10.618185247 +0000 UTC m=+308.692648002"
Sep 11 12:52:14.556163 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:14.556127    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"]
Sep 11 12:52:14.668995 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:14.668967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:14.769733 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:14.769707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:14.869565 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:14.869497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:16.753563 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.753526    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f84d67d5f-6brw7"]
Sep 11 12:52:16.758351 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.758322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:16.761397 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.761375    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 12:52:16.761519 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.761448    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 12:52:16.762035 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.762015    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 12:52:16.762202 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.762034    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 12:52:16.762301 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.762037    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 12:52:16.762301 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.762034    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 12:52:16.762409 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.762038    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wsqtg\""
Sep 11 12:52:16.762409 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.762084    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 12:52:16.778390 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.778370    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f84d67d5f-6brw7"]
Sep 11 12:52:16.918316 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.918286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-config\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:16.918475 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.918326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-serving-cert\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:16.918475 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.918368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdf2d\" (UniqueName: \"kubernetes.io/projected/913c3731-7d0e-48fe-b35a-d64d7592e3fc-kube-api-access-cdf2d\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:16.918575 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.918507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-oauth-config\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:16.918575 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.918535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-service-ca\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:16.918650 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:16.918575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-oauth-serving-cert\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.019995 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.019926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-oauth-config\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.019995 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.019958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-service-ca\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.019995 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.019983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-oauth-serving-cert\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.020261 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.020010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-config\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.020261 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.020032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-serving-cert\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.020261 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.020076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdf2d\" (UniqueName: \"kubernetes.io/projected/913c3731-7d0e-48fe-b35a-d64d7592e3fc-kube-api-access-cdf2d\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.020868 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.020761    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-oauth-serving-cert\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.020868 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.020787    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-service-ca\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.020868 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.020785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-config\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.022689 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.022662    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-serving-cert\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.022813 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.022746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-oauth-config\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.029527 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.029504    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdf2d\" (UniqueName: \"kubernetes.io/projected/913c3731-7d0e-48fe-b35a-d64d7592e3fc-kube-api-access-cdf2d\") pod \"console-5f84d67d5f-6brw7\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") " pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.068466 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.068443    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:17.339455 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.339374    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f84d67d5f-6brw7"]
Sep 11 12:52:17.341990 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:52:17.341966    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913c3731_7d0e_48fe_b35a_d64d7592e3fc.slice/crio-2b5693e378e675b80906a491c88f67d0f067ff8c4ffc880855b79610a6b75f70 WatchSource:0}: Error finding container 2b5693e378e675b80906a491c88f67d0f067ff8c4ffc880855b79610a6b75f70: Status 404 returned error can't find the container with id 2b5693e378e675b80906a491c88f67d0f067ff8c4ffc880855b79610a6b75f70
Sep 11 12:52:17.623819 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:17.623738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f84d67d5f-6brw7" event={"ID":"913c3731-7d0e-48fe-b35a-d64d7592e3fc","Type":"ContainerStarted","Data":"2b5693e378e675b80906a491c88f67d0f067ff8c4ffc880855b79610a6b75f70"}
Sep 11 12:52:19.644514 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:19.644476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:19.716882 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:19.716841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:20.308406 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:20.308379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:20.371823 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:20.371787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:20.637793 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:20.637757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f84d67d5f-6brw7" event={"ID":"913c3731-7d0e-48fe-b35a-d64d7592e3fc","Type":"ContainerStarted","Data":"d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7"}
Sep 11 12:52:20.663708 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:20.663655    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f84d67d5f-6brw7" podStartSLOduration=1.8359544429999999 podStartE2EDuration="4.663638385s" totalImagesPullingTime="2.827683942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:20.662409668 +0000 UTC m=+318.736872432" watchObservedRunningTime="2026-09-11 12:52:20.663638385 +0000 UTC m=+318.738101148"
Sep 11 12:52:21.422080 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:21.422031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:21.489938 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:21.489903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:23.307313 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:23.307274    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:23.364318 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:23.364287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:23.903562 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:23.903527    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687995fd5b-9prq9"]
Sep 11 12:52:23.910947 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:23.910923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:23.918516 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:23.918490    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 12:52:23.920060 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:23.920040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687995fd5b-9prq9"]
Sep 11 12:52:24.078479 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.078452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-serving-cert\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.078619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.078503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-config\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.078619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.078575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-service-ca\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.078710 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.078657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-oauth-serving-cert\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.078710 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.078693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-oauth-config\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.078793 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.078710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-trusted-ca-bundle\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.078793 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.078730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-kube-api-access-rtxfc\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.172746 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.172647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:24.179684 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.179656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-service-ca\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.179789 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.179720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-oauth-serving-cert\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.179789 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.179764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-oauth-config\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.179900 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.179787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-trusted-ca-bundle\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.179900 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.179819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-kube-api-access-rtxfc\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.179900 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.179881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-serving-cert\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.180044 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.179915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-config\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.180518 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.180490    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-service-ca\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.180611 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.180522    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-oauth-serving-cert\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.180670 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.180610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-config\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.180723 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.180668    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-trusted-ca-bundle\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.182425 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.182400    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-oauth-config\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.182543 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.182527    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-serving-cert\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.188208 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.188186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-kube-api-access-rtxfc\") pod \"console-687995fd5b-9prq9\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") " pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.221096 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.221068    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:24.270731 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.270696    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:24.504597 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.504529    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687995fd5b-9prq9"]
Sep 11 12:52:24.507400 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:52:24.507372    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1804a2d_3323_48f0_83bf_c4d1bbc4eda6.slice/crio-af404e90e405030e2d43d879dcf248fdea3ce099a47efe94df0838ed282e602a WatchSource:0}: Error finding container af404e90e405030e2d43d879dcf248fdea3ce099a47efe94df0838ed282e602a: Status 404 returned error can't find the container with id af404e90e405030e2d43d879dcf248fdea3ce099a47efe94df0838ed282e602a
Sep 11 12:52:24.656133 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.656102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687995fd5b-9prq9" event={"ID":"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6","Type":"ContainerStarted","Data":"a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3"}
Sep 11 12:52:24.656288 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.656149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687995fd5b-9prq9" event={"ID":"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6","Type":"ContainerStarted","Data":"af404e90e405030e2d43d879dcf248fdea3ce099a47efe94df0838ed282e602a"}
Sep 11 12:52:24.687886 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:24.687843    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687995fd5b-9prq9" podStartSLOduration=1.687826375 podStartE2EDuration="1.687826375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:24.686938474 +0000 UTC m=+322.761401239" watchObservedRunningTime="2026-09-11 12:52:24.687826375 +0000 UTC m=+322.762289197"
Sep 11 12:52:25.522501 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:25.522451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:25.620462 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:25.620419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:26.326652 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:26.326619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:27.069080 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:27.069044    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:27.069474 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:27.069104    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:27.074035 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:27.074009    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:27.671880 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:27.671850    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:52:28.715103 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:28.715064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:28.815893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:28.815867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:29.755401 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:29.755370    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:29.872640 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:29.872606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:30.237979 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:30.237949    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587cc5f64b-ntxkx_1d3447b5-569c-4668-8694-213ff5c1d709/router/0.log"
Sep 11 12:52:30.266732 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:30.266711    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9qsb6_2c2e050e-3b78-4c92-a219-9ca503b9d674/serve-healthcheck-canary/0.log"
Sep 11 12:52:30.504541 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:30.504466    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:30.607890 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:30.607863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:34.221675 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:34.221644    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:34.222094 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:34.221700    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:34.226361 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:34.226336    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:34.700315 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:34.700285    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:52:34.747355 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:34.747319    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f84d67d5f-6brw7"]
Sep 11 12:52:34.863628 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:34.863593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:34.963990 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:34.963912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:35.064495 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:35.064465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:39.576223 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.576133    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8" podUID="91ff2549-92ac-4ba9-8499-186df7c6ce8a" containerName="registry" containerID="cri-o://ecc3e069c3ebfe3631c7b134879947ee0f5073d80343b04a1e317b919dbfe7d9" gracePeriod=30
Sep 11 12:52:39.719693 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.719663    2573 generic.go:356] "Generic (PLEG): container finished" podID="91ff2549-92ac-4ba9-8499-186df7c6ce8a" containerID="ecc3e069c3ebfe3631c7b134879947ee0f5073d80343b04a1e317b919dbfe7d9" exitCode=0
Sep 11 12:52:39.719815 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.719741    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8" event={"ID":"91ff2549-92ac-4ba9-8499-186df7c6ce8a","Type":"ContainerDied","Data":"ecc3e069c3ebfe3631c7b134879947ee0f5073d80343b04a1e317b919dbfe7d9"}
Sep 11 12:52:39.810391 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.810361    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:52:39.903016 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.902961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-trusted-ca\") pod \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") "
Sep 11 12:52:39.903016 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903013    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ff2549-92ac-4ba9-8499-186df7c6ce8a-ca-trust-extracted\") pod \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") "
Sep 11 12:52:39.903163 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903046    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-certificates\") pod \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") "
Sep 11 12:52:39.903235 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903194    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-installation-pull-secrets\") pod \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") "
Sep 11 12:52:39.903294 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903232    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-bound-sa-token\") pod \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") "
Sep 11 12:52:39.903294 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903271    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") pod \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") "
Sep 11 12:52:39.903399 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903311    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-image-registry-private-configuration\") pod \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") "
Sep 11 12:52:39.903399 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903341    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmhwn\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-kube-api-access-pmhwn\") pod \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\" (UID: \"91ff2549-92ac-4ba9-8499-186df7c6ce8a\") "
Sep 11 12:52:39.903498 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903452    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "91ff2549-92ac-4ba9-8499-186df7c6ce8a" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:39.903498 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903443    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "91ff2549-92ac-4ba9-8499-186df7c6ce8a" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:39.903662 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903638    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-certificates\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:52:39.903777 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.903705    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91ff2549-92ac-4ba9-8499-186df7c6ce8a-trusted-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:52:39.905974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.905933    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-kube-api-access-pmhwn" (OuterVolumeSpecName: "kube-api-access-pmhwn") pod "91ff2549-92ac-4ba9-8499-186df7c6ce8a" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a"). InnerVolumeSpecName "kube-api-access-pmhwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:39.906197 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.906154    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "91ff2549-92ac-4ba9-8499-186df7c6ce8a" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:39.906275 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.906186    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "91ff2549-92ac-4ba9-8499-186df7c6ce8a" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:52:39.906275 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.906250    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "91ff2549-92ac-4ba9-8499-186df7c6ce8a" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:52:39.906275 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.906254    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "91ff2549-92ac-4ba9-8499-186df7c6ce8a" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:39.914449 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:39.914428    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ff2549-92ac-4ba9-8499-186df7c6ce8a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "91ff2549-92ac-4ba9-8499-186df7c6ce8a" (UID: "91ff2549-92ac-4ba9-8499-186df7c6ce8a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:40.004809 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.004785    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91ff2549-92ac-4ba9-8499-186df7c6ce8a-ca-trust-extracted\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:52:40.004809 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.004805    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-installation-pull-secrets\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:52:40.004919 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.004814    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-bound-sa-token\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:52:40.004919 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.004823    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-registry-tls\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:52:40.004919 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.004831    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91ff2549-92ac-4ba9-8499-186df7c6ce8a-image-registry-private-configuration\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:52:40.004919 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.004838    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmhwn\" (UniqueName: \"kubernetes.io/projected/91ff2549-92ac-4ba9-8499-186df7c6ce8a-kube-api-access-pmhwn\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:52:40.506133 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.506096    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:40.600373 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.600340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:40.725382 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.725347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8" event={"ID":"91ff2549-92ac-4ba9-8499-186df7c6ce8a","Type":"ContainerDied","Data":"93bfd5e43098ae3d91f47cdaf642ee923f5b922a2bad3c92bcc27374b8ded4a1"}
Sep 11 12:52:40.725558 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.725410    2573 scope.go:117] "RemoveContainer" containerID="ecc3e069c3ebfe3631c7b134879947ee0f5073d80343b04a1e317b919dbfe7d9"
Sep 11 12:52:40.725558 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.725361    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"
Sep 11 12:52:40.741650 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.741624    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"]
Sep 11 12:52:40.746216 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:40.746193    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f66b7b9bf-9xrw8"]
Sep 11 12:52:42.517259 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:42.517228    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ff2549-92ac-4ba9-8499-186df7c6ce8a" path="/var/lib/kubelet/pods/91ff2549-92ac-4ba9-8499-186df7c6ce8a/volumes"
Sep 11 12:52:55.498595 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:55.498484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:55.556345 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:55.556305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:59.771474 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:52:59.771425    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f84d67d5f-6brw7" podUID="913c3731-7d0e-48fe-b35a-d64d7592e3fc" containerName="console" containerID="cri-o://d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7" gracePeriod=15
Sep 11 12:53:00.006735 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.006705    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:53:00.061796 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.061767    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdf2d\" (UniqueName: \"kubernetes.io/projected/913c3731-7d0e-48fe-b35a-d64d7592e3fc-kube-api-access-cdf2d\") pod \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") "
Sep 11 12:53:00.061955 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.061819    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-service-ca\") pod \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") "
Sep 11 12:53:00.061955 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.061845    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-serving-cert\") pod \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") "
Sep 11 12:53:00.061955 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.061893    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-oauth-serving-cert\") pod \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") "
Sep 11 12:53:00.061955 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.061936    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-config\") pod \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") "
Sep 11 12:53:00.062162 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.061960    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-oauth-config\") pod \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\" (UID: \"913c3731-7d0e-48fe-b35a-d64d7592e3fc\") "
Sep 11 12:53:00.062349 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.062315    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "913c3731-7d0e-48fe-b35a-d64d7592e3fc" (UID: "913c3731-7d0e-48fe-b35a-d64d7592e3fc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:00.062349 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.062327    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-config" (OuterVolumeSpecName: "console-config") pod "913c3731-7d0e-48fe-b35a-d64d7592e3fc" (UID: "913c3731-7d0e-48fe-b35a-d64d7592e3fc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:00.062503 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.062317    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-service-ca" (OuterVolumeSpecName: "service-ca") pod "913c3731-7d0e-48fe-b35a-d64d7592e3fc" (UID: "913c3731-7d0e-48fe-b35a-d64d7592e3fc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:00.064265 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.064237    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "913c3731-7d0e-48fe-b35a-d64d7592e3fc" (UID: "913c3731-7d0e-48fe-b35a-d64d7592e3fc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:00.064366 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.064346    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/913c3731-7d0e-48fe-b35a-d64d7592e3fc-kube-api-access-cdf2d" (OuterVolumeSpecName: "kube-api-access-cdf2d") pod "913c3731-7d0e-48fe-b35a-d64d7592e3fc" (UID: "913c3731-7d0e-48fe-b35a-d64d7592e3fc"). InnerVolumeSpecName "kube-api-access-cdf2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:53:00.064408 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.064371    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "913c3731-7d0e-48fe-b35a-d64d7592e3fc" (UID: "913c3731-7d0e-48fe-b35a-d64d7592e3fc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:00.163070 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.163031    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-config\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:00.163070 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.163063    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-oauth-config\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:00.163070 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.163074    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdf2d\" (UniqueName: \"kubernetes.io/projected/913c3731-7d0e-48fe-b35a-d64d7592e3fc-kube-api-access-cdf2d\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:00.163325 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.163082    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:00.163325 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.163091    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913c3731-7d0e-48fe-b35a-d64d7592e3fc-console-serving-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:00.163325 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.163099    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913c3731-7d0e-48fe-b35a-d64d7592e3fc-oauth-serving-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:00.806885 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.806848    2573 generic.go:356] "Generic (PLEG): container finished" podID="913c3731-7d0e-48fe-b35a-d64d7592e3fc" containerID="d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7" exitCode=0
Sep 11 12:53:00.807256 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.806892    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f84d67d5f-6brw7"
Sep 11 12:53:00.807256 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.806928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f84d67d5f-6brw7" event={"ID":"913c3731-7d0e-48fe-b35a-d64d7592e3fc","Type":"ContainerDied","Data":"d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7"}
Sep 11 12:53:00.807256 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.807001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f84d67d5f-6brw7" event={"ID":"913c3731-7d0e-48fe-b35a-d64d7592e3fc","Type":"ContainerDied","Data":"2b5693e378e675b80906a491c88f67d0f067ff8c4ffc880855b79610a6b75f70"}
Sep 11 12:53:00.807256 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.807029    2573 scope.go:117] "RemoveContainer" containerID="d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7"
Sep 11 12:53:00.815234 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.815216    2573 scope.go:117] "RemoveContainer" containerID="d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7"
Sep 11 12:53:00.815518 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:53:00.815492    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7\": container with ID starting with d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7 not found: ID does not exist" containerID="d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7"
Sep 11 12:53:00.815570 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.815524    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7"} err="failed to get container status \"d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7\": rpc error: code = NotFound desc = could not find container \"d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7\": container with ID starting with d737c8250ef76cec2b50f4a41d2c2e81b9e8b19e062471d4877e1ada6909d5e7 not found: ID does not exist"
Sep 11 12:53:00.822830 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.822804    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f84d67d5f-6brw7"]
Sep 11 12:53:00.828007 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:00.827985    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f84d67d5f-6brw7"]
Sep 11 12:53:02.516810 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:02.516775    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="913c3731-7d0e-48fe-b35a-d64d7592e3fc" path="/var/lib/kubelet/pods/913c3731-7d0e-48fe-b35a-d64d7592e3fc/volumes"
Sep 11 12:53:02.683208 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:02.683156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:02.783650 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:02.783619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:02.846218 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:02.846165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:15.384156 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:15.384116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:53:15.392186 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:15.392144    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a3aa5e-7557-48d8-8eb1-c2d0178b3609-metrics-certs\") pod \"network-metrics-daemon-b42r4\" (UID: \"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609\") " pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:53:15.615448 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:15.615416    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86zcf\""
Sep 11 12:53:15.624159 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:15.624143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b42r4"
Sep 11 12:53:15.895481 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:15.895405    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b42r4"]
Sep 11 12:53:15.898543 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:53:15.898516    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a3aa5e_7557_48d8_8eb1_c2d0178b3609.slice/crio-663b02d9077ebda19c04113dab3a631cf0263ccdb64bb06ee802e9f613dee20f WatchSource:0}: Error finding container 663b02d9077ebda19c04113dab3a631cf0263ccdb64bb06ee802e9f613dee20f: Status 404 returned error can't find the container with id 663b02d9077ebda19c04113dab3a631cf0263ccdb64bb06ee802e9f613dee20f
Sep 11 12:53:16.874762 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:16.874721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b42r4" event={"ID":"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609","Type":"ContainerStarted","Data":"663b02d9077ebda19c04113dab3a631cf0263ccdb64bb06ee802e9f613dee20f"}
Sep 11 12:53:17.879792 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:17.879760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b42r4" event={"ID":"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609","Type":"ContainerStarted","Data":"da1dab3cec5ec10743ddd40a7d7eeb6dbb3543186d0fa6238638a5bcb57cabde"}
Sep 11 12:53:17.880209 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:17.879809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b42r4" event={"ID":"a0a3aa5e-7557-48d8-8eb1-c2d0178b3609","Type":"ContainerStarted","Data":"1afebf0ec0c983cf61ac91e86cb096fe093b0ab518b2fd640343f403fcf6a3bf"}
Sep 11 12:53:17.898304 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:17.898260    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b42r4" podStartSLOduration=373.858239639 podStartE2EDuration="6m14.898246753s" totalImagesPullingTime="1.040007114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:17.897032185 +0000 UTC m=+375.971494949" watchObservedRunningTime="2026-09-11 12:53:17.898246753 +0000 UTC m=+375.972709517"
Sep 11 12:53:18.003676 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:18.003647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:18.062075 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:18.062046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:18.454039 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:18.454005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:18.514030 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:18.513995    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:19.186971 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:19.186935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:22.726191 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.726134    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:53:22.726663 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.726583    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="alertmanager" containerID="cri-o://8a24276e2013236b42d166f2cd417d9fa39d8a9f83109eec9889fa56a01578c7" gracePeriod=120
Sep 11 12:53:22.726728 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.726604    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy" containerID="cri-o://cb5d9ee0c73b7d65c2efd5ece506efe536f31e15b2d4554864e877b29b5a21f3" gracePeriod=120
Sep 11 12:53:22.726728 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.726704    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy-metric" containerID="cri-o://f709ecf01e238b0c74387fd06903cd25ab4bc1b6030a819f6e155228f43affc5" gracePeriod=120
Sep 11 12:53:22.726837 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.726706    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="config-reloader" containerID="cri-o://ad51d5985728f354e29ea6b0f1a174fc7cbfb432435463cde7aa4db34c1d9e48" gracePeriod=120
Sep 11 12:53:22.726837 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.726657    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="prom-label-proxy" containerID="cri-o://4daf41427c8da73e4613ffcc4df980b519b602a37378b98c81cfd619f39c723d" gracePeriod=120
Sep 11 12:53:22.726837 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.726667    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy-web" containerID="cri-o://f23ad262d8f44e461b5a153e63a49c26eac548773fc41c0a03b0c4789b30c81c" gracePeriod=120
Sep 11 12:53:22.904720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.904689    2573 generic.go:356] "Generic (PLEG): container finished" podID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerID="4daf41427c8da73e4613ffcc4df980b519b602a37378b98c81cfd619f39c723d" exitCode=0
Sep 11 12:53:22.904720 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.904718    2573 generic.go:356] "Generic (PLEG): container finished" podID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerID="cb5d9ee0c73b7d65c2efd5ece506efe536f31e15b2d4554864e877b29b5a21f3" exitCode=0
Sep 11 12:53:22.904856 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.904727    2573 generic.go:356] "Generic (PLEG): container finished" podID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerID="ad51d5985728f354e29ea6b0f1a174fc7cbfb432435463cde7aa4db34c1d9e48" exitCode=0
Sep 11 12:53:22.904856 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.904734    2573 generic.go:356] "Generic (PLEG): container finished" podID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerID="8a24276e2013236b42d166f2cd417d9fa39d8a9f83109eec9889fa56a01578c7" exitCode=0
Sep 11 12:53:22.904856 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.904754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerDied","Data":"4daf41427c8da73e4613ffcc4df980b519b602a37378b98c81cfd619f39c723d"}
Sep 11 12:53:22.904856 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.904818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerDied","Data":"cb5d9ee0c73b7d65c2efd5ece506efe536f31e15b2d4554864e877b29b5a21f3"}
Sep 11 12:53:22.904856 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.904845    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerDied","Data":"ad51d5985728f354e29ea6b0f1a174fc7cbfb432435463cde7aa4db34c1d9e48"}
Sep 11 12:53:22.905005 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:22.904869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerDied","Data":"8a24276e2013236b42d166f2cd417d9fa39d8a9f83109eec9889fa56a01578c7"}
Sep 11 12:53:23.914954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:23.914924    2573 generic.go:356] "Generic (PLEG): container finished" podID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerID="f709ecf01e238b0c74387fd06903cd25ab4bc1b6030a819f6e155228f43affc5" exitCode=0
Sep 11 12:53:23.914954 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:23.914950    2573 generic.go:356] "Generic (PLEG): container finished" podID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerID="f23ad262d8f44e461b5a153e63a49c26eac548773fc41c0a03b0c4789b30c81c" exitCode=0
Sep 11 12:53:23.915386 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:23.914992    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerDied","Data":"f709ecf01e238b0c74387fd06903cd25ab4bc1b6030a819f6e155228f43affc5"}
Sep 11 12:53:23.915386 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:23.915062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerDied","Data":"f23ad262d8f44e461b5a153e63a49c26eac548773fc41c0a03b0c4789b30c81c"}
Sep 11 12:53:23.964974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:23.964953    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:24.154206 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154114    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.154206 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154147    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-metrics-client-ca\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.154421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154227    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-trusted-ca-bundle\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.154421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154252    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-config-out\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.154421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154275    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.154421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154318    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-tls-assets\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.154421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154354    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-config-volume\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.154421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154382    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-web-config\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.154733 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.154665    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:24.157088 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157046    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:24.157238 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157145    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-config-out" (OuterVolumeSpecName: "config-out") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:24.157238 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157207    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157471    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-cluster-tls-config\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157528    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-main-db\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157571    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nchtw\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-kube-api-access-nchtw\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157604    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-web\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157642    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy\") pod \"033f9cab-bace-44b3-bcae-2c093f7079f1\" (UID: \"033f9cab-bace-44b3-bcae-2c093f7079f1\") "
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157964    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-metrics-client-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.157989    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.158004    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-config-out\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.158346 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.158019    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-main-tls\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.159328 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.159300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:24.160240 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.160005    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-config-volume" (OuterVolumeSpecName: "config-volume") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:24.160349 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.160300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:53:24.162262 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.160531    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:24.162262 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.160781    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:24.162262 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.161493    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-kube-api-access-nchtw" (OuterVolumeSpecName: "kube-api-access-nchtw") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "kube-api-access-nchtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:53:24.164396 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.163313    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:24.167548 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.167517    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:24.171405 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.171387    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-web-config" (OuterVolumeSpecName: "web-config") pod "033f9cab-bace-44b3-bcae-2c093f7079f1" (UID: "033f9cab-bace-44b3-bcae-2c093f7079f1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:24.258493 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258471    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.258493 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258492    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-tls-assets\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.258635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258505    2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.258635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258527    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-web-config\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.258635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258536    2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-cluster-tls-config\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.258635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258544    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/033f9cab-bace-44b3-bcae-2c093f7079f1-alertmanager-main-db\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.258635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258553    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nchtw\" (UniqueName: \"kubernetes.io/projected/033f9cab-bace-44b3-bcae-2c093f7079f1-kube-api-access-nchtw\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.258635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258561    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.258635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.258570    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/033f9cab-bace-44b3-bcae-2c093f7079f1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:53:24.922443 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.922408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"033f9cab-bace-44b3-bcae-2c093f7079f1","Type":"ContainerDied","Data":"edc3dd70a30ec57545e347209d0dd855fd48fee539234a5a66fc03cacd90eba5"}
Sep 11 12:53:24.922443 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.922430    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:24.922888 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.922482    2573 scope.go:117] "RemoveContainer" containerID="4daf41427c8da73e4613ffcc4df980b519b602a37378b98c81cfd619f39c723d"
Sep 11 12:53:24.930437 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.930418    2573 scope.go:117] "RemoveContainer" containerID="f709ecf01e238b0c74387fd06903cd25ab4bc1b6030a819f6e155228f43affc5"
Sep 11 12:53:24.937375 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.937354    2573 scope.go:117] "RemoveContainer" containerID="cb5d9ee0c73b7d65c2efd5ece506efe536f31e15b2d4554864e877b29b5a21f3"
Sep 11 12:53:24.941244 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.941224    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:53:24.944839 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.944816    2573 scope.go:117] "RemoveContainer" containerID="f23ad262d8f44e461b5a153e63a49c26eac548773fc41c0a03b0c4789b30c81c"
Sep 11 12:53:24.946164 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.946142    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:53:24.951646 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.951630    2573 scope.go:117] "RemoveContainer" containerID="ad51d5985728f354e29ea6b0f1a174fc7cbfb432435463cde7aa4db34c1d9e48"
Sep 11 12:53:24.958084 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.958068    2573 scope.go:117] "RemoveContainer" containerID="8a24276e2013236b42d166f2cd417d9fa39d8a9f83109eec9889fa56a01578c7"
Sep 11 12:53:24.964483 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.964466    2573 scope.go:117] "RemoveContainer" containerID="5efdd1585eed9d2682b34dcb2b847db905fdc8d08c9223ec2e5310c1840d7871"
Sep 11 12:53:24.974244 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974224    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:53:24.974473 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974461    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913c3731-7d0e-48fe-b35a-d64d7592e3fc" containerName="console"
Sep 11 12:53:24.974527 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974474    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="913c3731-7d0e-48fe-b35a-d64d7592e3fc" containerName="console"
Sep 11 12:53:24.974527 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974484    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="prom-label-proxy"
Sep 11 12:53:24.974527 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974489    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="prom-label-proxy"
Sep 11 12:53:24.974527 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974499    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy-metric"
Sep 11 12:53:24.974527 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974513    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy-metric"
Sep 11 12:53:24.974527 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974526    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy-web"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974532    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy-web"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974540    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974545    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974550    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="init-config-reloader"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974556    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="init-config-reloader"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974561    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="alertmanager"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974566    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="alertmanager"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974571    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="config-reloader"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974576    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="config-reloader"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974584    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff2549-92ac-4ba9-8499-186df7c6ce8a" containerName="registry"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974588    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff2549-92ac-4ba9-8499-186df7c6ce8a" containerName="registry"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974632    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy-metric"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974639    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="config-reloader"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974645    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="913c3731-7d0e-48fe-b35a-d64d7592e3fc" containerName="console"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974650    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974655    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="alertmanager"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974660    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="prom-label-proxy"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974665    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" containerName="kube-rbac-proxy-web"
Sep 11 12:53:24.974699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.974669    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ff2549-92ac-4ba9-8499-186df7c6ce8a" containerName="registry"
Sep 11 12:53:24.979548 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.979529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:24.984204 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984139    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 12:53:24.984204 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984155    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 12:53:24.984359 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984218    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 12:53:24.984359 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984252    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 12:53:24.984359 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984233    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 12:53:24.984359 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984238    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 12:53:24.984555 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984219    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 12:53:24.984555 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984383    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w64f9\""
Sep 11 12:53:24.984555 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:24.984141    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 12:53:25.004799 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.004771    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:53:25.005994 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.005977    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 12:53:25.065271 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065211    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065271 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065271 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065265    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-web-config\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065413 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-config-out\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065413 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065413 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065375    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065413 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065413 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065564 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065564 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065564 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065534    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppn84\" (UniqueName: \"kubernetes.io/projected/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-kube-api-access-ppn84\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065564 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065558    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.065683 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.065573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.166645 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.166737 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppn84\" (UniqueName: \"kubernetes.io/projected/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-kube-api-access-ppn84\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.166737 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.166737 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.166876 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.166927 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.166927 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-web-config\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.167027 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-config-out\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.167027 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.166988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.167129 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.167027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.167129 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.167061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.167129 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.167092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.167370 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.167150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.167370 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.167314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.168010 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.167986    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.168767 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.168728    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.170233 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.170205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.170326 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.170257    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.170974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.170539    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-web-config\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.170974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.170554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.170974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.170735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-config-out\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.170974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.170737    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.171160 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.170983    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.171628 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.171605    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.172601 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.172580    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.174435 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.174414    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppn84\" (UniqueName: \"kubernetes.io/projected/49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff-kube-api-access-ppn84\") pod \"alertmanager-main-0\" (UID: \"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.289575 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.289540    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:53:25.571246 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.571208    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:53:25.574643 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:53:25.574617    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f9ed8e_601b_4abe_a0a2_b7f119eeb0ff.slice/crio-fbfbb832ecfd7962266d7bf2fd0691d168223123c922497593a17a245ad8ef2e WatchSource:0}: Error finding container fbfbb832ecfd7962266d7bf2fd0691d168223123c922497593a17a245ad8ef2e: Status 404 returned error can't find the container with id fbfbb832ecfd7962266d7bf2fd0691d168223123c922497593a17a245ad8ef2e
Sep 11 12:53:25.928921 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.928852    2573 generic.go:356] "Generic (PLEG): container finished" podID="49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff" containerID="0c093a534c90f7a62cd92821aafdc6fe5f2df3b8bc873c7ec7a53e54970f5fe5" exitCode=0
Sep 11 12:53:25.929270 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.928945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff","Type":"ContainerDied","Data":"0c093a534c90f7a62cd92821aafdc6fe5f2df3b8bc873c7ec7a53e54970f5fe5"}
Sep 11 12:53:25.929270 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:25.929011    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff","Type":"ContainerStarted","Data":"fbfbb832ecfd7962266d7bf2fd0691d168223123c922497593a17a245ad8ef2e"}
Sep 11 12:53:26.516730 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:26.516659    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="033f9cab-bace-44b3-bcae-2c093f7079f1" path="/var/lib/kubelet/pods/033f9cab-bace-44b3-bcae-2c093f7079f1/volumes"
Sep 11 12:53:26.936241 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:26.936204    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff","Type":"ContainerStarted","Data":"a39cc04e46edc51643c9820430b3a41bdb5790d2df314ca071d0bbf616d9f7ac"}
Sep 11 12:53:26.936578 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:26.936271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff","Type":"ContainerStarted","Data":"5410d61088d85e7f620b3736fe2f550bed74ec45464809221351b9cbf74583dd"}
Sep 11 12:53:26.936578 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:26.936296    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff","Type":"ContainerStarted","Data":"36a0c2c16f7fc9e24afa01ab454e177e97f73156bdb9ad63840a4110410c635d"}
Sep 11 12:53:26.936578 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:26.936322    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff","Type":"ContainerStarted","Data":"0210ee4dca46d9f8095c1f05baa1233e7825f92767ae17bb5e2e812eadada758"}
Sep 11 12:53:26.936578 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:26.936346    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff","Type":"ContainerStarted","Data":"40e97d48056bbf999cb053737a12b7e4ad6b0a8e35cb357a193d8bff956d88a5"}
Sep 11 12:53:26.936578 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:26.936367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff","Type":"ContainerStarted","Data":"5eec1d41736c039545880efa3ad3622ab449cf2faac0a550e99bcb627ba5601f"}
Sep 11 12:53:26.962731 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:26.962678    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.950567036 podStartE2EDuration="2.962656271s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.089235ms" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:26.961734634 +0000 UTC m=+385.036197399" watchObservedRunningTime="2026-09-11 12:53:26.962656271 +0000 UTC m=+385.037119037"
Sep 11 12:53:28.008592 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:28.008556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:28.102986 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:28.102950    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:30.696964 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:30.696909    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:30.758281 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:30.758242    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:31.101616 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:31.101582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:31.160559 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:31.160527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:39.739190 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.739151    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c4c56dcd-cvxpc"]
Sep 11 12:53:39.743846 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.743817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.756798 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.756775    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c4c56dcd-cvxpc"]
Sep 11 12:53:39.771570 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.771545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-oauth-config\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.771699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.771612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-oauth-serving-cert\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.771699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.771637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-service-ca\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.771699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.771667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-config\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.771699 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.771691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-trusted-ca-bundle\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.771882 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.771723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-serving-cert\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.771882 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.771780    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msgzk\" (UniqueName: \"kubernetes.io/projected/9aca8c6e-46d6-42cd-b075-613fc513eef3-kube-api-access-msgzk\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.795383 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.795359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:39.854269 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.854245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:39.872439 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.872414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-oauth-config\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.872530 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.872472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-oauth-serving-cert\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.872530 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.872494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-service-ca\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.872530 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.872512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-config\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.872668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.872538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-trusted-ca-bundle\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.872668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.872563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-serving-cert\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.872668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.872589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msgzk\" (UniqueName: \"kubernetes.io/projected/9aca8c6e-46d6-42cd-b075-613fc513eef3-kube-api-access-msgzk\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.873290 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.873265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-service-ca\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.873386 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.873265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-oauth-serving-cert\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.873441 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.873394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-config\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.873480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.873463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-trusted-ca-bundle\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.874964 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.874945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-oauth-config\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.875224 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.875203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-serving-cert\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:39.882786 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:39.882765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msgzk\" (UniqueName: \"kubernetes.io/projected/9aca8c6e-46d6-42cd-b075-613fc513eef3-kube-api-access-msgzk\") pod \"console-64c4c56dcd-cvxpc\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") " pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:40.054579 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:40.054551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:40.326670 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:40.326643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c4c56dcd-cvxpc"]
Sep 11 12:53:40.329309 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:53:40.329273    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aca8c6e_46d6_42cd_b075_613fc513eef3.slice/crio-7297f3355b3c09e5cec0097f8b612e74c967c56e6f51b5a7a6d7ddab983251b9 WatchSource:0}: Error finding container 7297f3355b3c09e5cec0097f8b612e74c967c56e6f51b5a7a6d7ddab983251b9: Status 404 returned error can't find the container with id 7297f3355b3c09e5cec0097f8b612e74c967c56e6f51b5a7a6d7ddab983251b9
Sep 11 12:53:40.510056 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:40.510023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:40.610783 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:40.610705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:40.995943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:40.995849    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4c56dcd-cvxpc" event={"ID":"9aca8c6e-46d6-42cd-b075-613fc513eef3","Type":"ContainerStarted","Data":"f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5"}
Sep 11 12:53:40.995943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:40.995902    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4c56dcd-cvxpc" event={"ID":"9aca8c6e-46d6-42cd-b075-613fc513eef3","Type":"ContainerStarted","Data":"7297f3355b3c09e5cec0097f8b612e74c967c56e6f51b5a7a6d7ddab983251b9"}
Sep 11 12:53:50.055308 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:50.055269    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:50.055834 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:50.055332    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:50.060400 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:50.060376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:50.077269 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:50.077225    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c4c56dcd-cvxpc" podStartSLOduration=11.077209335 podStartE2EDuration="11.077209335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:41.018619005 +0000 UTC m=+399.093081769" watchObservedRunningTime="2026-09-11 12:53:50.077209335 +0000 UTC m=+408.151672098"
Sep 11 12:53:51.040911 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:51.040881    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:53:51.085139 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:51.085094    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687995fd5b-9prq9"]
Sep 11 12:53:51.203515 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:51.203473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:51.292498 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:53:51.292425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:00.303469 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:00.303431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:00.361681 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:00.361644    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:16.111479 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.111434    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-687995fd5b-9prq9" podUID="c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" containerName="console" containerID="cri-o://a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3" gracePeriod=15
Sep 11 12:54:16.363496 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.363443    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:54:16.446610 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.446587    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-serving-cert\") pod \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") "
Sep 11 12:54:16.446745 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.446620    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-kube-api-access-rtxfc\") pod \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") "
Sep 11 12:54:16.446745 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.446638    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-oauth-serving-cert\") pod \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") "
Sep 11 12:54:16.446745 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.446663    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-config\") pod \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") "
Sep 11 12:54:16.446904 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.446871    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-service-ca\") pod \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") "
Sep 11 12:54:16.446961 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.446915    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-oauth-config\") pod \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") "
Sep 11 12:54:16.447020 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.446986    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-trusted-ca-bundle\") pod \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\" (UID: \"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6\") "
Sep 11 12:54:16.447070 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.447031    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" (UID: "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:54:16.447070 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.447039    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-config" (OuterVolumeSpecName: "console-config") pod "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" (UID: "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:54:16.447324 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.447292    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-service-ca" (OuterVolumeSpecName: "service-ca") pod "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" (UID: "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:54:16.447403 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.447335    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-oauth-serving-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:16.447403 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.447349    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-config\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:16.447620 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.447598    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" (UID: "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:54:16.448843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.448824    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" (UID: "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:54:16.448911 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.448872    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-kube-api-access-rtxfc" (OuterVolumeSpecName: "kube-api-access-rtxfc") pod "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" (UID: "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6"). InnerVolumeSpecName "kube-api-access-rtxfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:54:16.449278 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.449255    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" (UID: "c1804a2d-3323-48f0-83bf-c4d1bbc4eda6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:54:16.547979 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.547952    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-trusted-ca-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:16.547979 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.547978    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-serving-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:16.548111 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.547991    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-kube-api-access-rtxfc\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:16.548111 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.548003    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:16.548111 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:16.548017    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6-console-oauth-config\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:17.150257 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.150223    2573 generic.go:356] "Generic (PLEG): container finished" podID="c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" containerID="a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3" exitCode=0
Sep 11 12:54:17.150674 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.150283    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687995fd5b-9prq9"
Sep 11 12:54:17.150674 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.150305    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687995fd5b-9prq9" event={"ID":"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6","Type":"ContainerDied","Data":"a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3"}
Sep 11 12:54:17.150674 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.150363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687995fd5b-9prq9" event={"ID":"c1804a2d-3323-48f0-83bf-c4d1bbc4eda6","Type":"ContainerDied","Data":"af404e90e405030e2d43d879dcf248fdea3ce099a47efe94df0838ed282e602a"}
Sep 11 12:54:17.150674 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.150386    2573 scope.go:117] "RemoveContainer" containerID="a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3"
Sep 11 12:54:17.159826 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.159809    2573 scope.go:117] "RemoveContainer" containerID="a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3"
Sep 11 12:54:17.160144 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:54:17.160121    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3\": container with ID starting with a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3 not found: ID does not exist" containerID="a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3"
Sep 11 12:54:17.160268 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.160154    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3"} err="failed to get container status \"a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3\": rpc error: code = NotFound desc = could not find container \"a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3\": container with ID starting with a7d33ac4106f24930b9e9aefb25932dfed2104250cdc1065e730a1eb405aa4b3 not found: ID does not exist"
Sep 11 12:54:17.166001 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.165977    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687995fd5b-9prq9"]
Sep 11 12:54:17.170670 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:17.170647    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687995fd5b-9prq9"]
Sep 11 12:54:18.517242 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:18.517204    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" path="/var/lib/kubelet/pods/c1804a2d-3323-48f0-83bf-c4d1bbc4eda6/volumes"
Sep 11 12:54:29.761895 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:29.761816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:29.861280 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:29.861246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:30.497614 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.497556    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"]
Sep 11 12:54:30.497869 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.497857    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" containerName="console"
Sep 11 12:54:30.497910 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.497870    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" containerName="console"
Sep 11 12:54:30.497943 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.497922    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1804a2d-3323-48f0-83bf-c4d1bbc4eda6" containerName="console"
Sep 11 12:54:30.501003 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.500988    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.503293 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.503274    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:54:30.503559 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.503546    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:54:30.503940 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.503925    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-psqnw\""
Sep 11 12:54:30.517383 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.517360    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"]
Sep 11 12:54:30.648244 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.648222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-762f7\" (UniqueName: \"kubernetes.io/projected/62c567f7-8b29-4aae-9dac-9b7e4ed73592-kube-api-access-762f7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.648354 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.648255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.648354 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.648282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.749207 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.749129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-762f7\" (UniqueName: \"kubernetes.io/projected/62c567f7-8b29-4aae-9dac-9b7e4ed73592-kube-api-access-762f7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.749207 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.749195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.749347 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.749239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.749558 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.749541    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.749597 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.749574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.757380 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.757357    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-762f7\" (UniqueName: \"kubernetes.io/projected/62c567f7-8b29-4aae-9dac-9b7e4ed73592-kube-api-access-762f7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:30.810457 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:30.810426    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:31.079646 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:31.079612    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"]
Sep 11 12:54:31.082858 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:54:31.082829    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c567f7_8b29_4aae_9dac_9b7e4ed73592.slice/crio-d374e890494dcd5e41fd4ed70ad9175aee6a4701da111b13e5e7366e972b136e WatchSource:0}: Error finding container d374e890494dcd5e41fd4ed70ad9175aee6a4701da111b13e5e7366e972b136e: Status 404 returned error can't find the container with id d374e890494dcd5e41fd4ed70ad9175aee6a4701da111b13e5e7366e972b136e
Sep 11 12:54:31.212148 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:31.212117    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2" event={"ID":"62c567f7-8b29-4aae-9dac-9b7e4ed73592","Type":"ContainerStarted","Data":"d374e890494dcd5e41fd4ed70ad9175aee6a4701da111b13e5e7366e972b136e"}
Sep 11 12:54:36.234655 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:36.234590    2573 generic.go:356] "Generic (PLEG): container finished" podID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerID="054a0d2ad2e388cf161b6232ba541f6ba6d447e46cb1c181f245284a32171250" exitCode=0
Sep 11 12:54:36.234655 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:36.234636    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2" event={"ID":"62c567f7-8b29-4aae-9dac-9b7e4ed73592","Type":"ContainerDied","Data":"054a0d2ad2e388cf161b6232ba541f6ba6d447e46cb1c181f245284a32171250"}
Sep 11 12:54:39.247881 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:39.247850    2573 generic.go:356] "Generic (PLEG): container finished" podID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerID="6f01a8a1662bec2fc56cc25473f74884d0a79704288482bda6d46c6ec6ffe7b9" exitCode=0
Sep 11 12:54:39.248198 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:39.247890    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2" event={"ID":"62c567f7-8b29-4aae-9dac-9b7e4ed73592","Type":"ContainerDied","Data":"6f01a8a1662bec2fc56cc25473f74884d0a79704288482bda6d46c6ec6ffe7b9"}
Sep 11 12:54:46.280925 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:46.280893    2573 generic.go:356] "Generic (PLEG): container finished" podID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerID="639fbb326721274c86ea2b8d3766113fff6791c23b85ae538a61b138901bd966" exitCode=0
Sep 11 12:54:46.281274 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:46.280968    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2" event={"ID":"62c567f7-8b29-4aae-9dac-9b7e4ed73592","Type":"ContainerDied","Data":"639fbb326721274c86ea2b8d3766113fff6791c23b85ae538a61b138901bd966"}
Sep 11 12:54:47.404690 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.404661    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:47.486769 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.486745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-util\") pod \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") "
Sep 11 12:54:47.486891 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.486863    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-762f7\" (UniqueName: \"kubernetes.io/projected/62c567f7-8b29-4aae-9dac-9b7e4ed73592-kube-api-access-762f7\") pod \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") "
Sep 11 12:54:47.486958 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.486894    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-bundle\") pod \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\" (UID: \"62c567f7-8b29-4aae-9dac-9b7e4ed73592\") "
Sep 11 12:54:47.487559 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.487528    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-bundle" (OuterVolumeSpecName: "bundle") pod "62c567f7-8b29-4aae-9dac-9b7e4ed73592" (UID: "62c567f7-8b29-4aae-9dac-9b7e4ed73592"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:54:47.489033 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.489017    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c567f7-8b29-4aae-9dac-9b7e4ed73592-kube-api-access-762f7" (OuterVolumeSpecName: "kube-api-access-762f7") pod "62c567f7-8b29-4aae-9dac-9b7e4ed73592" (UID: "62c567f7-8b29-4aae-9dac-9b7e4ed73592"). InnerVolumeSpecName "kube-api-access-762f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:54:47.491851 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.491827    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-util" (OuterVolumeSpecName: "util") pod "62c567f7-8b29-4aae-9dac-9b7e4ed73592" (UID: "62c567f7-8b29-4aae-9dac-9b7e4ed73592"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:54:47.588378 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.588324    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-762f7\" (UniqueName: \"kubernetes.io/projected/62c567f7-8b29-4aae-9dac-9b7e4ed73592-kube-api-access-762f7\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:47.588378 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.588347    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:47.588378 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:47.588360    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c567f7-8b29-4aae-9dac-9b7e4ed73592-util\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:54:48.290017 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:48.289989    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2" event={"ID":"62c567f7-8b29-4aae-9dac-9b7e4ed73592","Type":"ContainerDied","Data":"d374e890494dcd5e41fd4ed70ad9175aee6a4701da111b13e5e7366e972b136e"}
Sep 11 12:54:48.290017 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:48.290015    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th6w2"
Sep 11 12:54:48.290147 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:48.290028    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d374e890494dcd5e41fd4ed70ad9175aee6a4701da111b13e5e7366e972b136e"
Sep 11 12:54:51.497330 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:51.497296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:52.318449 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:52.318420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:55.113511 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:55.113474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:55.232021 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:54:55.231984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:00.524338 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:00.524301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:00.623866 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:00.623840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:04.400901 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:04.400864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:04.497984 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:04.497962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:04.713412 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:04.713352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:04.864895 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:04.864864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:06.523358 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.523325    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"]
Sep 11 12:55:06.523709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.523585    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerName="extract"
Sep 11 12:55:06.523709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.523596    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerName="extract"
Sep 11 12:55:06.523709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.523615    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerName="util"
Sep 11 12:55:06.523709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.523620    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerName="util"
Sep 11 12:55:06.523709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.523626    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerName="pull"
Sep 11 12:55:06.523709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.523644    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerName="pull"
Sep 11 12:55:06.523709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.523683    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="62c567f7-8b29-4aae-9dac-9b7e4ed73592" containerName="extract"
Sep 11 12:55:06.526189 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.526161    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.528337 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.528319    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:55:06.528742 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.528713    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-psqnw\""
Sep 11 12:55:06.528830 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.528746    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:55:06.534871 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.534840    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"]
Sep 11 12:55:06.604017 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.603985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:06.621714 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.621692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.621806 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.621735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.621806 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.621760    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2k69\" (UniqueName: \"kubernetes.io/projected/fd3226a2-3bc7-4af6-99ef-ae071385defe-kube-api-access-s2k69\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.722875 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.722851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.722968 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.722881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2k69\" (UniqueName: \"kubernetes.io/projected/fd3226a2-3bc7-4af6-99ef-ae071385defe-kube-api-access-s2k69\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.722968 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.722913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.723277 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.723261    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.723336 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.723323    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.730731 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.730711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2k69\" (UniqueName: \"kubernetes.io/projected/fd3226a2-3bc7-4af6-99ef-ae071385defe-kube-api-access-s2k69\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:06.788566 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.788540    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:06.836134 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:06.836113    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:07.104885 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:07.104847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"]
Sep 11 12:55:07.107259 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:55:07.107234    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3226a2_3bc7_4af6_99ef_ae071385defe.slice/crio-913bbc91c8754cc5c575af3fe06cfdc5613b8dcf874e1fb8edc4e983897b4318 WatchSource:0}: Error finding container 913bbc91c8754cc5c575af3fe06cfdc5613b8dcf874e1fb8edc4e983897b4318: Status 404 returned error can't find the container with id 913bbc91c8754cc5c575af3fe06cfdc5613b8dcf874e1fb8edc4e983897b4318
Sep 11 12:55:07.358392 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:07.358334    2573 generic.go:356] "Generic (PLEG): container finished" podID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerID="12db82194061b7f54af8bcea2f56ded257e80dc635adea0f9542b96652441731" exitCode=0
Sep 11 12:55:07.358507 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:07.358408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v" event={"ID":"fd3226a2-3bc7-4af6-99ef-ae071385defe","Type":"ContainerDied","Data":"12db82194061b7f54af8bcea2f56ded257e80dc635adea0f9542b96652441731"}
Sep 11 12:55:07.358507 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:07.358453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v" event={"ID":"fd3226a2-3bc7-4af6-99ef-ae071385defe","Type":"ContainerStarted","Data":"913bbc91c8754cc5c575af3fe06cfdc5613b8dcf874e1fb8edc4e983897b4318"}
Sep 11 12:55:09.367637 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:09.367597    2573 generic.go:356] "Generic (PLEG): container finished" podID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerID="340d2693f0ad97b8a2267e7c7aa7d91477dc6e2529c4f8f05d8d25e8d0c77412" exitCode=0
Sep 11 12:55:09.367909 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:09.367673    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v" event={"ID":"fd3226a2-3bc7-4af6-99ef-ae071385defe","Type":"ContainerDied","Data":"340d2693f0ad97b8a2267e7c7aa7d91477dc6e2529c4f8f05d8d25e8d0c77412"}
Sep 11 12:55:10.373772 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:10.373742    2573 generic.go:356] "Generic (PLEG): container finished" podID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerID="d148c00f91cfd8f00dedb1062f1db69c11fa1e915d07cdd1adacd94e18030119" exitCode=0
Sep 11 12:55:10.374115 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:10.373810    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v" event={"ID":"fd3226a2-3bc7-4af6-99ef-ae071385defe","Type":"ContainerDied","Data":"d148c00f91cfd8f00dedb1062f1db69c11fa1e915d07cdd1adacd94e18030119"}
Sep 11 12:55:11.502695 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.502670    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:11.559940 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.559916    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2k69\" (UniqueName: \"kubernetes.io/projected/fd3226a2-3bc7-4af6-99ef-ae071385defe-kube-api-access-s2k69\") pod \"fd3226a2-3bc7-4af6-99ef-ae071385defe\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") "
Sep 11 12:55:11.560062 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.559979    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-util\") pod \"fd3226a2-3bc7-4af6-99ef-ae071385defe\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") "
Sep 11 12:55:11.560062 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.560012    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-bundle\") pod \"fd3226a2-3bc7-4af6-99ef-ae071385defe\" (UID: \"fd3226a2-3bc7-4af6-99ef-ae071385defe\") "
Sep 11 12:55:11.560419 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.560388    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-bundle" (OuterVolumeSpecName: "bundle") pod "fd3226a2-3bc7-4af6-99ef-ae071385defe" (UID: "fd3226a2-3bc7-4af6-99ef-ae071385defe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:11.562205 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.562161    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd3226a2-3bc7-4af6-99ef-ae071385defe-kube-api-access-s2k69" (OuterVolumeSpecName: "kube-api-access-s2k69") pod "fd3226a2-3bc7-4af6-99ef-ae071385defe" (UID: "fd3226a2-3bc7-4af6-99ef-ae071385defe"). InnerVolumeSpecName "kube-api-access-s2k69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:11.566417 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.566389    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-util" (OuterVolumeSpecName: "util") pod "fd3226a2-3bc7-4af6-99ef-ae071385defe" (UID: "fd3226a2-3bc7-4af6-99ef-ae071385defe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:11.570223 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.570203    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"]
Sep 11 12:55:11.570483 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.570472    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerName="extract"
Sep 11 12:55:11.570535 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.570485    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerName="extract"
Sep 11 12:55:11.570535 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.570502    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerName="pull"
Sep 11 12:55:11.570535 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.570508    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerName="pull"
Sep 11 12:55:11.570535 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.570519    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerName="util"
Sep 11 12:55:11.570535 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.570524    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerName="util"
Sep 11 12:55:11.570679 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.570583    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd3226a2-3bc7-4af6-99ef-ae071385defe" containerName="extract"
Sep 11 12:55:11.572412 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.572394    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"
Sep 11 12:55:11.574870 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.574854    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9tj8m\""
Sep 11 12:55:11.575109 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.575094    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 12:55:11.575348 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.575334    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 12:55:11.581881 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.581861    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"]
Sep 11 12:55:11.661266 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.661206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73a27843-e4bb-4ba1-9145-8632d17e2f42-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fwkhv\" (UID: \"73a27843-e4bb-4ba1-9145-8632d17e2f42\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"
Sep 11 12:55:11.661266 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.661249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcptf\" (UniqueName: \"kubernetes.io/projected/73a27843-e4bb-4ba1-9145-8632d17e2f42-kube-api-access-xcptf\") pod \"cert-manager-cainjector-559cdd8c87-fwkhv\" (UID: \"73a27843-e4bb-4ba1-9145-8632d17e2f42\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"
Sep 11 12:55:11.661404 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.661281    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2k69\" (UniqueName: \"kubernetes.io/projected/fd3226a2-3bc7-4af6-99ef-ae071385defe-kube-api-access-s2k69\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:11.661404 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.661291    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-util\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:11.661404 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.661301    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd3226a2-3bc7-4af6-99ef-ae071385defe-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:11.762402 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.762373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73a27843-e4bb-4ba1-9145-8632d17e2f42-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fwkhv\" (UID: \"73a27843-e4bb-4ba1-9145-8632d17e2f42\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"
Sep 11 12:55:11.762517 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.762409    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcptf\" (UniqueName: \"kubernetes.io/projected/73a27843-e4bb-4ba1-9145-8632d17e2f42-kube-api-access-xcptf\") pod \"cert-manager-cainjector-559cdd8c87-fwkhv\" (UID: \"73a27843-e4bb-4ba1-9145-8632d17e2f42\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"
Sep 11 12:55:11.770926 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.770902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73a27843-e4bb-4ba1-9145-8632d17e2f42-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fwkhv\" (UID: \"73a27843-e4bb-4ba1-9145-8632d17e2f42\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"
Sep 11 12:55:11.771338 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.771319    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcptf\" (UniqueName: \"kubernetes.io/projected/73a27843-e4bb-4ba1-9145-8632d17e2f42-kube-api-access-xcptf\") pod \"cert-manager-cainjector-559cdd8c87-fwkhv\" (UID: \"73a27843-e4bb-4ba1-9145-8632d17e2f42\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"
Sep 11 12:55:11.902794 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:11.902775    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"
Sep 11 12:55:12.170284 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:12.170246    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv"]
Sep 11 12:55:12.172376 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:55:12.172348    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73a27843_e4bb_4ba1_9145_8632d17e2f42.slice/crio-ddba0198118f3582a4c28138e9a66876b5e67636e59fb4ddfe648f007da285e9 WatchSource:0}: Error finding container ddba0198118f3582a4c28138e9a66876b5e67636e59fb4ddfe648f007da285e9: Status 404 returned error can't find the container with id ddba0198118f3582a4c28138e9a66876b5e67636e59fb4ddfe648f007da285e9
Sep 11 12:55:12.383843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:12.383811    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v"
Sep 11 12:55:12.383843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:12.383830    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdh7v" event={"ID":"fd3226a2-3bc7-4af6-99ef-ae071385defe","Type":"ContainerDied","Data":"913bbc91c8754cc5c575af3fe06cfdc5613b8dcf874e1fb8edc4e983897b4318"}
Sep 11 12:55:12.384051 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:12.383877    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="913bbc91c8754cc5c575af3fe06cfdc5613b8dcf874e1fb8edc4e983897b4318"
Sep 11 12:55:12.385107 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:12.385083    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv" event={"ID":"73a27843-e4bb-4ba1-9145-8632d17e2f42","Type":"ContainerStarted","Data":"ddba0198118f3582a4c28138e9a66876b5e67636e59fb4ddfe648f007da285e9"}
Sep 11 12:55:15.007977 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:15.007929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:15.246080 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:15.246028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:15.302679 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:15.302651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:15.401358 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:15.401326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv" event={"ID":"73a27843-e4bb-4ba1-9145-8632d17e2f42","Type":"ContainerStarted","Data":"9bd9a3fbc164109dbffcda24de1bc3c53ddf65be179e1040e4bfb5bae8bd5392"}
Sep 11 12:55:15.419515 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:15.419467    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwkhv" podStartSLOduration=2.112556061 podStartE2EDuration="4.419452389s" totalImagesPullingTime="2.306896328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:15.417378309 +0000 UTC m=+493.491841073" watchObservedRunningTime="2026-09-11 12:55:15.419452389 +0000 UTC m=+493.493915152"
Sep 11 12:55:17.636526 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:17.636475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:17.735857 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:17.735829    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:19.621099 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.621066    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"]
Sep 11 12:55:19.623390 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.623368    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"
Sep 11 12:55:19.625611 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.625588    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:55:19.626037 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.626021    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 12:55:19.626123 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.626024    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tnmqb\""
Sep 11 12:55:19.635628 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.635596    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"]
Sep 11 12:55:19.723703 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.723672    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vvlx\" (UniqueName: \"kubernetes.io/projected/becbe09f-34a1-4ed9-9abe-fd68eb17922d-kube-api-access-5vvlx\") pod \"openshift-lws-operator-fd8ccff4c-sb6dn\" (UID: \"becbe09f-34a1-4ed9-9abe-fd68eb17922d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"
Sep 11 12:55:19.723803 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.723730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/becbe09f-34a1-4ed9-9abe-fd68eb17922d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sb6dn\" (UID: \"becbe09f-34a1-4ed9-9abe-fd68eb17922d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"
Sep 11 12:55:19.825101 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.825071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/becbe09f-34a1-4ed9-9abe-fd68eb17922d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sb6dn\" (UID: \"becbe09f-34a1-4ed9-9abe-fd68eb17922d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"
Sep 11 12:55:19.825223 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.825154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vvlx\" (UniqueName: \"kubernetes.io/projected/becbe09f-34a1-4ed9-9abe-fd68eb17922d-kube-api-access-5vvlx\") pod \"openshift-lws-operator-fd8ccff4c-sb6dn\" (UID: \"becbe09f-34a1-4ed9-9abe-fd68eb17922d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"
Sep 11 12:55:19.825453 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.825426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/becbe09f-34a1-4ed9-9abe-fd68eb17922d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sb6dn\" (UID: \"becbe09f-34a1-4ed9-9abe-fd68eb17922d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"
Sep 11 12:55:19.833621 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.833602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vvlx\" (UniqueName: \"kubernetes.io/projected/becbe09f-34a1-4ed9-9abe-fd68eb17922d-kube-api-access-5vvlx\") pod \"openshift-lws-operator-fd8ccff4c-sb6dn\" (UID: \"becbe09f-34a1-4ed9-9abe-fd68eb17922d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"
Sep 11 12:55:19.932276 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:19.932225    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"
Sep 11 12:55:20.215474 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:20.215385    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn"]
Sep 11 12:55:20.219839 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:55:20.219793    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbecbe09f_34a1_4ed9_9abe_fd68eb17922d.slice/crio-2a4b1209e87c0eadcd8c69c8ef7ceeb44268899adeba65d72434591f9043b7e6 WatchSource:0}: Error finding container 2a4b1209e87c0eadcd8c69c8ef7ceeb44268899adeba65d72434591f9043b7e6: Status 404 returned error can't find the container with id 2a4b1209e87c0eadcd8c69c8ef7ceeb44268899adeba65d72434591f9043b7e6
Sep 11 12:55:20.423241 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:20.423208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn" event={"ID":"becbe09f-34a1-4ed9-9abe-fd68eb17922d","Type":"ContainerStarted","Data":"2a4b1209e87c0eadcd8c69c8ef7ceeb44268899adeba65d72434591f9043b7e6"}
Sep 11 12:55:22.433691 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:22.433609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn" event={"ID":"becbe09f-34a1-4ed9-9abe-fd68eb17922d","Type":"ContainerStarted","Data":"ecfa69c9e997ae60710e902da2f877c569886f501243f5a588eac3d7b6c877d9"}
Sep 11 12:55:22.450380 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:22.450325    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sb6dn" podStartSLOduration=1.585624342 podStartE2EDuration="3.450304356s" totalImagesPullingTime="1.864680014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:22.448501552 +0000 UTC m=+500.522964318" watchObservedRunningTime="2026-09-11 12:55:22.450304356 +0000 UTC m=+500.524767122"
Sep 11 12:55:23.166332 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:23.166303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:23.267498 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:23.267057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:24.391549 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:24.391516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:25.146344 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.146308    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"]
Sep 11 12:55:25.148843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.148823    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.150795 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.150774    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:55:25.150795 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.150787    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:55:25.151428 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.151410    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-psqnw\""
Sep 11 12:55:25.157717 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.157696    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"]
Sep 11 12:55:25.266103 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.266046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:25.273102 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.273066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.273223 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.273131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.273274 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.273239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df5rp\" (UniqueName: \"kubernetes.io/projected/cbecf16a-3674-4a2e-8050-3a2e82a50e90-kube-api-access-df5rp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.373784 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.373754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.373893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.373794    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df5rp\" (UniqueName: \"kubernetes.io/projected/cbecf16a-3674-4a2e-8050-3a2e82a50e90-kube-api-access-df5rp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.373893 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.373837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.374134 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.374118    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.374221 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.374205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.381871 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.381849    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df5rp\" (UniqueName: \"kubernetes.io/projected/cbecf16a-3674-4a2e-8050-3a2e82a50e90-kube-api-access-df5rp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.458307 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.458246    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:25.725669 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:25.725593    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"]
Sep 11 12:55:25.728770 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:55:25.728742    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbecf16a_3674_4a2e_8050_3a2e82a50e90.slice/crio-7858c0cce2e6e579e70bb555a83e84296b5b81ae6ae2bdf34736a5308f773013 WatchSource:0}: Error finding container 7858c0cce2e6e579e70bb555a83e84296b5b81ae6ae2bdf34736a5308f773013: Status 404 returned error can't find the container with id 7858c0cce2e6e579e70bb555a83e84296b5b81ae6ae2bdf34736a5308f773013
Sep 11 12:55:26.451900 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:26.451872    2573 generic.go:356] "Generic (PLEG): container finished" podID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerID="67dddb72838ef588301b552e81e2900c7129df7434911db76f545cff06fe2d2a" exitCode=0
Sep 11 12:55:26.452051 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:26.451907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf" event={"ID":"cbecf16a-3674-4a2e-8050-3a2e82a50e90","Type":"ContainerDied","Data":"67dddb72838ef588301b552e81e2900c7129df7434911db76f545cff06fe2d2a"}
Sep 11 12:55:26.452051 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:26.451941    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf" event={"ID":"cbecf16a-3674-4a2e-8050-3a2e82a50e90","Type":"ContainerStarted","Data":"7858c0cce2e6e579e70bb555a83e84296b5b81ae6ae2bdf34736a5308f773013"}
Sep 11 12:55:27.459815 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:27.459730    2573 generic.go:356] "Generic (PLEG): container finished" podID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerID="49d2335238d2b5f81c0339a0cf2a78588fb595262b70b10ab3923136de743628" exitCode=0
Sep 11 12:55:27.459815 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:27.459809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf" event={"ID":"cbecf16a-3674-4a2e-8050-3a2e82a50e90","Type":"ContainerDied","Data":"49d2335238d2b5f81c0339a0cf2a78588fb595262b70b10ab3923136de743628"}
Sep 11 12:55:28.467644 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:28.467598    2573 generic.go:356] "Generic (PLEG): container finished" podID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerID="bc02b46c00494458f79637a4b41e86f5c0fa3cdacec93103a68135f426f0ffd6" exitCode=0
Sep 11 12:55:28.468015 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:28.467661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf" event={"ID":"cbecf16a-3674-4a2e-8050-3a2e82a50e90","Type":"ContainerDied","Data":"bc02b46c00494458f79637a4b41e86f5c0fa3cdacec93103a68135f426f0ffd6"}
Sep 11 12:55:29.596595 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.596568    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:29.705466 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.705436    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-util\") pod \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") "
Sep 11 12:55:29.705619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.705474    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-bundle\") pod \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") "
Sep 11 12:55:29.705619 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.705516    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df5rp\" (UniqueName: \"kubernetes.io/projected/cbecf16a-3674-4a2e-8050-3a2e82a50e90-kube-api-access-df5rp\") pod \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\" (UID: \"cbecf16a-3674-4a2e-8050-3a2e82a50e90\") "
Sep 11 12:55:29.706248 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.706218    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-bundle" (OuterVolumeSpecName: "bundle") pod "cbecf16a-3674-4a2e-8050-3a2e82a50e90" (UID: "cbecf16a-3674-4a2e-8050-3a2e82a50e90"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:29.707696 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.707670    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbecf16a-3674-4a2e-8050-3a2e82a50e90-kube-api-access-df5rp" (OuterVolumeSpecName: "kube-api-access-df5rp") pod "cbecf16a-3674-4a2e-8050-3a2e82a50e90" (UID: "cbecf16a-3674-4a2e-8050-3a2e82a50e90"). InnerVolumeSpecName "kube-api-access-df5rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:29.710646 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.710622    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-util" (OuterVolumeSpecName: "util") pod "cbecf16a-3674-4a2e-8050-3a2e82a50e90" (UID: "cbecf16a-3674-4a2e-8050-3a2e82a50e90"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:29.806256 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.806234    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df5rp\" (UniqueName: \"kubernetes.io/projected/cbecf16a-3674-4a2e-8050-3a2e82a50e90-kube-api-access-df5rp\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.806329 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.806257    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-util\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.806329 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:29.806268    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbecf16a-3674-4a2e-8050-3a2e82a50e90-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:30.479371 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:30.479336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf" event={"ID":"cbecf16a-3674-4a2e-8050-3a2e82a50e90","Type":"ContainerDied","Data":"7858c0cce2e6e579e70bb555a83e84296b5b81ae6ae2bdf34736a5308f773013"}
Sep 11 12:55:30.479371 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:30.479371    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnm7sf"
Sep 11 12:55:30.479568 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:30.479384    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7858c0cce2e6e579e70bb555a83e84296b5b81ae6ae2bdf34736a5308f773013"
Sep 11 12:55:40.969304 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:40.969257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:41.079813 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:41.079778    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:41.569478 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:41.569421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:41.852661 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:41.852533    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:41.957826 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:41.957781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:42.000786 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.000755    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"]
Sep 11 12:55:42.001119 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.001042    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerName="pull"
Sep 11 12:55:42.001119 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.001052    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerName="pull"
Sep 11 12:55:42.001119 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.001064    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerName="extract"
Sep 11 12:55:42.001119 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.001070    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerName="extract"
Sep 11 12:55:42.001119 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.001078    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerName="util"
Sep 11 12:55:42.001119 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.001083    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerName="util"
Sep 11 12:55:42.001350 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.001136    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbecf16a-3674-4a2e-8050-3a2e82a50e90" containerName="extract"
Sep 11 12:55:42.005061 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.005042    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.007279 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.007248    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 12:55:42.007398 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.007308    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 12:55:42.007398 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.007382    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 12:55:42.007662 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.007646    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5m6lg\""
Sep 11 12:55:42.007741 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.007648    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 12:55:42.020505 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.020484    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"]
Sep 11 12:55:42.110006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.109949    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b70ae903-38b0-41fb-9126-c13061578806-manifests\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.110006 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.109987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b70ae903-38b0-41fb-9126-c13061578806-tmp\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.110145 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.110015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b70ae903-38b0-41fb-9126-c13061578806-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.110145 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.110031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s65jd\" (UniqueName: \"kubernetes.io/projected/b70ae903-38b0-41fb-9126-c13061578806-kube-api-access-s65jd\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.110145 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.110080    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b70ae903-38b0-41fb-9126-c13061578806-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.138906 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.138884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:42.210761 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.210737    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b70ae903-38b0-41fb-9126-c13061578806-manifests\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.210850 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.210774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b70ae903-38b0-41fb-9126-c13061578806-tmp\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.210850 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.210805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b70ae903-38b0-41fb-9126-c13061578806-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.210850 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.210823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s65jd\" (UniqueName: \"kubernetes.io/projected/b70ae903-38b0-41fb-9126-c13061578806-kube-api-access-s65jd\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.211001 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.210851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b70ae903-38b0-41fb-9126-c13061578806-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.211194 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.211152    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b70ae903-38b0-41fb-9126-c13061578806-manifests\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.213288 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.213265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b70ae903-38b0-41fb-9126-c13061578806-tmp\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.213372 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.213334    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b70ae903-38b0-41fb-9126-c13061578806-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.213464 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.213448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b70ae903-38b0-41fb-9126-c13061578806-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.218567 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.218549    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s65jd\" (UniqueName: \"kubernetes.io/projected/b70ae903-38b0-41fb-9126-c13061578806-kube-api-access-s65jd\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-xmtgw\" (UID: \"b70ae903-38b0-41fb-9126-c13061578806\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.239506 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.239479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:42.315543 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.315509    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:42.343761 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.343734    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:42.372148 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.372119    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"]
Sep 11 12:55:42.377843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.377819    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.381104 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.380219    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-psqnw\""
Sep 11 12:55:42.381104 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.380443    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:55:42.381104 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.380632    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:55:42.385393 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.385347    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"]
Sep 11 12:55:42.439842 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.439803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:42.512197 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.512142    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.512333 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.512211    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nblbz\" (UniqueName: \"kubernetes.io/projected/fbecf9a9-8300-4e42-8107-f6535211bbbb-kube-api-access-nblbz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.512333 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.512285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.540534 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.540498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:42.593024 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.593000    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"]
Sep 11 12:55:42.594781 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:55:42.594758    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70ae903_38b0_41fb_9126_c13061578806.slice/crio-d7a9d11c77ab5b24bf9fc99c887fcffe5aa92b33df5ce0f35950150b2ab96540 WatchSource:0}: Error finding container d7a9d11c77ab5b24bf9fc99c887fcffe5aa92b33df5ce0f35950150b2ab96540: Status 404 returned error can't find the container with id d7a9d11c77ab5b24bf9fc99c887fcffe5aa92b33df5ce0f35950150b2ab96540
Sep 11 12:55:42.612708 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.612650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.612808 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.612716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.612808 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.612748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nblbz\" (UniqueName: \"kubernetes.io/projected/fbecf9a9-8300-4e42-8107-f6535211bbbb-kube-api-access-nblbz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.613093 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.613070    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.613210 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.613164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.632224 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.632207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nblbz\" (UniqueName: \"kubernetes.io/projected/fbecf9a9-8300-4e42-8107-f6535211bbbb-kube-api-access-nblbz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.660341 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.660319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:42.692200 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.692161    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:42.959961 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:42.959885    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"]
Sep 11 12:55:42.963136 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:55:42.963112    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbecf9a9_8300_4e42_8107_f6535211bbbb.slice/crio-b63f3024c765751e94414895e254b4657c1285f2b6e44703e3e1913da0c08e2f WatchSource:0}: Error finding container b63f3024c765751e94414895e254b4657c1285f2b6e44703e3e1913da0c08e2f: Status 404 returned error can't find the container with id b63f3024c765751e94414895e254b4657c1285f2b6e44703e3e1913da0c08e2f
Sep 11 12:55:43.547458 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:43.547422    2573 generic.go:356] "Generic (PLEG): container finished" podID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerID="7db49d7a90ae30a42a31b64eed6fb34998598958d90a6426c7b0c2ea2ca9f700" exitCode=0
Sep 11 12:55:43.547928 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:43.547516    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r" event={"ID":"fbecf9a9-8300-4e42-8107-f6535211bbbb","Type":"ContainerDied","Data":"7db49d7a90ae30a42a31b64eed6fb34998598958d90a6426c7b0c2ea2ca9f700"}
Sep 11 12:55:43.547928 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:43.547610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r" event={"ID":"fbecf9a9-8300-4e42-8107-f6535211bbbb","Type":"ContainerStarted","Data":"b63f3024c765751e94414895e254b4657c1285f2b6e44703e3e1913da0c08e2f"}
Sep 11 12:55:43.549071 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:43.549034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw" event={"ID":"b70ae903-38b0-41fb-9126-c13061578806","Type":"ContainerStarted","Data":"d7a9d11c77ab5b24bf9fc99c887fcffe5aa92b33df5ce0f35950150b2ab96540"}
Sep 11 12:55:46.564029 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:46.563983    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw" event={"ID":"b70ae903-38b0-41fb-9126-c13061578806","Type":"ContainerStarted","Data":"b9f94c07a591d36c12ccecbea8933c36ab8ea326bd548fd10182374ade8266b4"}
Sep 11 12:55:46.565841 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:46.565814    2573 generic.go:356] "Generic (PLEG): container finished" podID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerID="e654c61f32bc7e9b00b2c1d52769f7fc7267960a76908df04efcae5d28e0bffd" exitCode=0
Sep 11 12:55:46.565948 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:46.565892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r" event={"ID":"fbecf9a9-8300-4e42-8107-f6535211bbbb","Type":"ContainerDied","Data":"e654c61f32bc7e9b00b2c1d52769f7fc7267960a76908df04efcae5d28e0bffd"}
Sep 11 12:55:47.573141 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:47.573104    2573 generic.go:356] "Generic (PLEG): container finished" podID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerID="2e8fa7d58fcd6ed6ce57872fce9efcd021f276f0d3fea60364baf491b2a12314" exitCode=0
Sep 11 12:55:47.573515 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:47.573213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r" event={"ID":"fbecf9a9-8300-4e42-8107-f6535211bbbb","Type":"ContainerDied","Data":"2e8fa7d58fcd6ed6ce57872fce9efcd021f276f0d3fea60364baf491b2a12314"}
Sep 11 12:55:47.574823 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:47.574803    2573 generic.go:356] "Generic (PLEG): container finished" podID="b70ae903-38b0-41fb-9126-c13061578806" containerID="b9f94c07a591d36c12ccecbea8933c36ab8ea326bd548fd10182374ade8266b4" exitCode=0
Sep 11 12:55:47.574937 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:47.574866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw" event={"ID":"b70ae903-38b0-41fb-9126-c13061578806","Type":"ContainerDied","Data":"b9f94c07a591d36c12ccecbea8933c36ab8ea326bd548fd10182374ade8266b4"}
Sep 11 12:55:48.581019 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.580975    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw" event={"ID":"b70ae903-38b0-41fb-9126-c13061578806","Type":"ContainerStarted","Data":"3050978d65f270efb6bcc17d5b3bf360b6a07ae35bcc1853b13f91b28260ffa3"}
Sep 11 12:55:48.581393 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.581274    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:48.601962 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.601890    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw" podStartSLOduration=2.759856518 podStartE2EDuration="7.601873387s" totalImagesPullingTime="3.78105459s" totalInitContainerRuntime="1.060962279s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:48.599891938 +0000 UTC m=+526.674354701" watchObservedRunningTime="2026-09-11 12:55:48.601873387 +0000 UTC m=+526.676336185"
Sep 11 12:55:48.701440 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.701418    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:48.765250 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.765225    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nblbz\" (UniqueName: \"kubernetes.io/projected/fbecf9a9-8300-4e42-8107-f6535211bbbb-kube-api-access-nblbz\") pod \"fbecf9a9-8300-4e42-8107-f6535211bbbb\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") "
Sep 11 12:55:48.765403 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.765312    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-bundle\") pod \"fbecf9a9-8300-4e42-8107-f6535211bbbb\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") "
Sep 11 12:55:48.765471 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.765410    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-util\") pod \"fbecf9a9-8300-4e42-8107-f6535211bbbb\" (UID: \"fbecf9a9-8300-4e42-8107-f6535211bbbb\") "
Sep 11 12:55:48.766106 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.766081    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-bundle" (OuterVolumeSpecName: "bundle") pod "fbecf9a9-8300-4e42-8107-f6535211bbbb" (UID: "fbecf9a9-8300-4e42-8107-f6535211bbbb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:48.767417 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.767394    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbecf9a9-8300-4e42-8107-f6535211bbbb-kube-api-access-nblbz" (OuterVolumeSpecName: "kube-api-access-nblbz") pod "fbecf9a9-8300-4e42-8107-f6535211bbbb" (UID: "fbecf9a9-8300-4e42-8107-f6535211bbbb"). InnerVolumeSpecName "kube-api-access-nblbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:48.769592 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.769571    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-util" (OuterVolumeSpecName: "util") pod "fbecf9a9-8300-4e42-8107-f6535211bbbb" (UID: "fbecf9a9-8300-4e42-8107-f6535211bbbb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:48.866369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.866317    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:48.866369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.866336    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbecf9a9-8300-4e42-8107-f6535211bbbb-util\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:48.866369 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:48.866344    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nblbz\" (UniqueName: \"kubernetes.io/projected/fbecf9a9-8300-4e42-8107-f6535211bbbb-kube-api-access-nblbz\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:55:49.587652 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:49.587623    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r"
Sep 11 12:55:49.587974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:49.587651    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sr54r" event={"ID":"fbecf9a9-8300-4e42-8107-f6535211bbbb","Type":"ContainerDied","Data":"b63f3024c765751e94414895e254b4657c1285f2b6e44703e3e1913da0c08e2f"}
Sep 11 12:55:49.587974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:49.587689    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b63f3024c765751e94414895e254b4657c1285f2b6e44703e3e1913da0c08e2f"
Sep 11 12:55:57.459242 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:57.459144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:57.559927 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:57.559895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:59.476286 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.476253    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"]
Sep 11 12:55:59.476635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.476541    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerName="extract"
Sep 11 12:55:59.476635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.476551    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerName="extract"
Sep 11 12:55:59.476635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.476565    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerName="util"
Sep 11 12:55:59.476635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.476570    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerName="util"
Sep 11 12:55:59.476635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.476583    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerName="pull"
Sep 11 12:55:59.476635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.476589    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerName="pull"
Sep 11 12:55:59.476831 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.476642    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbecf9a9-8300-4e42-8107-f6535211bbbb" containerName="extract"
Sep 11 12:55:59.479602 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.479584    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.482203 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.482162    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 12:55:59.482305 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.482164    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zgw8r\""
Sep 11 12:55:59.482305 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.482223    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 12:55:59.482305 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.482296    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 12:55:59.488441 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.488416    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"]
Sep 11 12:55:59.540439 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.540410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwrms\" (UniqueName: \"kubernetes.io/projected/c362234e-ce14-4ef9-9358-e3d995f46f47-kube-api-access-nwrms\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.540577 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.540456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c362234e-ce14-4ef9-9358-e3d995f46f47-metrics-cert\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.540577 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.540484    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c362234e-ce14-4ef9-9358-e3d995f46f47-manager-config\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.540577 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.540557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c362234e-ce14-4ef9-9358-e3d995f46f47-cert\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.590004 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.589974    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-xmtgw"
Sep 11 12:55:59.641917 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.641888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c362234e-ce14-4ef9-9358-e3d995f46f47-metrics-cert\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.642100 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.641952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c362234e-ce14-4ef9-9358-e3d995f46f47-manager-config\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.642100 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.642011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c362234e-ce14-4ef9-9358-e3d995f46f47-cert\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.642100 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.642089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwrms\" (UniqueName: \"kubernetes.io/projected/c362234e-ce14-4ef9-9358-e3d995f46f47-kube-api-access-nwrms\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.642766 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.642742    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c362234e-ce14-4ef9-9358-e3d995f46f47-manager-config\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.644723 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.644699    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c362234e-ce14-4ef9-9358-e3d995f46f47-metrics-cert\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.644887 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.644868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c362234e-ce14-4ef9-9358-e3d995f46f47-cert\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.652896 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.652867    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwrms\" (UniqueName: \"kubernetes.io/projected/c362234e-ce14-4ef9-9358-e3d995f46f47-kube-api-access-nwrms\") pod \"lws-controller-manager-5655dcc49-drdwh\" (UID: \"c362234e-ce14-4ef9-9358-e3d995f46f47\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:55:59.789580 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:55:59.789542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:56:00.059972 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:00.059901    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"]
Sep 11 12:56:00.062017 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:56:00.061992    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc362234e_ce14_4ef9_9358_e3d995f46f47.slice/crio-c0c503f6c8c610a920fc94ade2a0e94cfcef8a47d905a9a3d0c2aa993365e676 WatchSource:0}: Error finding container c0c503f6c8c610a920fc94ade2a0e94cfcef8a47d905a9a3d0c2aa993365e676: Status 404 returned error can't find the container with id c0c503f6c8c610a920fc94ade2a0e94cfcef8a47d905a9a3d0c2aa993365e676
Sep 11 12:56:00.638663 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:00.638629    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh" event={"ID":"c362234e-ce14-4ef9-9358-e3d995f46f47","Type":"ContainerStarted","Data":"c0c503f6c8c610a920fc94ade2a0e94cfcef8a47d905a9a3d0c2aa993365e676"}
Sep 11 12:56:01.255343 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.255308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:01.372827 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.372785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:01.768447 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.768402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:01.883643 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.883603    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"]
Sep 11 12:56:01.888456 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.888432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:01.892274 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.892239    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 12:56:01.892274 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.892255    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 12:56:01.893431 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.893415    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zdpb6\""
Sep 11 12:56:01.901399 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.901374    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"]
Sep 11 12:56:01.960287 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.960248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f465c9a8-4b49-4789-be17-49524afcbc8c-tmp\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:01.960469 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.960335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f465c9a8-4b49-4789-be17-49524afcbc8c-tls-certs\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:01.960469 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.960353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4jg2\" (UniqueName: \"kubernetes.io/projected/f465c9a8-4b49-4789-be17-49524afcbc8c-kube-api-access-z4jg2\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:01.984275 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:01.984246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:02.060851 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.060813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f465c9a8-4b49-4789-be17-49524afcbc8c-tls-certs\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:02.061044 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.060860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4jg2\" (UniqueName: \"kubernetes.io/projected/f465c9a8-4b49-4789-be17-49524afcbc8c-kube-api-access-z4jg2\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:02.061044 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.060887    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f465c9a8-4b49-4789-be17-49524afcbc8c-tmp\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:02.063458 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.063426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f465c9a8-4b49-4789-be17-49524afcbc8c-tmp\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:02.063669 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.063649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f465c9a8-4b49-4789-be17-49524afcbc8c-tls-certs\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:02.076128 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.076099    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4jg2\" (UniqueName: \"kubernetes.io/projected/f465c9a8-4b49-4789-be17-49524afcbc8c-kube-api-access-z4jg2\") pod \"kube-auth-proxy-75775448dd-dd7w4\" (UID: \"f465c9a8-4b49-4789-be17-49524afcbc8c\") " pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:02.199277 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.199249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"
Sep 11 12:56:02.482428 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.482255    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75775448dd-dd7w4"]
Sep 11 12:56:02.483649 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:56:02.483622    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf465c9a8_4b49_4789_be17_49524afcbc8c.slice/crio-911724b5ca1badda6aa9d25f2a2dfa8867a0629bf139c246d33802cb56101cad WatchSource:0}: Error finding container 911724b5ca1badda6aa9d25f2a2dfa8867a0629bf139c246d33802cb56101cad: Status 404 returned error can't find the container with id 911724b5ca1badda6aa9d25f2a2dfa8867a0629bf139c246d33802cb56101cad
Sep 11 12:56:02.650505 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:02.650468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4" event={"ID":"f465c9a8-4b49-4789-be17-49524afcbc8c","Type":"ContainerStarted","Data":"911724b5ca1badda6aa9d25f2a2dfa8867a0629bf139c246d33802cb56101cad"}
Sep 11 12:56:03.446368 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:03.446269    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:03.544682 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:03.544645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:03.659955 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:03.659911    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh" event={"ID":"c362234e-ce14-4ef9-9358-e3d995f46f47","Type":"ContainerStarted","Data":"f053c93a819883637664d3166c1add9a47383af47ed6315b155c56391c681f2f"}
Sep 11 12:56:03.660497 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:03.660474    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:56:03.678224 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:03.678141    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh" podStartSLOduration=1.6007819840000002 podStartE2EDuration="4.678121544s" totalImagesPullingTime="3.07733956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:03.67766248 +0000 UTC m=+541.752125245" watchObservedRunningTime="2026-09-11 12:56:03.678121544 +0000 UTC m=+541.752584314"
Sep 11 12:56:04.440942 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:04.440894    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:05.404781 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:05.404757    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 12:56:05.671216 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:05.671124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4" event={"ID":"f465c9a8-4b49-4789-be17-49524afcbc8c","Type":"ContainerStarted","Data":"8cbd18d3979aee5ea1e972221c09620fa62e2c0f3afdd45da27a2752506eb4ca"}
Sep 11 12:56:05.689353 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:05.689306    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75775448dd-dd7w4" podStartSLOduration=1.772485871 podStartE2EDuration="4.689289687s" totalImagesPullingTime="2.916803816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:05.688259747 +0000 UTC m=+543.762722512" watchObservedRunningTime="2026-09-11 12:56:05.689289687 +0000 UTC m=+543.763752451"
Sep 11 12:56:08.845643 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:08.845595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:08.945981 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:08.945940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:09.509974 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:09.509935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:09.731962 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:09.731934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:09.833539 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:09.833495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:12.449421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:12.449356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:12.544715 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:12.544684    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:12.646669 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:12.646638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:12.882674 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:12.882645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:13.016620 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:13.016591    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:13.315133 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:13.315102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:14.668434 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:14.668402    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-drdwh"
Sep 11 12:56:22.524939 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:22.524902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:22.626007 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:22.625974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.102778 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:23.102725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.240397 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:23.240365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.829218 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:23.829163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:23.974751 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:23.974707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:24.038305 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:56:24.038276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:02.507856 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:02.507812    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 12:57:02.509750 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:02.509717    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 12:57:02.516245 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:02.516220    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 12:57:02.520422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:02.520388    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 12:57:13.602482 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:13.602441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:15.271536 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:15.271486    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:17.593299 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.593262    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"]
Sep 11 12:57:17.596089 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.596069    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.598165 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.598135    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:57:17.598550 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.598534    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:57:17.598641 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.598580    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-psqnw\""
Sep 11 12:57:17.604952 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.604919    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"]
Sep 11 12:57:17.648116 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.648077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.648281 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.648238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.648347 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.648285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhcbn\" (UniqueName: \"kubernetes.io/projected/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-kube-api-access-jhcbn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.690866 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.690838    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"]
Sep 11 12:57:17.693071 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.693056    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.701406 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.701384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"]
Sep 11 12:57:17.749410 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.749385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.749571 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.749420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cztc7\" (UniqueName: \"kubernetes.io/projected/37723ed4-16d3-4076-ab49-bcb84879fb8d-kube-api-access-cztc7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.749571 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.749442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhcbn\" (UniqueName: \"kubernetes.io/projected/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-kube-api-access-jhcbn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.749695 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.749572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.749695 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.749623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.749788 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.749692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.749845 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.749826    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.749903 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.749886    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.756788 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.756764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhcbn\" (UniqueName: \"kubernetes.io/projected/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-kube-api-access-jhcbn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.790092 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.790061    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"]
Sep 11 12:57:17.792942 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.792926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.801385 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.801364    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"]
Sep 11 12:57:17.850422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.850366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.850422 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.850395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.850550 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.850423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvxt6\" (UniqueName: \"kubernetes.io/projected/697f2bd9-85a9-4b89-acbe-7c803a463f93-kube-api-access-nvxt6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.850550 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.850491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cztc7\" (UniqueName: \"kubernetes.io/projected/37723ed4-16d3-4076-ab49-bcb84879fb8d-kube-api-access-cztc7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.850550 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.850519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.850675 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.850562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.850831 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.850814    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.850872 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.850837    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.858761 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.858738    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cztc7\" (UniqueName: \"kubernetes.io/projected/37723ed4-16d3-4076-ab49-bcb84879fb8d-kube-api-access-cztc7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:17.890833 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.890809    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"]
Sep 11 12:57:17.893325 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.893312    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:17.903300 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.903280    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"]
Sep 11 12:57:17.907449 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.907427    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:17.951697 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.951658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:17.951889 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.951717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.951889 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.951750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.951889 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.951789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvxt6\" (UniqueName: \"kubernetes.io/projected/697f2bd9-85a9-4b89-acbe-7c803a463f93-kube-api-access-nvxt6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.951889 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.951813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:17.951889 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.951853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxlfd\" (UniqueName: \"kubernetes.io/projected/144566cb-2c96-4c63-8bb1-cac0da64831c-kube-api-access-vxlfd\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:17.952380 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.952113    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.952380 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.952132    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:17.961784 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:17.961756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvxt6\" (UniqueName: \"kubernetes.io/projected/697f2bd9-85a9-4b89-acbe-7c803a463f93-kube-api-access-nvxt6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:18.002408 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.002383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:18.053351 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.053329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:18.053448 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.053399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxlfd\" (UniqueName: \"kubernetes.io/projected/144566cb-2c96-4c63-8bb1-cac0da64831c-kube-api-access-vxlfd\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:18.053512 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.053477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:18.053794 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.053769    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:18.053912 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.053774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:18.066845 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.066822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxlfd\" (UniqueName: \"kubernetes.io/projected/144566cb-2c96-4c63-8bb1-cac0da64831c-kube-api-access-vxlfd\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:18.102690 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.102632    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:18.181080 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.181004    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"]
Sep 11 12:57:18.183314 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:57:18.183288    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f22251e_e82c_40ee_8dbe_bb6cb8de1b73.slice/crio-bd12e0faa20d1b97f10cb54d4be68b03d5ebcdcf42832c3a7327b87caa639608 WatchSource:0}: Error finding container bd12e0faa20d1b97f10cb54d4be68b03d5ebcdcf42832c3a7327b87caa639608: Status 404 returned error can't find the container with id bd12e0faa20d1b97f10cb54d4be68b03d5ebcdcf42832c3a7327b87caa639608
Sep 11 12:57:18.201608 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.201588    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:18.277717 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.277691    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"]
Sep 11 12:57:18.281829 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:57:18.281797    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37723ed4_16d3_4076_ab49_bcb84879fb8d.slice/crio-406229554e6f538ece57eb8293b0c435e9f2db50395a7eed1a1f0dbf9cd0d439 WatchSource:0}: Error finding container 406229554e6f538ece57eb8293b0c435e9f2db50395a7eed1a1f0dbf9cd0d439: Status 404 returned error can't find the container with id 406229554e6f538ece57eb8293b0c435e9f2db50395a7eed1a1f0dbf9cd0d439
Sep 11 12:57:18.374288 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.374263    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"]
Sep 11 12:57:18.376680 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:57:18.376648    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697f2bd9_85a9_4b89_acbe_7c803a463f93.slice/crio-af99ec0e9a05c3b5da5554f9d2be2bd8abc771eddb97c87a86becd9bc5ab5815 WatchSource:0}: Error finding container af99ec0e9a05c3b5da5554f9d2be2bd8abc771eddb97c87a86becd9bc5ab5815: Status 404 returned error can't find the container with id af99ec0e9a05c3b5da5554f9d2be2bd8abc771eddb97c87a86becd9bc5ab5815
Sep 11 12:57:18.471972 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:18.471950    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"]
Sep 11 12:57:18.473527 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:57:18.473506    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144566cb_2c96_4c63_8bb1_cac0da64831c.slice/crio-cbbb926f1bdacc43210933523699d10bcd0ac4861d2e64fbd5ed9f165afe5e2d WatchSource:0}: Error finding container cbbb926f1bdacc43210933523699d10bcd0ac4861d2e64fbd5ed9f165afe5e2d: Status 404 returned error can't find the container with id cbbb926f1bdacc43210933523699d10bcd0ac4861d2e64fbd5ed9f165afe5e2d
Sep 11 12:57:19.051322 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.051283    2573 generic.go:356] "Generic (PLEG): container finished" podID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerID="8a380ed6af5ae78396d05a54d01a404742755fea0b06bbaefb675900452f0298" exitCode=0
Sep 11 12:57:19.051709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.051379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb" event={"ID":"37723ed4-16d3-4076-ab49-bcb84879fb8d","Type":"ContainerDied","Data":"8a380ed6af5ae78396d05a54d01a404742755fea0b06bbaefb675900452f0298"}
Sep 11 12:57:19.051709 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.051434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb" event={"ID":"37723ed4-16d3-4076-ab49-bcb84879fb8d","Type":"ContainerStarted","Data":"406229554e6f538ece57eb8293b0c435e9f2db50395a7eed1a1f0dbf9cd0d439"}
Sep 11 12:57:19.052651 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.052631    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:57:19.053459 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.053429    2573 generic.go:356] "Generic (PLEG): container finished" podID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerID="43c0b0acccfa9b444ba92994a47859835774ec13aebb80a1ad4672e5a00088fb" exitCode=0
Sep 11 12:57:19.053544 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.053477    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz" event={"ID":"697f2bd9-85a9-4b89-acbe-7c803a463f93","Type":"ContainerDied","Data":"43c0b0acccfa9b444ba92994a47859835774ec13aebb80a1ad4672e5a00088fb"}
Sep 11 12:57:19.053607 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.053547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz" event={"ID":"697f2bd9-85a9-4b89-acbe-7c803a463f93","Type":"ContainerStarted","Data":"af99ec0e9a05c3b5da5554f9d2be2bd8abc771eddb97c87a86becd9bc5ab5815"}
Sep 11 12:57:19.055760 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.055737    2573 generic.go:356] "Generic (PLEG): container finished" podID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerID="0dd6f457e9c88ce3387471ab96f0c0daa54850ef659d6d190faaaed3d714c875" exitCode=0
Sep 11 12:57:19.055870 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.055779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6" event={"ID":"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73","Type":"ContainerDied","Data":"0dd6f457e9c88ce3387471ab96f0c0daa54850ef659d6d190faaaed3d714c875"}
Sep 11 12:57:19.055870 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.055839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6" event={"ID":"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73","Type":"ContainerStarted","Data":"bd12e0faa20d1b97f10cb54d4be68b03d5ebcdcf42832c3a7327b87caa639608"}
Sep 11 12:57:19.057888 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.057842    2573 generic.go:356] "Generic (PLEG): container finished" podID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerID="18ddb197d34e5c5a8c959db520df84bf9f9339dbcf240608845c39c7f13831c9" exitCode=0
Sep 11 12:57:19.057888 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.057881    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59" event={"ID":"144566cb-2c96-4c63-8bb1-cac0da64831c","Type":"ContainerDied","Data":"18ddb197d34e5c5a8c959db520df84bf9f9339dbcf240608845c39c7f13831c9"}
Sep 11 12:57:19.058097 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:19.057917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59" event={"ID":"144566cb-2c96-4c63-8bb1-cac0da64831c","Type":"ContainerStarted","Data":"cbbb926f1bdacc43210933523699d10bcd0ac4861d2e64fbd5ed9f165afe5e2d"}
Sep 11 12:57:20.065125 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:20.065097    2573 generic.go:356] "Generic (PLEG): container finished" podID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerID="e52c1c8132172ab9113babce940958c3f28b7e558fc4d57957df491cce2623dd" exitCode=0
Sep 11 12:57:20.065552 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:20.065190    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz" event={"ID":"697f2bd9-85a9-4b89-acbe-7c803a463f93","Type":"ContainerDied","Data":"e52c1c8132172ab9113babce940958c3f28b7e558fc4d57957df491cce2623dd"}
Sep 11 12:57:21.072479 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:21.072448    2573 generic.go:356] "Generic (PLEG): container finished" podID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerID="8f712bfcf41aeb5d55e60fa28ff0dfe0abc88f7808f9e67c77bc6099f2d9eb8c" exitCode=0
Sep 11 12:57:21.072882 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:21.072533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz" event={"ID":"697f2bd9-85a9-4b89-acbe-7c803a463f93","Type":"ContainerDied","Data":"8f712bfcf41aeb5d55e60fa28ff0dfe0abc88f7808f9e67c77bc6099f2d9eb8c"}
Sep 11 12:57:21.074487 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:21.074465    2573 generic.go:356] "Generic (PLEG): container finished" podID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerID="79a95167799d11242058c0b36d780bfce2d5727b423cd1b70db7341edd4e44fe" exitCode=0
Sep 11 12:57:21.074590 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:21.074541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59" event={"ID":"144566cb-2c96-4c63-8bb1-cac0da64831c","Type":"ContainerDied","Data":"79a95167799d11242058c0b36d780bfce2d5727b423cd1b70db7341edd4e44fe"}
Sep 11 12:57:21.076551 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:21.076526    2573 generic.go:356] "Generic (PLEG): container finished" podID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerID="3f558b3f517cf7973381945771ec9cdb56f94dcb7e61d4f6f584e857bef41c27" exitCode=0
Sep 11 12:57:21.076651 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:21.076603    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb" event={"ID":"37723ed4-16d3-4076-ab49-bcb84879fb8d","Type":"ContainerDied","Data":"3f558b3f517cf7973381945771ec9cdb56f94dcb7e61d4f6f584e857bef41c27"}
Sep 11 12:57:22.083749 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.083712    2573 generic.go:356] "Generic (PLEG): container finished" podID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerID="8532b01fe3e749cf2a68b56994b9965ca9aff6610230fb6f938e470a7edb2aa0" exitCode=0
Sep 11 12:57:22.084212 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.083815    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59" event={"ID":"144566cb-2c96-4c63-8bb1-cac0da64831c","Type":"ContainerDied","Data":"8532b01fe3e749cf2a68b56994b9965ca9aff6610230fb6f938e470a7edb2aa0"}
Sep 11 12:57:22.086024 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.085998    2573 generic.go:356] "Generic (PLEG): container finished" podID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerID="57fc86ed127638643e08c9a5dec56027941aec482ce96b6d6bdced2e4a17bbb8" exitCode=0
Sep 11 12:57:22.086124 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.086071    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb" event={"ID":"37723ed4-16d3-4076-ab49-bcb84879fb8d","Type":"ContainerDied","Data":"57fc86ed127638643e08c9a5dec56027941aec482ce96b6d6bdced2e4a17bbb8"}
Sep 11 12:57:22.210537 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.210511    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:22.292008 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.291984    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-bundle\") pod \"697f2bd9-85a9-4b89-acbe-7c803a463f93\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") "
Sep 11 12:57:22.292231 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.292016    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-util\") pod \"697f2bd9-85a9-4b89-acbe-7c803a463f93\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") "
Sep 11 12:57:22.292231 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.292059    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvxt6\" (UniqueName: \"kubernetes.io/projected/697f2bd9-85a9-4b89-acbe-7c803a463f93-kube-api-access-nvxt6\") pod \"697f2bd9-85a9-4b89-acbe-7c803a463f93\" (UID: \"697f2bd9-85a9-4b89-acbe-7c803a463f93\") "
Sep 11 12:57:22.292584 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.292553    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-bundle" (OuterVolumeSpecName: "bundle") pod "697f2bd9-85a9-4b89-acbe-7c803a463f93" (UID: "697f2bd9-85a9-4b89-acbe-7c803a463f93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:22.294241 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.294218    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697f2bd9-85a9-4b89-acbe-7c803a463f93-kube-api-access-nvxt6" (OuterVolumeSpecName: "kube-api-access-nvxt6") pod "697f2bd9-85a9-4b89-acbe-7c803a463f93" (UID: "697f2bd9-85a9-4b89-acbe-7c803a463f93"). InnerVolumeSpecName "kube-api-access-nvxt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:22.299643 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.299617    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-util" (OuterVolumeSpecName: "util") pod "697f2bd9-85a9-4b89-acbe-7c803a463f93" (UID: "697f2bd9-85a9-4b89-acbe-7c803a463f93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:22.392668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.392610    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:22.392668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.392632    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/697f2bd9-85a9-4b89-acbe-7c803a463f93-util\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:22.392668 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:22.392641    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvxt6\" (UniqueName: \"kubernetes.io/projected/697f2bd9-85a9-4b89-acbe-7c803a463f93-kube-api-access-nvxt6\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:23.093273 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.093213    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz"
Sep 11 12:57:23.093611 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.093211    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crpxvz" event={"ID":"697f2bd9-85a9-4b89-acbe-7c803a463f93","Type":"ContainerDied","Data":"af99ec0e9a05c3b5da5554f9d2be2bd8abc771eddb97c87a86becd9bc5ab5815"}
Sep 11 12:57:23.093611 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.093350    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af99ec0e9a05c3b5da5554f9d2be2bd8abc771eddb97c87a86becd9bc5ab5815"
Sep 11 12:57:23.095443 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.095421    2573 generic.go:356] "Generic (PLEG): container finished" podID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerID="b5677566a2dd55d7aa584d56cadee482d700a840800b0c21cfee02f5a073b84b" exitCode=0
Sep 11 12:57:23.095553 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.095469    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6" event={"ID":"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73","Type":"ContainerDied","Data":"b5677566a2dd55d7aa584d56cadee482d700a840800b0c21cfee02f5a073b84b"}
Sep 11 12:57:23.248408 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.248384    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:23.251457 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.251432    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:23.299929 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.299907    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-bundle\") pod \"37723ed4-16d3-4076-ab49-bcb84879fb8d\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") "
Sep 11 12:57:23.300036 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.299941    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-util\") pod \"37723ed4-16d3-4076-ab49-bcb84879fb8d\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") "
Sep 11 12:57:23.300036 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.299957    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-bundle\") pod \"144566cb-2c96-4c63-8bb1-cac0da64831c\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") "
Sep 11 12:57:23.300036 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.299977    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxlfd\" (UniqueName: \"kubernetes.io/projected/144566cb-2c96-4c63-8bb1-cac0da64831c-kube-api-access-vxlfd\") pod \"144566cb-2c96-4c63-8bb1-cac0da64831c\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") "
Sep 11 12:57:23.300036 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.300013    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cztc7\" (UniqueName: \"kubernetes.io/projected/37723ed4-16d3-4076-ab49-bcb84879fb8d-kube-api-access-cztc7\") pod \"37723ed4-16d3-4076-ab49-bcb84879fb8d\" (UID: \"37723ed4-16d3-4076-ab49-bcb84879fb8d\") "
Sep 11 12:57:23.300595 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.300049    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-util\") pod \"144566cb-2c96-4c63-8bb1-cac0da64831c\" (UID: \"144566cb-2c96-4c63-8bb1-cac0da64831c\") "
Sep 11 12:57:23.300653 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.300610    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-bundle" (OuterVolumeSpecName: "bundle") pod "37723ed4-16d3-4076-ab49-bcb84879fb8d" (UID: "37723ed4-16d3-4076-ab49-bcb84879fb8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:23.300713 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.300695    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-bundle" (OuterVolumeSpecName: "bundle") pod "144566cb-2c96-4c63-8bb1-cac0da64831c" (UID: "144566cb-2c96-4c63-8bb1-cac0da64831c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:23.302474 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.302439    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37723ed4-16d3-4076-ab49-bcb84879fb8d-kube-api-access-cztc7" (OuterVolumeSpecName: "kube-api-access-cztc7") pod "37723ed4-16d3-4076-ab49-bcb84879fb8d" (UID: "37723ed4-16d3-4076-ab49-bcb84879fb8d"). InnerVolumeSpecName "kube-api-access-cztc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:23.302576 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.302531    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144566cb-2c96-4c63-8bb1-cac0da64831c-kube-api-access-vxlfd" (OuterVolumeSpecName: "kube-api-access-vxlfd") pod "144566cb-2c96-4c63-8bb1-cac0da64831c" (UID: "144566cb-2c96-4c63-8bb1-cac0da64831c"). InnerVolumeSpecName "kube-api-access-vxlfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:23.306021 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.305996    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-util" (OuterVolumeSpecName: "util") pod "37723ed4-16d3-4076-ab49-bcb84879fb8d" (UID: "37723ed4-16d3-4076-ab49-bcb84879fb8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:23.306834 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.306814    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-util" (OuterVolumeSpecName: "util") pod "144566cb-2c96-4c63-8bb1-cac0da64831c" (UID: "144566cb-2c96-4c63-8bb1-cac0da64831c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:23.401638 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.401588    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:23.401638 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.401607    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37723ed4-16d3-4076-ab49-bcb84879fb8d-util\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:23.401638 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.401617    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:23.401638 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.401625    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxlfd\" (UniqueName: \"kubernetes.io/projected/144566cb-2c96-4c63-8bb1-cac0da64831c-kube-api-access-vxlfd\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:23.401638 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.401634    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cztc7\" (UniqueName: \"kubernetes.io/projected/37723ed4-16d3-4076-ab49-bcb84879fb8d-kube-api-access-cztc7\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:23.401834 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:23.401644    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/144566cb-2c96-4c63-8bb1-cac0da64831c-util\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:24.103322 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:24.103283    2573 generic.go:356] "Generic (PLEG): container finished" podID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerID="98b840129ab299b66bdabed19dccbef4716966c4d982a9ede2ebe8a70c392c35" exitCode=0
Sep 11 12:57:24.103702 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:24.103379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6" event={"ID":"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73","Type":"ContainerDied","Data":"98b840129ab299b66bdabed19dccbef4716966c4d982a9ede2ebe8a70c392c35"}
Sep 11 12:57:24.105667 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:24.105643    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59"
Sep 11 12:57:24.105667 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:24.105659    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l7j59" event={"ID":"144566cb-2c96-4c63-8bb1-cac0da64831c","Type":"ContainerDied","Data":"cbbb926f1bdacc43210933523699d10bcd0ac4861d2e64fbd5ed9f165afe5e2d"}
Sep 11 12:57:24.105852 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:24.105697    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbbb926f1bdacc43210933523699d10bcd0ac4861d2e64fbd5ed9f165afe5e2d"
Sep 11 12:57:24.108236 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:24.108194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb" event={"ID":"37723ed4-16d3-4076-ab49-bcb84879fb8d","Type":"ContainerDied","Data":"406229554e6f538ece57eb8293b0c435e9f2db50395a7eed1a1f0dbf9cd0d439"}
Sep 11 12:57:24.108236 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:24.108229    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lk9bb"
Sep 11 12:57:24.108404 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:24.108242    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="406229554e6f538ece57eb8293b0c435e9f2db50395a7eed1a1f0dbf9cd0d439"
Sep 11 12:57:25.237299 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.237278    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:25.316703 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.316675    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-util\") pod \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") "
Sep 11 12:57:25.316831 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.316761    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhcbn\" (UniqueName: \"kubernetes.io/projected/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-kube-api-access-jhcbn\") pod \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") "
Sep 11 12:57:25.316831 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.316784    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-bundle\") pod \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\" (UID: \"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73\") "
Sep 11 12:57:25.317484 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.317453    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-bundle" (OuterVolumeSpecName: "bundle") pod "4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" (UID: "4f22251e-e82c-40ee-8dbe-bb6cb8de1b73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:25.318887 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.318860    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-kube-api-access-jhcbn" (OuterVolumeSpecName: "kube-api-access-jhcbn") pod "4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" (UID: "4f22251e-e82c-40ee-8dbe-bb6cb8de1b73"). InnerVolumeSpecName "kube-api-access-jhcbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:25.321574 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.321528    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-util" (OuterVolumeSpecName: "util") pod "4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" (UID: "4f22251e-e82c-40ee-8dbe-bb6cb8de1b73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:25.418153 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.418097    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhcbn\" (UniqueName: \"kubernetes.io/projected/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-kube-api-access-jhcbn\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:25.418153 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.418121    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:25.418153 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:25.418135    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f22251e-e82c-40ee-8dbe-bb6cb8de1b73-util\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:57:26.120716 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:26.120686    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6"
Sep 11 12:57:26.120848 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:26.120711    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agfjz6" event={"ID":"4f22251e-e82c-40ee-8dbe-bb6cb8de1b73","Type":"ContainerDied","Data":"bd12e0faa20d1b97f10cb54d4be68b03d5ebcdcf42832c3a7327b87caa639608"}
Sep 11 12:57:26.120848 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:26.120761    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd12e0faa20d1b97f10cb54d4be68b03d5ebcdcf42832c3a7327b87caa639608"
Sep 11 12:57:29.957364 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:29.957318    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:32.556579 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:32.556537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:32.999087 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:32.999004    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:33.366526 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:33.366492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:34.083375 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083329    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-779cb767d8-dmlbr"]
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083787    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerName="pull"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083803    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerName="pull"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083812    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerName="extract"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083819    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerName="extract"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083827    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerName="util"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083833    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerName="util"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083839    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerName="pull"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083845    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerName="pull"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083854    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerName="pull"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083861    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerName="pull"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083871    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerName="pull"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083875    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerName="pull"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083888    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerName="util"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083893    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerName="util"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083899    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerName="util"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083904    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerName="util"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083911    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerName="extract"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083919    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerName="extract"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083927    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerName="extract"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083932    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerName="extract"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083938    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerName="util"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083943    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerName="util"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083950    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerName="extract"
Sep 11 12:57:34.083935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.083955    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerName="extract"
Sep 11 12:57:34.085046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.084010    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f22251e-e82c-40ee-8dbe-bb6cb8de1b73" containerName="extract"
Sep 11 12:57:34.085046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.084021    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="37723ed4-16d3-4076-ab49-bcb84879fb8d" containerName="extract"
Sep 11 12:57:34.085046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.084029    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="697f2bd9-85a9-4b89-acbe-7c803a463f93" containerName="extract"
Sep 11 12:57:34.085046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.084037    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="144566cb-2c96-4c63-8bb1-cac0da64831c" containerName="extract"
Sep 11 12:57:34.086652 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.086621    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.099040 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.099015    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-779cb767d8-dmlbr"]
Sep 11 12:57:34.140584 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.140549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:34.184194 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.184147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-trusted-ca-bundle\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.184328 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.184212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-serving-cert\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.184328 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.184231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-config\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.184328 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.184280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-oauth-serving-cert\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.184501 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.184352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dct6k\" (UniqueName: \"kubernetes.io/projected/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-kube-api-access-dct6k\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.184501 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.184394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-oauth-config\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.184501 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.184432    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-service-ca\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.270926 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.270904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:34.285473 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.285447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dct6k\" (UniqueName: \"kubernetes.io/projected/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-kube-api-access-dct6k\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.285569 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.285479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-oauth-config\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.285569 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.285498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-service-ca\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.285717 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.285698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-trusted-ca-bundle\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.285779 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.285762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-serving-cert\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.285834 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.285795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-config\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.285888 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.285833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-oauth-serving-cert\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.286163 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.286124    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-service-ca\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.286436 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.286416    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-config\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.286549 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.286522    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-oauth-serving-cert\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.286608 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.286570    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-trusted-ca-bundle\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.288797 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.288780    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-oauth-config\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.288885 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.288874    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-console-serving-cert\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.293707 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.293686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dct6k\" (UniqueName: \"kubernetes.io/projected/f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc-kube-api-access-dct6k\") pod \"console-779cb767d8-dmlbr\" (UID: \"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc\") " pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.378935 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.378875    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:34.397064 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.397036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:34.606963 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.606924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:34.676473 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.676453    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-779cb767d8-dmlbr"]
Sep 11 12:57:34.678519 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:57:34.678493    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf501c60a_c9ba_42e2_8e9a_82a3b1d17ebc.slice/crio-02cba5efc22c5b4b5e985cb05be7da51f92458cb4dc9cdfa1d5759730a2bf151 WatchSource:0}: Error finding container 02cba5efc22c5b4b5e985cb05be7da51f92458cb4dc9cdfa1d5759730a2bf151: Status 404 returned error can't find the container with id 02cba5efc22c5b4b5e985cb05be7da51f92458cb4dc9cdfa1d5759730a2bf151
Sep 11 12:57:34.876133 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.876099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:34.974141 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:34.974024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:35.170398 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:35.170354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779cb767d8-dmlbr" event={"ID":"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc","Type":"ContainerStarted","Data":"9eee8ad966099cbf45d78d86aee82ffd553f79c5d3dda932099fd8aa74c06b4f"}
Sep 11 12:57:35.170781 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:35.170418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779cb767d8-dmlbr" event={"ID":"f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc","Type":"ContainerStarted","Data":"02cba5efc22c5b4b5e985cb05be7da51f92458cb4dc9cdfa1d5759730a2bf151"}
Sep 11 12:57:35.189130 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:35.189076    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-779cb767d8-dmlbr" podStartSLOduration=1.189060231 podStartE2EDuration="1.189060231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:57:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:35.187488519 +0000 UTC m=+633.261951282" watchObservedRunningTime="2026-09-11 12:57:35.189060231 +0000 UTC m=+633.263522995"
Sep 11 12:57:36.487339 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:36.487298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:36.581220 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:36.581151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:36.952287 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:36.952251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:38.051295 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:38.051257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:38.171877 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:38.171836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:39.584234 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:39.584165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:39.861991 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:39.861913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:42.566366 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:42.566333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:42.642104 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:42.642065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:43.507794 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:43.507740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:43.635813 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:43.635779    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:44.397296 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:44.397258    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:44.397509 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:44.397342    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:44.402617 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:44.402590    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:45.227291 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.227248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-779cb767d8-dmlbr"
Sep 11 12:57:45.274085 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.274057    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c4c56dcd-cvxpc"]
Sep 11 12:57:45.393534 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.393501    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:45.404705 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.404679    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"]
Sep 11 12:57:45.407332 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.407310    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.409905 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.409878    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 12:57:45.410024 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.409908    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bbh28\""
Sep 11 12:57:45.410024 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.409925    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 12:57:45.410024 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.409916    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 12:57:45.410024 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.409913    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 12:57:45.417068 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.417045    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"]
Sep 11 12:57:45.478565 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.478496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slhgr\" (UniqueName: \"kubernetes.io/projected/ced116a1-5055-4296-a8c3-4a24c8f894f3-kube-api-access-slhgr\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.478645 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.478578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ced116a1-5055-4296-a8c3-4a24c8f894f3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.478645 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.478611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ced116a1-5055-4296-a8c3-4a24c8f894f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.483882 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.483838    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:45.579977 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.579949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slhgr\" (UniqueName: \"kubernetes.io/projected/ced116a1-5055-4296-a8c3-4a24c8f894f3-kube-api-access-slhgr\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.580072 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.580036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ced116a1-5055-4296-a8c3-4a24c8f894f3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.580158 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.580093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ced116a1-5055-4296-a8c3-4a24c8f894f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.580635 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.580616    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ced116a1-5055-4296-a8c3-4a24c8f894f3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.582804 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.582782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ced116a1-5055-4296-a8c3-4a24c8f894f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.584134 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.584110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:45.587617 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.587596    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slhgr\" (UniqueName: \"kubernetes.io/projected/ced116a1-5055-4296-a8c3-4a24c8f894f3-kube-api-access-slhgr\") pod \"kuadrant-console-plugin-fbdd4f445-7tw9g\" (UID: \"ced116a1-5055-4296-a8c3-4a24c8f894f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.718505 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.718482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"
Sep 11 12:57:45.989262 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:45.989239    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g"]
Sep 11 12:57:45.990897 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:57:45.990867    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podced116a1_5055_4296_a8c3_4a24c8f894f3.slice/crio-2e91649227c10af3d81cc8bf9d27a9e65c5f75fda3d3976fba7b501f32fef6ef WatchSource:0}: Error finding container 2e91649227c10af3d81cc8bf9d27a9e65c5f75fda3d3976fba7b501f32fef6ef: Status 404 returned error can't find the container with id 2e91649227c10af3d81cc8bf9d27a9e65c5f75fda3d3976fba7b501f32fef6ef
Sep 11 12:57:46.228957 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:46.228924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g" event={"ID":"ced116a1-5055-4296-a8c3-4a24c8f894f3","Type":"ContainerStarted","Data":"2e91649227c10af3d81cc8bf9d27a9e65c5f75fda3d3976fba7b501f32fef6ef"}
Sep 11 12:57:47.958687 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:47.958595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:48.064689 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:48.064642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:48.156836 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:48.156785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:48.256960 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:48.256839    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:48.357812 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:48.357774    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:48.467782 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:48.467745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:52.266475 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:52.266442    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g" event={"ID":"ced116a1-5055-4296-a8c3-4a24c8f894f3","Type":"ContainerStarted","Data":"9f28d7fb42e9faee7bc0ae96cd733be14a1cf9dec499e5e4f8939eeda552347b"}
Sep 11 12:57:52.291614 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:52.291561    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7tw9g" podStartSLOduration=1.628966262 podStartE2EDuration="7.291544855s" totalImagesPullingTime="5.662578593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:52.290062521 +0000 UTC m=+650.364525286" watchObservedRunningTime="2026-09-11 12:57:52.291544855 +0000 UTC m=+650.366007623"
Sep 11 12:57:56.640347 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:56.640309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:56.798403 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:56.798367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:57.308651 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:57.308612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:57.423389 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:57:57.423356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:00.235989 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:00.235956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:02.186089 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:02.186053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:02.445318 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:02.445230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:06.531748 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:06.531717    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:06.637523 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:06.637498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:10.301032 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.300999    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64c4c56dcd-cvxpc" podUID="9aca8c6e-46d6-42cd-b075-613fc513eef3" containerName="console" containerID="cri-o://f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5" gracePeriod=15
Sep 11 12:58:10.561117 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.561059    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:58:10.580402 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580378    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-oauth-config\") pod \"9aca8c6e-46d6-42cd-b075-613fc513eef3\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") "
Sep 11 12:58:10.580532 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580410    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msgzk\" (UniqueName: \"kubernetes.io/projected/9aca8c6e-46d6-42cd-b075-613fc513eef3-kube-api-access-msgzk\") pod \"9aca8c6e-46d6-42cd-b075-613fc513eef3\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") "
Sep 11 12:58:10.580532 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580453    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-trusted-ca-bundle\") pod \"9aca8c6e-46d6-42cd-b075-613fc513eef3\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") "
Sep 11 12:58:10.580532 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580476    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-oauth-serving-cert\") pod \"9aca8c6e-46d6-42cd-b075-613fc513eef3\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") "
Sep 11 12:58:10.580532 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580516    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-service-ca\") pod \"9aca8c6e-46d6-42cd-b075-613fc513eef3\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") "
Sep 11 12:58:10.580742 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580547    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-serving-cert\") pod \"9aca8c6e-46d6-42cd-b075-613fc513eef3\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") "
Sep 11 12:58:10.580742 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580604    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-config\") pod \"9aca8c6e-46d6-42cd-b075-613fc513eef3\" (UID: \"9aca8c6e-46d6-42cd-b075-613fc513eef3\") "
Sep 11 12:58:10.580934 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580904    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-service-ca" (OuterVolumeSpecName: "service-ca") pod "9aca8c6e-46d6-42cd-b075-613fc513eef3" (UID: "9aca8c6e-46d6-42cd-b075-613fc513eef3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:58:10.580994 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580913    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9aca8c6e-46d6-42cd-b075-613fc513eef3" (UID: "9aca8c6e-46d6-42cd-b075-613fc513eef3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:58:10.580994 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580934    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9aca8c6e-46d6-42cd-b075-613fc513eef3" (UID: "9aca8c6e-46d6-42cd-b075-613fc513eef3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:58:10.580994 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.580964    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-config" (OuterVolumeSpecName: "console-config") pod "9aca8c6e-46d6-42cd-b075-613fc513eef3" (UID: "9aca8c6e-46d6-42cd-b075-613fc513eef3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:58:10.582626 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.582598    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9aca8c6e-46d6-42cd-b075-613fc513eef3" (UID: "9aca8c6e-46d6-42cd-b075-613fc513eef3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:58:10.582809 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.582787    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aca8c6e-46d6-42cd-b075-613fc513eef3-kube-api-access-msgzk" (OuterVolumeSpecName: "kube-api-access-msgzk") pod "9aca8c6e-46d6-42cd-b075-613fc513eef3" (UID: "9aca8c6e-46d6-42cd-b075-613fc513eef3"). InnerVolumeSpecName "kube-api-access-msgzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:58:10.582999 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.582985    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9aca8c6e-46d6-42cd-b075-613fc513eef3" (UID: "9aca8c6e-46d6-42cd-b075-613fc513eef3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:58:10.681612 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.681577    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-oauth-serving-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:58:10.681612 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.681608    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:58:10.681612 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.681617    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-serving-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:58:10.681858 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.681627    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-config\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:58:10.681858 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.681636    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aca8c6e-46d6-42cd-b075-613fc513eef3-console-oauth-config\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:58:10.681858 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.681644    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msgzk\" (UniqueName: \"kubernetes.io/projected/9aca8c6e-46d6-42cd-b075-613fc513eef3-kube-api-access-msgzk\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:58:10.681858 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:10.681652    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aca8c6e-46d6-42cd-b075-613fc513eef3-trusted-ca-bundle\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:58:11.364421 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.364390    2573 generic.go:356] "Generic (PLEG): container finished" podID="9aca8c6e-46d6-42cd-b075-613fc513eef3" containerID="f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5" exitCode=0
Sep 11 12:58:11.364853 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.364433    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4c56dcd-cvxpc" event={"ID":"9aca8c6e-46d6-42cd-b075-613fc513eef3","Type":"ContainerDied","Data":"f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5"}
Sep 11 12:58:11.364853 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.364438    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4c56dcd-cvxpc"
Sep 11 12:58:11.364853 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.364466    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4c56dcd-cvxpc" event={"ID":"9aca8c6e-46d6-42cd-b075-613fc513eef3","Type":"ContainerDied","Data":"7297f3355b3c09e5cec0097f8b612e74c967c56e6f51b5a7a6d7ddab983251b9"}
Sep 11 12:58:11.364853 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.364487    2573 scope.go:117] "RemoveContainer" containerID="f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5"
Sep 11 12:58:11.373929 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.373914    2573 scope.go:117] "RemoveContainer" containerID="f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5"
Sep 11 12:58:11.374229 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:58:11.374207    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5\": container with ID starting with f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5 not found: ID does not exist" containerID="f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5"
Sep 11 12:58:11.374285 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.374237    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5"} err="failed to get container status \"f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5\": rpc error: code = NotFound desc = could not find container \"f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5\": container with ID starting with f7ebf54b5fe313b73f2f89a974c629890c31d9e30de10e19b4b2f140be1c40d5 not found: ID does not exist"
Sep 11 12:58:11.407001 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.406972    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c4c56dcd-cvxpc"]
Sep 11 12:58:11.417088 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.417064    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c4c56dcd-cvxpc"]
Sep 11 12:58:11.696412 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.696294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:11.796072 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.796034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:11.893631 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:11.893598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:12.516972 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:12.516927    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aca8c6e-46d6-42cd-b075-613fc513eef3" path="/var/lib/kubelet/pods/9aca8c6e-46d6-42cd-b075-613fc513eef3/volumes"
Sep 11 12:58:12.575788 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:12.575753    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:12.685063 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:12.685025    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:13.142728 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:13.142687    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:13.243937 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:13.243903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:20.347888 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:20.347857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:20.448126 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:20.448053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:23.370766 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:23.370721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:23.504609 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:23.504559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:25.667958 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:25.667918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:25.928129 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:25.928019    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:34.146403 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:34.146365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:37.182376 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.182334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:37.300939 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.300907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:37.462444 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.462347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:37.620621 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.620587    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 12:58:37.620950 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.620937    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aca8c6e-46d6-42cd-b075-613fc513eef3" containerName="console"
Sep 11 12:58:37.620995 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.620951    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aca8c6e-46d6-42cd-b075-613fc513eef3" containerName="console"
Sep 11 12:58:37.621038 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.621029    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aca8c6e-46d6-42cd-b075-613fc513eef3" containerName="console"
Sep 11 12:58:37.624046 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.624030    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:37.625979 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.625959    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 12:58:37.633427 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.633396    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 12:58:37.662885 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.662854    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 12:58:37.705883 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.705853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e53dd8e0-2ce0-43b8-8da4-4e68d0859173-config-file\") pod \"limitador-limitador-84994f7ffc-5nfcf\" (UID: \"e53dd8e0-2ce0-43b8-8da4-4e68d0859173\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:37.706017 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.705930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2jbg\" (UniqueName: \"kubernetes.io/projected/e53dd8e0-2ce0-43b8-8da4-4e68d0859173-kube-api-access-j2jbg\") pod \"limitador-limitador-84994f7ffc-5nfcf\" (UID: \"e53dd8e0-2ce0-43b8-8da4-4e68d0859173\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:37.807040 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.807007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2jbg\" (UniqueName: \"kubernetes.io/projected/e53dd8e0-2ce0-43b8-8da4-4e68d0859173-kube-api-access-j2jbg\") pod \"limitador-limitador-84994f7ffc-5nfcf\" (UID: \"e53dd8e0-2ce0-43b8-8da4-4e68d0859173\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:37.807236 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.807046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e53dd8e0-2ce0-43b8-8da4-4e68d0859173-config-file\") pod \"limitador-limitador-84994f7ffc-5nfcf\" (UID: \"e53dd8e0-2ce0-43b8-8da4-4e68d0859173\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:37.807692 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.807674    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e53dd8e0-2ce0-43b8-8da4-4e68d0859173-config-file\") pod \"limitador-limitador-84994f7ffc-5nfcf\" (UID: \"e53dd8e0-2ce0-43b8-8da4-4e68d0859173\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:37.816601 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.816577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2jbg\" (UniqueName: \"kubernetes.io/projected/e53dd8e0-2ce0-43b8-8da4-4e68d0859173-kube-api-access-j2jbg\") pod \"limitador-limitador-84994f7ffc-5nfcf\" (UID: \"e53dd8e0-2ce0-43b8-8da4-4e68d0859173\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:37.935403 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:37.935366    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:38.005997 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.005969    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-blmbt"]
Sep 11 12:58:38.009731 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.009707    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt"
Sep 11 12:58:38.011775 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.011755    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gwf2j\""
Sep 11 12:58:38.017051 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.017006    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-blmbt"]
Sep 11 12:58:38.052510 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.052481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:38.109682 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.109607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh2vn\" (UniqueName: \"kubernetes.io/projected/41556986-731b-4ceb-a9eb-6fe57e8cd997-kube-api-access-mh2vn\") pod \"authorino-7bcfd8f9cd-blmbt\" (UID: \"41556986-731b-4ceb-a9eb-6fe57e8cd997\") " pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt"
Sep 11 12:58:38.141272 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.141239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:38.207499 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.207478    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 12:58:38.209520 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:58:38.209492    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53dd8e0_2ce0_43b8_8da4_4e68d0859173.slice/crio-2f4e29331ff7c8879b26b274e058dd13af0d996ad34f0753f5f55ebe72597d96 WatchSource:0}: Error finding container 2f4e29331ff7c8879b26b274e058dd13af0d996ad34f0753f5f55ebe72597d96: Status 404 returned error can't find the container with id 2f4e29331ff7c8879b26b274e058dd13af0d996ad34f0753f5f55ebe72597d96
Sep 11 12:58:38.210600 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.210550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh2vn\" (UniqueName: \"kubernetes.io/projected/41556986-731b-4ceb-a9eb-6fe57e8cd997-kube-api-access-mh2vn\") pod \"authorino-7bcfd8f9cd-blmbt\" (UID: \"41556986-731b-4ceb-a9eb-6fe57e8cd997\") " pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt"
Sep 11 12:58:38.218123 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.218099    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh2vn\" (UniqueName: \"kubernetes.io/projected/41556986-731b-4ceb-a9eb-6fe57e8cd997-kube-api-access-mh2vn\") pod \"authorino-7bcfd8f9cd-blmbt\" (UID: \"41556986-731b-4ceb-a9eb-6fe57e8cd997\") " pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt"
Sep 11 12:58:38.320888 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.320855    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt"
Sep 11 12:58:38.504670 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.504635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf" event={"ID":"e53dd8e0-2ce0-43b8-8da4-4e68d0859173","Type":"ContainerStarted","Data":"2f4e29331ff7c8879b26b274e058dd13af0d996ad34f0753f5f55ebe72597d96"}
Sep 11 12:58:38.590632 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:38.590598    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-blmbt"]
Sep 11 12:58:38.594091 ip-10-0-128-225 kubenswrapper[2573]: W0911 12:58:38.594064    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41556986_731b_4ceb_a9eb_6fe57e8cd997.slice/crio-c93aace222adf7dd70532b546760f541fc76d5535eec2bfd64499707ac136913 WatchSource:0}: Error finding container c93aace222adf7dd70532b546760f541fc76d5535eec2bfd64499707ac136913: Status 404 returned error can't find the container with id c93aace222adf7dd70532b546760f541fc76d5535eec2bfd64499707ac136913
Sep 11 12:58:39.511711 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:39.511678    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt" event={"ID":"41556986-731b-4ceb-a9eb-6fe57e8cd997","Type":"ContainerStarted","Data":"c93aace222adf7dd70532b546760f541fc76d5535eec2bfd64499707ac136913"}
Sep 11 12:58:41.442194 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:41.442145    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-blmbt"]
Sep 11 12:58:41.524838 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:41.524804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt" event={"ID":"41556986-731b-4ceb-a9eb-6fe57e8cd997","Type":"ContainerStarted","Data":"76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8"}
Sep 11 12:58:41.525011 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:41.524912    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt" podUID="41556986-731b-4ceb-a9eb-6fe57e8cd997" containerName="authorino" containerID="cri-o://76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8" gracePeriod=30
Sep 11 12:58:41.539061 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:41.539017    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt" podStartSLOduration=1.710044086 podStartE2EDuration="4.539002607s" totalImagesPullingTime="2.828958521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:58:41.536843079 +0000 UTC m=+699.611305843" watchObservedRunningTime="2026-09-11 12:58:41.539002607 +0000 UTC m=+699.613465370"
Sep 11 12:58:41.773460 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:41.773435    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt"
Sep 11 12:58:41.843869 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:41.843840    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh2vn\" (UniqueName: \"kubernetes.io/projected/41556986-731b-4ceb-a9eb-6fe57e8cd997-kube-api-access-mh2vn\") pod \"41556986-731b-4ceb-a9eb-6fe57e8cd997\" (UID: \"41556986-731b-4ceb-a9eb-6fe57e8cd997\") "
Sep 11 12:58:41.846028 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:41.845999    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41556986-731b-4ceb-a9eb-6fe57e8cd997-kube-api-access-mh2vn" (OuterVolumeSpecName: "kube-api-access-mh2vn") pod "41556986-731b-4ceb-a9eb-6fe57e8cd997" (UID: "41556986-731b-4ceb-a9eb-6fe57e8cd997"). InnerVolumeSpecName "kube-api-access-mh2vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:58:41.944953 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:41.944865    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh2vn\" (UniqueName: \"kubernetes.io/projected/41556986-731b-4ceb-a9eb-6fe57e8cd997-kube-api-access-mh2vn\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:58:42.531236 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.531206    2573 generic.go:356] "Generic (PLEG): container finished" podID="41556986-731b-4ceb-a9eb-6fe57e8cd997" containerID="76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8" exitCode=0
Sep 11 12:58:42.531640 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.531252    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt"
Sep 11 12:58:42.531640 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.531300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt" event={"ID":"41556986-731b-4ceb-a9eb-6fe57e8cd997","Type":"ContainerDied","Data":"76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8"}
Sep 11 12:58:42.531640 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.531344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-blmbt" event={"ID":"41556986-731b-4ceb-a9eb-6fe57e8cd997","Type":"ContainerDied","Data":"c93aace222adf7dd70532b546760f541fc76d5535eec2bfd64499707ac136913"}
Sep 11 12:58:42.531640 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.531369    2573 scope.go:117] "RemoveContainer" containerID="76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8"
Sep 11 12:58:42.540223 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.540206    2573 scope.go:117] "RemoveContainer" containerID="76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8"
Sep 11 12:58:42.540485 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:58:42.540466    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8\": container with ID starting with 76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8 not found: ID does not exist" containerID="76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8"
Sep 11 12:58:42.540533 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.540494    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8"} err="failed to get container status \"76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8\": rpc error: code = NotFound desc = could not find container \"76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8\": container with ID starting with 76d9033ce628a89cdc563ca48afbd4427ef670f9d53c6efab47a393a97e36fa8 not found: ID does not exist"
Sep 11 12:58:42.546838 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.546814    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-blmbt"]
Sep 11 12:58:42.550617 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:42.550598    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-blmbt"]
Sep 11 12:58:44.516958 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:44.516924    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41556986-731b-4ceb-a9eb-6fe57e8cd997" path="/var/lib/kubelet/pods/41556986-731b-4ceb-a9eb-6fe57e8cd997/volumes"
Sep 11 12:58:46.553008 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:46.552971    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf" event={"ID":"e53dd8e0-2ce0-43b8-8da4-4e68d0859173","Type":"ContainerStarted","Data":"cfe77962a34d3ebe8dc71a1dd4947eb9162d8ae08daf4f44f2c6d53178ed85b1"}
Sep 11 12:58:46.553455 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:46.553056    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:46.592047 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:46.591998    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf" podStartSLOduration=1.5985356309999998 podStartE2EDuration="9.591982223s" totalImagesPullingTime="7.993446592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:58:46.587009009 +0000 UTC m=+704.661471784" watchObservedRunningTime="2026-09-11 12:58:46.591982223 +0000 UTC m=+704.666445034"
Sep 11 12:58:57.560886 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:57.560804    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"
Sep 11 12:58:59.313886 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:59.313847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:59.425457 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:59.425412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:59.841554 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:58:59.841513    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:13.903629 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:13.903592    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:14.123431 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.123395    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-cz2n2"]
Sep 11 12:59:14.123736 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.123724    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41556986-731b-4ceb-a9eb-6fe57e8cd997" containerName="authorino"
Sep 11 12:59:14.123787 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.123738    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="41556986-731b-4ceb-a9eb-6fe57e8cd997" containerName="authorino"
Sep 11 12:59:14.123823 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.123801    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="41556986-731b-4ceb-a9eb-6fe57e8cd997" containerName="authorino"
Sep 11 12:59:14.129211 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.129185    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-cz2n2"
Sep 11 12:59:14.131480 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.131099    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gwf2j\""
Sep 11 12:59:14.134540 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.134507    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-cz2n2"]
Sep 11 12:59:14.288515 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.288481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:14.312605 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.312571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv866\" (UniqueName: \"kubernetes.io/projected/709c2734-e0ef-4b56-b0b3-a391876f34f3-kube-api-access-qv866\") pod \"authorino-557f876f69-cz2n2\" (UID: \"709c2734-e0ef-4b56-b0b3-a391876f34f3\") " pod="kuadrant-system/authorino-557f876f69-cz2n2"
Sep 11 12:59:14.375657 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.375625    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-cz2n2"]
Sep 11 12:59:14.375900 ip-10-0-128-225 kubenswrapper[2573]: E0911 12:59:14.375881    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qv866], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-cz2n2" podUID="709c2734-e0ef-4b56-b0b3-a391876f34f3"
Sep 11 12:59:14.413953 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.413919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv866\" (UniqueName: \"kubernetes.io/projected/709c2734-e0ef-4b56-b0b3-a391876f34f3-kube-api-access-qv866\") pod \"authorino-557f876f69-cz2n2\" (UID: \"709c2734-e0ef-4b56-b0b3-a391876f34f3\") " pod="kuadrant-system/authorino-557f876f69-cz2n2"
Sep 11 12:59:14.427728 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.427703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv866\" (UniqueName: \"kubernetes.io/projected/709c2734-e0ef-4b56-b0b3-a391876f34f3-kube-api-access-qv866\") pod \"authorino-557f876f69-cz2n2\" (UID: \"709c2734-e0ef-4b56-b0b3-a391876f34f3\") " pod="kuadrant-system/authorino-557f876f69-cz2n2"
Sep 11 12:59:14.693193 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.693091    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-cz2n2"
Sep 11 12:59:14.699533 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.699510    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-cz2n2"
Sep 11 12:59:14.818359 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.818324    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv866\" (UniqueName: \"kubernetes.io/projected/709c2734-e0ef-4b56-b0b3-a391876f34f3-kube-api-access-qv866\") pod \"709c2734-e0ef-4b56-b0b3-a391876f34f3\" (UID: \"709c2734-e0ef-4b56-b0b3-a391876f34f3\") "
Sep 11 12:59:14.820510 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.820477    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/709c2734-e0ef-4b56-b0b3-a391876f34f3-kube-api-access-qv866" (OuterVolumeSpecName: "kube-api-access-qv866") pod "709c2734-e0ef-4b56-b0b3-a391876f34f3" (UID: "709c2734-e0ef-4b56-b0b3-a391876f34f3"). InnerVolumeSpecName "kube-api-access-qv866". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:59:14.919616 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:14.919586    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv866\" (UniqueName: \"kubernetes.io/projected/709c2734-e0ef-4b56-b0b3-a391876f34f3-kube-api-access-qv866\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 12:59:15.698439 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:15.698407    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-cz2n2"
Sep 11 12:59:15.727931 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:15.727905    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-cz2n2"]
Sep 11 12:59:15.731417 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:15.731394    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-cz2n2"]
Sep 11 12:59:15.827634 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:15.827596    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:15.883022 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:15.882987    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:16.516988 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:16.516956    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="709c2734-e0ef-4b56-b0b3-a391876f34f3" path="/var/lib/kubelet/pods/709c2734-e0ef-4b56-b0b3-a391876f34f3/volumes"
Sep 11 12:59:17.524327 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:17.524287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:17.587657 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:17.587618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:21.606891 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:21.606834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:21.730826 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:21.730793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:21.835773 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:21.835732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:21.947129 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:21.947020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:22.077830 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:22.077796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:25.374960 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:25.374924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:25.471748 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:25.471708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:31.359225 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:31.359155    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:59.068843 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:59.068803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:59.163945 ip-10-0-128-225 kubenswrapper[2573]: I0911 12:59:59.163910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:00.529740 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:00.529688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:00.633679 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:00.633638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:00.775056 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:00.775015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:00.875607 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:00.875570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:01.247313 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:01.247218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:01.343632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:01.343593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:01.563884 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:01.563842    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:00:13.613959 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:13.613919    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:13.717194 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:13.717136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:19.067242 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:19.067210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:19.805364 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:19.805328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:00:38.498719 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.498680    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"]
Sep 11 13:00:38.502586 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.502563    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.505466 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.505445    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 13:00:38.506220 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.506196    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 13:00:38.506399 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.506382    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 13:00:38.506399 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.506393    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gqvhs\""
Sep 11 13:00:38.518227 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.518201    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"]
Sep 11 13:00:38.550884 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.550858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:38.623978 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.623947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.624118 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.623983    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.624118 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.624029    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.624267 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.624112    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wwmk\" (UniqueName: \"kubernetes.io/projected/d3cde241-dca6-49f2-b511-fc82cdcb391d-kube-api-access-6wwmk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.624267 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.624144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.624267 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.624248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cde241-dca6-49f2-b511-fc82cdcb391d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725152 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wwmk\" (UniqueName: \"kubernetes.io/projected/d3cde241-dca6-49f2-b511-fc82cdcb391d-kube-api-access-6wwmk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cde241-dca6-49f2-b511-fc82cdcb391d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725694 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725672    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725756 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725721    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.725756 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.725747    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.727693 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.727675    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3cde241-dca6-49f2-b511-fc82cdcb391d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.728143 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.728124    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cde241-dca6-49f2-b511-fc82cdcb391d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.736123 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.736103    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wwmk\" (UniqueName: \"kubernetes.io/projected/d3cde241-dca6-49f2-b511-fc82cdcb391d-kube-api-access-6wwmk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fpqlt\" (UID: \"d3cde241-dca6-49f2-b511-fc82cdcb391d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:38.814996 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:38.814969    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:39.094506 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:39.094482    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"]
Sep 11 13:00:39.097273 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:00:39.097234    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cde241_dca6_49f2_b511_fc82cdcb391d.slice/crio-16003e6af4f6afd24e661148c0d7b4cf6892f53fea58f7d60c35140242a0a498 WatchSource:0}: Error finding container 16003e6af4f6afd24e661148c0d7b4cf6892f53fea58f7d60c35140242a0a498: Status 404 returned error can't find the container with id 16003e6af4f6afd24e661148c0d7b4cf6892f53fea58f7d60c35140242a0a498
Sep 11 13:00:39.128978 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:39.128949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt" event={"ID":"d3cde241-dca6-49f2-b511-fc82cdcb391d","Type":"ContainerStarted","Data":"16003e6af4f6afd24e661148c0d7b4cf6892f53fea58f7d60c35140242a0a498"}
Sep 11 13:00:39.319999 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:39.319966    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:00:41.140614 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:41.140567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt" event={"ID":"d3cde241-dca6-49f2-b511-fc82cdcb391d","Type":"ContainerStarted","Data":"568283904fe9935659ab3572e5968e10b9030c5754d62ecefb0655bd4e7e2181"}
Sep 11 13:00:41.158873 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:41.158817    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt" podStartSLOduration=2.115740455 podStartE2EDuration="3.158797602s" totalImagesPullingTime="1.043057147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:00:41.157955392 +0000 UTC m=+819.232418156" watchObservedRunningTime="2026-09-11 13:00:41.158797602 +0000 UTC m=+819.233260360"
Sep 11 13:00:48.815720 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:48.815671    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:48.816121 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:48.815745    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:48.828535 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:48.828513    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:49.175956 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:49.175867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:49.195984 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:49.195958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fpqlt"
Sep 11 13:00:50.221818 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:50.221784    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:00:56.648340 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:56.648297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:58.205819 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:00:58.205781    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:01:03.284730 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:03.284697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:05.012887 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:05.012855    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:01:10.615845 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.615813    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"]
Sep 11 13:01:10.621665 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.621643    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.623793 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.623773    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 13:01:10.629566 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.629538    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"]
Sep 11 13:01:10.647043 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.647010    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:10.710408 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.710380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.710534 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.710422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e311f23c-ff95-4629-bae6-baaac36af370-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.710534 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.710469    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggtwg\" (UniqueName: \"kubernetes.io/projected/e311f23c-ff95-4629-bae6-baaac36af370-kube-api-access-ggtwg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.710534 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.710505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.710646 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.710537    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.710646 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.710569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811108 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e311f23c-ff95-4629-bae6-baaac36af370-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggtwg\" (UniqueName: \"kubernetes.io/projected/e311f23c-ff95-4629-bae6-baaac36af370-kube-api-access-ggtwg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811629 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811595    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811935 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811640    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.811935 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.811666    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.813379 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.813360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e311f23c-ff95-4629-bae6-baaac36af370-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.813690 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.813672    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e311f23c-ff95-4629-bae6-baaac36af370-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.819409 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.819390    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggtwg\" (UniqueName: \"kubernetes.io/projected/e311f23c-ff95-4629-bae6-baaac36af370-kube-api-access-ggtwg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b5lmn\" (UID: \"e311f23c-ff95-4629-bae6-baaac36af370\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:10.932789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:10.932700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:11.211231 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:11.211204    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"]
Sep 11 13:01:11.213512 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:01:11.213474    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode311f23c_ff95_4629_bae6_baaac36af370.slice/crio-9bf6938cd3a77819bf1a4c218d15eb0eead70583be6446ea0c645a6fa33d9262 WatchSource:0}: Error finding container 9bf6938cd3a77819bf1a4c218d15eb0eead70583be6446ea0c645a6fa33d9262: Status 404 returned error can't find the container with id 9bf6938cd3a77819bf1a4c218d15eb0eead70583be6446ea0c645a6fa33d9262
Sep 11 13:01:11.303217 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:11.303158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn" event={"ID":"e311f23c-ff95-4629-bae6-baaac36af370","Type":"ContainerStarted","Data":"9bf6938cd3a77819bf1a4c218d15eb0eead70583be6446ea0c645a6fa33d9262"}
Sep 11 13:01:12.315446 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:12.315406    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn" event={"ID":"e311f23c-ff95-4629-bae6-baaac36af370","Type":"ContainerStarted","Data":"eb80ec3c2f02136a4f9d1d4f5bab9879b4d947957a3c5934d24a675c0a353e74"}
Sep 11 13:01:12.335129 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:12.335078    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn" podStartSLOduration=2.152125418 podStartE2EDuration="2.33505946s" totalImagesPullingTime="182.934042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:12.33407022 +0000 UTC m=+850.408532986" watchObservedRunningTime="2026-09-11 13:01:12.33505946 +0000 UTC m=+850.409522225"
Sep 11 13:01:12.812381 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:12.812348    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:01:20.933093 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:20.933051    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:20.933585 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:20.933140    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:20.945631 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:20.945607    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:21.373567 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:21.373533    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b5lmn"
Sep 11 13:01:22.534114 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.534084    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"]
Sep 11 13:01:22.537072 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.537049    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.540390 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.540364    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 11 13:01:22.562778 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.562747    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"]
Sep 11 13:01:22.615763 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.615732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.615943 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.615869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.615943 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.615905    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.615943 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.615924    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjzmn\" (UniqueName: \"kubernetes.io/projected/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-kube-api-access-hjzmn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.616066 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.615991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.616120 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.616107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.620728 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.620699    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:01:22.716599 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.716566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.716790 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.716620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.716790 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.716647    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.716790 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.716672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjzmn\" (UniqueName: \"kubernetes.io/projected/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-kube-api-access-hjzmn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.716790 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.716717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.717017 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.716798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.717079 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.717052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.717138 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.717119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.717303 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.717280    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.719365 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.719343    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.719506 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.719485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.725127 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.725107    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjzmn\" (UniqueName: \"kubernetes.io/projected/32f0c672-8fc5-40e8-a1a3-8b144fbffef6-kube-api-access-hjzmn\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m\" (UID: \"32f0c672-8fc5-40e8-a1a3-8b144fbffef6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:22.847142 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:22.847054    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:23.124920 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:23.124897    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"]
Sep 11 13:01:23.126973 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:01:23.126939    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32f0c672_8fc5_40e8_a1a3_8b144fbffef6.slice/crio-40bf1c24e1792de5a3f93f5cf7ff037bd733d6e4aa92fb83d63e473f28deaabe WatchSource:0}: Error finding container 40bf1c24e1792de5a3f93f5cf7ff037bd733d6e4aa92fb83d63e473f28deaabe: Status 404 returned error can't find the container with id 40bf1c24e1792de5a3f93f5cf7ff037bd733d6e4aa92fb83d63e473f28deaabe
Sep 11 13:01:23.374721 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:23.374621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m" event={"ID":"32f0c672-8fc5-40e8-a1a3-8b144fbffef6","Type":"ContainerStarted","Data":"6d84d62e9031c80a1065715ade195c7b01dcf4a0016615a35b067b5038636e25"}
Sep 11 13:01:23.374721 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:23.374676    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m" event={"ID":"32f0c672-8fc5-40e8-a1a3-8b144fbffef6","Type":"ContainerStarted","Data":"40bf1c24e1792de5a3f93f5cf7ff037bd733d6e4aa92fb83d63e473f28deaabe"}
Sep 11 13:01:23.400687 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:23.400471    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m" podStartSLOduration=1.250128875 podStartE2EDuration="1.400451686s" totalImagesPullingTime="150.322811ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:23.397753774 +0000 UTC m=+861.472216538" watchObservedRunningTime="2026-09-11 13:01:23.400451686 +0000 UTC m=+861.474914450"
Sep 11 13:01:24.908041 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:24.908004    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:01:32.847635 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:32.847582    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:32.847635 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:32.847643    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:32.860122 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:32.860090    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:01:33.437671 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:01:33.437645    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m"
Sep 11 13:02:02.553848 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:02.553760    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:02:02.557476 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:02.557448    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:02:02.557921 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:02.557899    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:02:02.561007 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:02.560983    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:02:25.071095 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.071059    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ff6846bfb-4zrg6"]
Sep 11 13:02:25.074428 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.074412    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff6846bfb-4zrg6"
Sep 11 13:02:25.077422 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.077400    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 13:02:25.077572 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.077400    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gwf2j\""
Sep 11 13:02:25.084779 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.084757    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ff6846bfb-4zrg6"]
Sep 11 13:02:25.170768 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.170737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgwf2\" (UniqueName: \"kubernetes.io/projected/7c7e7632-9df1-4688-9e19-5f05e440975f-kube-api-access-bgwf2\") pod \"authorino-ff6846bfb-4zrg6\" (UID: \"7c7e7632-9df1-4688-9e19-5f05e440975f\") " pod="kuadrant-system/authorino-ff6846bfb-4zrg6"
Sep 11 13:02:25.170941 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.170800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c7e7632-9df1-4688-9e19-5f05e440975f-tls-cert\") pod \"authorino-ff6846bfb-4zrg6\" (UID: \"7c7e7632-9df1-4688-9e19-5f05e440975f\") " pod="kuadrant-system/authorino-ff6846bfb-4zrg6"
Sep 11 13:02:25.272102 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.272071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgwf2\" (UniqueName: \"kubernetes.io/projected/7c7e7632-9df1-4688-9e19-5f05e440975f-kube-api-access-bgwf2\") pod \"authorino-ff6846bfb-4zrg6\" (UID: \"7c7e7632-9df1-4688-9e19-5f05e440975f\") " pod="kuadrant-system/authorino-ff6846bfb-4zrg6"
Sep 11 13:02:25.272289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.272161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c7e7632-9df1-4688-9e19-5f05e440975f-tls-cert\") pod \"authorino-ff6846bfb-4zrg6\" (UID: \"7c7e7632-9df1-4688-9e19-5f05e440975f\") " pod="kuadrant-system/authorino-ff6846bfb-4zrg6"
Sep 11 13:02:25.274917 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.274891    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c7e7632-9df1-4688-9e19-5f05e440975f-tls-cert\") pod \"authorino-ff6846bfb-4zrg6\" (UID: \"7c7e7632-9df1-4688-9e19-5f05e440975f\") " pod="kuadrant-system/authorino-ff6846bfb-4zrg6"
Sep 11 13:02:25.279487 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.279465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgwf2\" (UniqueName: \"kubernetes.io/projected/7c7e7632-9df1-4688-9e19-5f05e440975f-kube-api-access-bgwf2\") pod \"authorino-ff6846bfb-4zrg6\" (UID: \"7c7e7632-9df1-4688-9e19-5f05e440975f\") " pod="kuadrant-system/authorino-ff6846bfb-4zrg6"
Sep 11 13:02:25.385749 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.385671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff6846bfb-4zrg6"
Sep 11 13:02:25.659326 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.659299    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ff6846bfb-4zrg6"]
Sep 11 13:02:25.661119 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:02:25.661091    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c7e7632_9df1_4688_9e19_5f05e440975f.slice/crio-5804462a7a095fb2b6ec72df39327370b14a23828e9d860a41f6eeae61bbd492 WatchSource:0}: Error finding container 5804462a7a095fb2b6ec72df39327370b14a23828e9d860a41f6eeae61bbd492: Status 404 returned error can't find the container with id 5804462a7a095fb2b6ec72df39327370b14a23828e9d860a41f6eeae61bbd492
Sep 11 13:02:25.662493 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.662474    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:02:25.699839 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:25.699804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff6846bfb-4zrg6" event={"ID":"7c7e7632-9df1-4688-9e19-5f05e440975f","Type":"ContainerStarted","Data":"5804462a7a095fb2b6ec72df39327370b14a23828e9d860a41f6eeae61bbd492"}
Sep 11 13:02:27.712286 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:27.712203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff6846bfb-4zrg6" event={"ID":"7c7e7632-9df1-4688-9e19-5f05e440975f","Type":"ContainerStarted","Data":"5423ebf2b15dc2e1cf45d03c1029ed2ef2e071a4fc6e4a3f8dd9aaa6266e3b47"}
Sep 11 13:02:27.747479 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:27.747424    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-ff6846bfb-4zrg6" podStartSLOduration=0.99050541 podStartE2EDuration="2.747406327s" totalImagesPullingTime="1.756900917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:27.745029036 +0000 UTC m=+925.819491801" watchObservedRunningTime="2026-09-11 13:02:27.747406327 +0000 UTC m=+925.821869091"
Sep 11 13:02:28.353331 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:28.353292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:29.666416 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:29.666372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:44.970097 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:44.970061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:45.075813 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:45.075780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:45.323534 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:45.323494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:45.497001 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:45.496961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:46.471251 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:46.471219    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:46.575267 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:46.575210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:46.965907 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:46.965864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:48.921953 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:48.921918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:49.025498 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:49.025463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:49.137153 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:49.137119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:02:50.090727 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:50.090684    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:50.176923 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:50.176889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:50.275992 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:50.275962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:50.730774 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:50.730731    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:50.832937 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:50.832900    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:52.952203 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:52.952155    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:53.052137 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:53.052082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:53.171754 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:53.171722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:53.481289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:53.481249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:53.590457 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:53.590420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:55.045165 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:55.045121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:55.353478 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:55.353392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:55.690951 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:55.690861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:56.350851 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:56.350802    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:56.460277 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:56.460242    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:57.564848 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:57.564805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:57.664669 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:57.664632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:58.040982 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:58.040935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:58.141660 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:58.141621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:58.238098 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:58.238061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:58.980059 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:58.980022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:59.128966 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:02:59.128929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:00.215948 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.215911    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"]
Sep 11 13:03:00.220065 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.220039    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.223155 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.223125    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-5f1b61-serving-cert\""
Sep 11 13:03:00.223648 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.223627    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:03:00.223816 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.223795    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2t5gt\""
Sep 11 13:03:00.223965 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.223847    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:03:00.224036 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.223663    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:03:00.237715 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.237690    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"]
Sep 11 13:03:00.268520 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.268482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:00.281463 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.281436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.281636 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.281509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4829b\" (UniqueName: \"kubernetes.io/projected/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-kube-api-access-4829b\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.281636 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.281536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-metrics-certs\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.281636 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.281574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-openshift-service-ca\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.349604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.349573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:00.382862 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.382828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.383001 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.382892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4829b\" (UniqueName: \"kubernetes.io/projected/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-kube-api-access-4829b\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.383001 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.382927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-metrics-certs\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.383001 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.382969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-openshift-service-ca\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.383001 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:03:00.382975    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-serving-cert: secret "maas-api-e2e-autores-5f1b61-serving-cert" not found
Sep 11 13:03:00.383250 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:03:00.383037    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls podName:76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c nodeName:}" failed. No retries permitted until 2026-09-11 13:03:00.883020269 +0000 UTC m=+958.957483010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls") pod "maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq" (UID: "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c") : secret "maas-api-e2e-autores-5f1b61-serving-cert" not found
Sep 11 13:03:00.383748 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.383727    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-openshift-service-ca\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.385597 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.385577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-metrics-certs\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.391534 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.391513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4829b\" (UniqueName: \"kubernetes.io/projected/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-kube-api-access-4829b\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.640363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.640332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:00.831804 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.831764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:00.886559 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.886515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.889093 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.889068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls\") pod \"maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:00.995454 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:00.995355    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:01.012292 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.012263    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"]
Sep 11 13:03:01.015798 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.015781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:01.018769 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.018748    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-5f1b61\""
Sep 11 13:03:01.032781 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.032758    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"]
Sep 11 13:03:01.088544 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.088506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb746\" (UniqueName: \"kubernetes.io/projected/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-kube-api-access-qb746\") pod \"payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn\" (UID: \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\") " pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:01.088701 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.088582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-plugins-config-volume\") pod \"payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn\" (UID: \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\") " pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:01.131540 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.131508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:01.189942 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.189906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb746\" (UniqueName: \"kubernetes.io/projected/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-kube-api-access-qb746\") pod \"payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn\" (UID: \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\") " pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:01.190059 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.190020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-plugins-config-volume\") pod \"payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn\" (UID: \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\") " pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:01.191007 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.190955    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-plugins-config-volume\") pod \"payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn\" (UID: \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\") " pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:01.202939 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.202917    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb746\" (UniqueName: \"kubernetes.io/projected/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-kube-api-access-qb746\") pod \"payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn\" (UID: \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\") " pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:01.326244 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.326210    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:01.412761 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.412735    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"]
Sep 11 13:03:01.414416 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:03:01.414384    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c5e20c_7a9c_4d9d_9eed_e7874cd45c2c.slice/crio-75c150d3943083c7eca2899a40a05fc53a5191489de079bfa573cd59570e8f17 WatchSource:0}: Error finding container 75c150d3943083c7eca2899a40a05fc53a5191489de079bfa573cd59570e8f17: Status 404 returned error can't find the container with id 75c150d3943083c7eca2899a40a05fc53a5191489de079bfa573cd59570e8f17
Sep 11 13:03:01.602375 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.602339    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"]
Sep 11 13:03:01.604598 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:03:01.604572    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1a4424_fb6a_467d_b4f6_67e1732a5f31.slice/crio-2d8d13c79019ea4ac01a688a0a09f20fcd6c617aa6e2c7d1ba1fc338551e254b WatchSource:0}: Error finding container 2d8d13c79019ea4ac01a688a0a09f20fcd6c617aa6e2c7d1ba1fc338551e254b: Status 404 returned error can't find the container with id 2d8d13c79019ea4ac01a688a0a09f20fcd6c617aa6e2c7d1ba1fc338551e254b
Sep 11 13:03:01.903396 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.903296    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn" event={"ID":"bd1a4424-fb6a-467d-b4f6-67e1732a5f31","Type":"ContainerStarted","Data":"2d8d13c79019ea4ac01a688a0a09f20fcd6c617aa6e2c7d1ba1fc338551e254b"}
Sep 11 13:03:01.904788 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:01.904760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq" event={"ID":"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c","Type":"ContainerStarted","Data":"75c150d3943083c7eca2899a40a05fc53a5191489de079bfa573cd59570e8f17"}
Sep 11 13:03:04.097185 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.097100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:04.244851 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.244816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:04.346289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.346255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:04.444355 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.444253    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:04.909234 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.909188    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:03:04.926261 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.926224    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn" event={"ID":"bd1a4424-fb6a-467d-b4f6-67e1732a5f31","Type":"ContainerStarted","Data":"8f907aa942da0d7119ce83242a9ffdfd7656935a554092efc31cceb8de663c87"}
Sep 11 13:03:04.926454 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.926331    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:04.927868 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.927835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq" event={"ID":"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c","Type":"ContainerStarted","Data":"31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff"}
Sep 11 13:03:04.928015 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.927958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:04.943058 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.943010    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn" podStartSLOduration=2.422066967 podStartE2EDuration="4.942994994s" totalImagesPullingTime="2.520928027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:04.941911782 +0000 UTC m=+963.016374549" watchObservedRunningTime="2026-09-11 13:03:04.942994994 +0000 UTC m=+963.017457758"
Sep 11 13:03:04.959025 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:04.958977    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq" podStartSLOduration=2.25050689 podStartE2EDuration="4.958957057s" totalImagesPullingTime="2.708450167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:04.95788903 +0000 UTC m=+963.032351795" watchObservedRunningTime="2026-09-11 13:03:04.958957057 +0000 UTC m=+963.033419823"
Sep 11 13:03:07.108358 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:07.108316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:09.142482 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:09.142445    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:10.422798 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:10.422747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:10.514129 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:10.514091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:10.640098 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:10.640060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:10.939150 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:10.939122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:03:11.513194 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:11.513140    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:12.913044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:12.913010    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:13.014129 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:13.014080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:13.848490 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:13.848455    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:14.269381 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:14.269298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:14.585704 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:14.585673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:14.784713 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:14.784672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:15.936108 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:15.936076    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:03:17.378319 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:17.378286    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:17.445062 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:17.445031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:17.543908 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:17.543877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:17.629164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:17.629082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:17.781887 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:17.781853    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:18.111572 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:18.111536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:18.346246 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:18.346207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:18.650188 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:18.650146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:19.589211 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:19.589149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:19.685962 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:19.685930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:19.719597 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:19.719539    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:03:19.809096 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:19.809061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:20.238562 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:20.238516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:20.319061 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:20.319030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:20.853150 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:20.853108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:21.721204 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:21.721151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:22.521159 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:22.521125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:23.349515 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:23.349479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:23.940719 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:23.940686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:24.331015 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:24.330984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:24.433913 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:24.433879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:35.483885 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.483853    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"]
Sep 11 13:03:35.486314 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.486299    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.488785 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.488763    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-b18cb0e6-kserve-self-signed-certs\""
Sep 11 13:03:35.498802 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.498779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"]
Sep 11 13:03:35.503343 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.503323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knsq2\" (UniqueName: \"kubernetes.io/projected/54560aa4-b8e7-495e-9658-7550028fcade-kube-api-access-knsq2\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.503435 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.503357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-tmp-dir\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.503435 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.503394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-dshm\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.503507 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.503436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-home\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.503507 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.503454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-model-cache\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.503576 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.503552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54560aa4-b8e7-495e-9658-7550028fcade-tls-certs\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.598154 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.598119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:35.604292 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-home\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.604410 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604306    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-model-cache\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.604410 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54560aa4-b8e7-495e-9658-7550028fcade-tls-certs\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.604508 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knsq2\" (UniqueName: \"kubernetes.io/projected/54560aa4-b8e7-495e-9658-7550028fcade-kube-api-access-knsq2\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.604559 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-tmp-dir\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.604622 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-dshm\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.604676 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604624    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-home\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.604728 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-model-cache\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.604929 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.604909    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-tmp-dir\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.606782 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.606764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-dshm\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.606897 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.606880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54560aa4-b8e7-495e-9658-7550028fcade-tls-certs\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.612440 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.612420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knsq2\" (UniqueName: \"kubernetes.io/projected/54560aa4-b8e7-495e-9658-7550028fcade-kube-api-access-knsq2\") pod \"e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") " pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:35.703450 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.703421    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:03:35.795230 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:35.795199    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:36.067234 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:36.067211    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"]
Sep 11 13:03:36.069630 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:03:36.069602    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54560aa4_b8e7_495e_9658_7550028fcade.slice/crio-8eed3f873950cc2e17c1e2ef3a37e4a851ee80d0cb7aebde6ac7244079901da8 WatchSource:0}: Error finding container 8eed3f873950cc2e17c1e2ef3a37e4a851ee80d0cb7aebde6ac7244079901da8: Status 404 returned error can't find the container with id 8eed3f873950cc2e17c1e2ef3a37e4a851ee80d0cb7aebde6ac7244079901da8
Sep 11 13:03:36.101786 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:36.101760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm" event={"ID":"54560aa4-b8e7-495e-9658-7550028fcade","Type":"ContainerStarted","Data":"8eed3f873950cc2e17c1e2ef3a37e4a851ee80d0cb7aebde6ac7244079901da8"}
Sep 11 13:03:37.108785 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:37.108744    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm" event={"ID":"54560aa4-b8e7-495e-9658-7550028fcade","Type":"ContainerStarted","Data":"25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563"}
Sep 11 13:03:37.126806 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:37.126758    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm" podStartSLOduration=2.126743347 podStartE2EDuration="2.126743347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:37.12532592 +0000 UTC m=+995.199788697" watchObservedRunningTime="2026-09-11 13:03:37.126743347 +0000 UTC m=+995.201206110"
Sep 11 13:03:37.823222 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:37.823163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:38.483963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:38.483922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:38.558134 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:38.558095    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:38.658670 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:38.658632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:38.723445 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:38.723408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:38.887832 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:38.887788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:39.394639 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:39.394582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:39.481113 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:39.481078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:39.586432 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:39.586382    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:39.908046 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:39.908017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:40.164731 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:40.164632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:40.818272 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:40.818228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:42.902499 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:42.902459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:43.008201 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.008144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:43.030629 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.030595    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"]
Sep 11 13:03:43.033447 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.033426    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.035706 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.035681    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-6a731442-serving-cert\""
Sep 11 13:03:43.046514 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.046451    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"]
Sep 11 13:03:43.075860 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.075830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-metrics-certs\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.076017 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.075878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfbb\" (UniqueName: \"kubernetes.io/projected/e022af07-2792-4331-8e05-888fe746da91-kube-api-access-hwfbb\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.076017 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.075934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-maas-api-tls\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.076017 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.075981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e022af07-2792-4331-8e05-888fe746da91-openshift-service-ca\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.107143 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.107106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:43.177379 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.177276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-metrics-certs\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.177379 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.177365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfbb\" (UniqueName: \"kubernetes.io/projected/e022af07-2792-4331-8e05-888fe746da91-kube-api-access-hwfbb\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.177601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.177429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-maas-api-tls\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.177601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.177481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e022af07-2792-4331-8e05-888fe746da91-openshift-service-ca\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.178308 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.178278    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e022af07-2792-4331-8e05-888fe746da91-openshift-service-ca\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.182701 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.182667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-metrics-certs\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.189813 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.189778    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfbb\" (UniqueName: \"kubernetes.io/projected/e022af07-2792-4331-8e05-888fe746da91-kube-api-access-hwfbb\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.190008 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.189982    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-maas-api-tls\") pod \"maas-api-e2e-migrate-6a731442-6f5f755849-2tq84\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.203109 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.203079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:43.349749 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.349709    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:43.624622 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.624592    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"]
Sep 11 13:03:43.625905 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:03:43.625874    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode022af07_2792_4331_8e05_888fe746da91.slice/crio-f03dcb50b24f38b6cff8e907f90bf8f22dd4984b225e721ef96c5e1f0ad7f038 WatchSource:0}: Error finding container f03dcb50b24f38b6cff8e907f90bf8f22dd4984b225e721ef96c5e1f0ad7f038: Status 404 returned error can't find the container with id f03dcb50b24f38b6cff8e907f90bf8f22dd4984b225e721ef96c5e1f0ad7f038
Sep 11 13:03:43.632247 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.632139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:43.717984 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.717954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:43.825572 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.825536    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"]
Sep 11 13:03:43.828805 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.828788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:43.831360 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.831340    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-6a731442\""
Sep 11 13:03:43.831603 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.831587    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-6a731442-dockercfg-5mpt8\""
Sep 11 13:03:43.845275 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.845254    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"]
Sep 11 13:03:43.883987 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.883911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwx2\" (UniqueName: \"kubernetes.io/projected/e7e31698-21b1-4ab9-93f4-4f5b63be8983-kube-api-access-dmwx2\") pod \"payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb\" (UID: \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:43.883987 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.883976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e31698-21b1-4ab9-93f4-4f5b63be8983-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb\" (UID: \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:43.931765 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.931737    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"]
Sep 11 13:03:43.934200 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.934158    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:43.951159 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.951133    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"]
Sep 11 13:03:43.985326 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.985296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e31698-21b1-4ab9-93f4-4f5b63be8983-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb\" (UID: \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:43.985413 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.985361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04220bd-ec64-427a-bcc4-b95638c34318-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq\" (UID: \"c04220bd-ec64-427a-bcc4-b95638c34318\") " pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:43.985498 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.985478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwx2\" (UniqueName: \"kubernetes.io/projected/e7e31698-21b1-4ab9-93f4-4f5b63be8983-kube-api-access-dmwx2\") pod \"payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb\" (UID: \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:43.985548 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.985508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w62rl\" (UniqueName: \"kubernetes.io/projected/c04220bd-ec64-427a-bcc4-b95638c34318-kube-api-access-w62rl\") pod \"payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq\" (UID: \"c04220bd-ec64-427a-bcc4-b95638c34318\") " pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:43.985928 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.985911    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e31698-21b1-4ab9-93f4-4f5b63be8983-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb\" (UID: \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:43.994440 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:43.994413    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwx2\" (UniqueName: \"kubernetes.io/projected/e7e31698-21b1-4ab9-93f4-4f5b63be8983-kube-api-access-dmwx2\") pod \"payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb\" (UID: \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:44.086627 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.086589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w62rl\" (UniqueName: \"kubernetes.io/projected/c04220bd-ec64-427a-bcc4-b95638c34318-kube-api-access-w62rl\") pod \"payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq\" (UID: \"c04220bd-ec64-427a-bcc4-b95638c34318\") " pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:44.086788 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.086684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04220bd-ec64-427a-bcc4-b95638c34318-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq\" (UID: \"c04220bd-ec64-427a-bcc4-b95638c34318\") " pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:44.087359 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.087340    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04220bd-ec64-427a-bcc4-b95638c34318-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq\" (UID: \"c04220bd-ec64-427a-bcc4-b95638c34318\") " pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:44.094957 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.094933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w62rl\" (UniqueName: \"kubernetes.io/projected/c04220bd-ec64-427a-bcc4-b95638c34318-kube-api-access-w62rl\") pod \"payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq\" (UID: \"c04220bd-ec64-427a-bcc4-b95638c34318\") " pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:44.140377 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.140309    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:44.149558 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.149503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84" event={"ID":"e022af07-2792-4331-8e05-888fe746da91","Type":"ContainerStarted","Data":"39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592"}
Sep 11 13:03:44.149743 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.149730    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84" event={"ID":"e022af07-2792-4331-8e05-888fe746da91","Type":"ContainerStarted","Data":"f03dcb50b24f38b6cff8e907f90bf8f22dd4984b225e721ef96c5e1f0ad7f038"}
Sep 11 13:03:44.149790 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.149767    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:44.168941 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.168886    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84" podStartSLOduration=0.818364217 podStartE2EDuration="1.168864667s" totalImagesPullingTime="350.50045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:44.168754268 +0000 UTC m=+1002.243217033" watchObservedRunningTime="2026-09-11 13:03:44.168864667 +0000 UTC m=+1002.243327434"
Sep 11 13:03:44.244711 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.244680    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:44.417086 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.417061    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"]
Sep 11 13:03:44.419007 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:03:44.418978    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e31698_21b1_4ab9_93f4_4f5b63be8983.slice/crio-1cd837a42ba4a50f87a8f19cc2bf554d0c72f672974c9ffeb16b831fc6712894 WatchSource:0}: Error finding container 1cd837a42ba4a50f87a8f19cc2bf554d0c72f672974c9ffeb16b831fc6712894: Status 404 returned error can't find the container with id 1cd837a42ba4a50f87a8f19cc2bf554d0c72f672974c9ffeb16b831fc6712894
Sep 11 13:03:44.537264 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:44.537236    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"]
Sep 11 13:03:44.538334 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:03:44.538310    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04220bd_ec64_427a_bcc4_b95638c34318.slice/crio-0ed60d11ccd5771fa1ce04b9749ba1053d55a72570a91b7e098098d41a1328f0 WatchSource:0}: Error finding container 0ed60d11ccd5771fa1ce04b9749ba1053d55a72570a91b7e098098d41a1328f0: Status 404 returned error can't find the container with id 0ed60d11ccd5771fa1ce04b9749ba1053d55a72570a91b7e098098d41a1328f0
Sep 11 13:03:45.157117 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.157082    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq" event={"ID":"c04220bd-ec64-427a-bcc4-b95638c34318","Type":"ContainerStarted","Data":"504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde"}
Sep 11 13:03:45.157644 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.157146    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq" event={"ID":"c04220bd-ec64-427a-bcc4-b95638c34318","Type":"ContainerStarted","Data":"0ed60d11ccd5771fa1ce04b9749ba1053d55a72570a91b7e098098d41a1328f0"}
Sep 11 13:03:45.157644 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.157305    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:45.158985 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.158961    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb" event={"ID":"e7e31698-21b1-4ab9-93f4-4f5b63be8983","Type":"ContainerStarted","Data":"ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f"}
Sep 11 13:03:45.159103 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.159004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb" event={"ID":"e7e31698-21b1-4ab9-93f4-4f5b63be8983","Type":"ContainerStarted","Data":"1cd837a42ba4a50f87a8f19cc2bf554d0c72f672974c9ffeb16b831fc6712894"}
Sep 11 13:03:45.159103 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.159047    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:45.180620 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.180572    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq" podStartSLOduration=2.180557596 podStartE2EDuration="2.180557596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:45.178854723 +0000 UTC m=+1003.253317487" watchObservedRunningTime="2026-09-11 13:03:45.180557596 +0000 UTC m=+1003.255020359"
Sep 11 13:03:45.201076 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.200831    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb" podStartSLOduration=2.200814469 podStartE2EDuration="2.200814469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:45.19929687 +0000 UTC m=+1003.273759632" watchObservedRunningTime="2026-09-11 13:03:45.200814469 +0000 UTC m=+1003.275277234"
Sep 11 13:03:45.795594 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.795553    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:45.795818 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.795622    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:45.808462 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:45.808434    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:46.176218 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:46.176113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:03:50.165088 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:50.165057    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:03:51.006580 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:51.006534    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:03:56.166392 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:56.166354    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:03:56.166928 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:56.166703    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:03:58.736234 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:03:58.736200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:05.038445 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:05.038404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:08.909964 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:08.909924    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:04:13.855141 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:13.855101    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"]
Sep 11 13:04:13.855744 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:13.855353    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84" podUID="e022af07-2792-4331-8e05-888fe746da91" containerName="maas-api" containerID="cri-o://39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592" gracePeriod=30
Sep 11 13:04:13.889396 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:13.889358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:13.925826 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:13.925790    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"]
Sep 11 13:04:13.926063 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:13.926032    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq" podUID="c04220bd-ec64-427a-bcc4-b95638c34318" containerName="payload-processing" containerID="cri-o://504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde" gracePeriod=30
Sep 11 13:04:13.935166 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:13.935140    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"]
Sep 11 13:04:13.935535 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:13.935353    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb" podUID="e7e31698-21b1-4ab9-93f4-4f5b63be8983" containerName="payload-pre-processing" containerID="cri-o://ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f" gracePeriod=30
Sep 11 13:04:13.975865 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:13.975839    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:14.063825 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.063751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:14.159031 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.158995    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:14.224867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.224835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:14.225680 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.225660    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:04:14.228873 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.228855    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:04:14.241932 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.241913    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:04:14.329511 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.329477    2573 generic.go:356] "Generic (PLEG): container finished" podID="e022af07-2792-4331-8e05-888fe746da91" containerID="39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592" exitCode=0
Sep 11 13:04:14.329698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.329524    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"
Sep 11 13:04:14.329698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.329558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84" event={"ID":"e022af07-2792-4331-8e05-888fe746da91","Type":"ContainerDied","Data":"39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592"}
Sep 11 13:04:14.329698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.329621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84" event={"ID":"e022af07-2792-4331-8e05-888fe746da91","Type":"ContainerDied","Data":"f03dcb50b24f38b6cff8e907f90bf8f22dd4984b225e721ef96c5e1f0ad7f038"}
Sep 11 13:04:14.329698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.329648    2573 scope.go:117] "RemoveContainer" containerID="39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592"
Sep 11 13:04:14.331068 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.331048    2573 generic.go:356] "Generic (PLEG): container finished" podID="e7e31698-21b1-4ab9-93f4-4f5b63be8983" containerID="ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f" exitCode=0
Sep 11 13:04:14.331197 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.331107    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"
Sep 11 13:04:14.331197 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.331140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb" event={"ID":"e7e31698-21b1-4ab9-93f4-4f5b63be8983","Type":"ContainerDied","Data":"ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f"}
Sep 11 13:04:14.331340 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.331223    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb" event={"ID":"e7e31698-21b1-4ab9-93f4-4f5b63be8983","Type":"ContainerDied","Data":"1cd837a42ba4a50f87a8f19cc2bf554d0c72f672974c9ffeb16b831fc6712894"}
Sep 11 13:04:14.332745 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.332723    2573 generic.go:356] "Generic (PLEG): container finished" podID="c04220bd-ec64-427a-bcc4-b95638c34318" containerID="504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde" exitCode=0
Sep 11 13:04:14.332901 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.332768    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"
Sep 11 13:04:14.332901 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.332782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq" event={"ID":"c04220bd-ec64-427a-bcc4-b95638c34318","Type":"ContainerDied","Data":"504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde"}
Sep 11 13:04:14.332901 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.332815    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq" event={"ID":"c04220bd-ec64-427a-bcc4-b95638c34318","Type":"ContainerDied","Data":"0ed60d11ccd5771fa1ce04b9749ba1053d55a72570a91b7e098098d41a1328f0"}
Sep 11 13:04:14.339828 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.339809    2573 scope.go:117] "RemoveContainer" containerID="39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592"
Sep 11 13:04:14.340128 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:04:14.340107    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592\": container with ID starting with 39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592 not found: ID does not exist" containerID="39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592"
Sep 11 13:04:14.340215 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.340135    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592"} err="failed to get container status \"39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592\": rpc error: code = NotFound desc = could not find container \"39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592\": container with ID starting with 39a570339b175d6c02be934f4bc6774c67905c4274289a7cbda18f14c00a3592 not found: ID does not exist"
Sep 11 13:04:14.340215 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.340152    2573 scope.go:117] "RemoveContainer" containerID="ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f"
Sep 11 13:04:14.341739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.341715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:14.349208 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.349162    2573 scope.go:117] "RemoveContainer" containerID="ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f"
Sep 11 13:04:14.349449 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:04:14.349429    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f\": container with ID starting with ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f not found: ID does not exist" containerID="ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f"
Sep 11 13:04:14.349501 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.349457    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f"} err="failed to get container status \"ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f\": rpc error: code = NotFound desc = could not find container \"ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f\": container with ID starting with ffb9c8832c349e632191221fe621c08c2a54a9ba155a8f17c2f6ec924783ad7f not found: ID does not exist"
Sep 11 13:04:14.349501 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.349473    2573 scope.go:117] "RemoveContainer" containerID="504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde"
Sep 11 13:04:14.357445 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.357429    2573 scope.go:117] "RemoveContainer" containerID="504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde"
Sep 11 13:04:14.357713 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:04:14.357696    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde\": container with ID starting with 504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde not found: ID does not exist" containerID="504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde"
Sep 11 13:04:14.357771 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.357718    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde"} err="failed to get container status \"504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde\": rpc error: code = NotFound desc = could not find container \"504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde\": container with ID starting with 504925c04cb664026b656b98b690e8528ed687ca6beed3ac67e1d115b8c0bcde not found: ID does not exist"
Sep 11 13:04:14.378187 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378146    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e31698-21b1-4ab9-93f4-4f5b63be8983-plugins-config-volume\") pod \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\" (UID: \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\") "
Sep 11 13:04:14.378276 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378197    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-maas-api-tls\") pod \"e022af07-2792-4331-8e05-888fe746da91\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") "
Sep 11 13:04:14.378346 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378291    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04220bd-ec64-427a-bcc4-b95638c34318-plugins-config-volume\") pod \"c04220bd-ec64-427a-bcc4-b95638c34318\" (UID: \"c04220bd-ec64-427a-bcc4-b95638c34318\") "
Sep 11 13:04:14.378402 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378357    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmwx2\" (UniqueName: \"kubernetes.io/projected/e7e31698-21b1-4ab9-93f4-4f5b63be8983-kube-api-access-dmwx2\") pod \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\" (UID: \"e7e31698-21b1-4ab9-93f4-4f5b63be8983\") "
Sep 11 13:04:14.378402 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w62rl\" (UniqueName: \"kubernetes.io/projected/c04220bd-ec64-427a-bcc4-b95638c34318-kube-api-access-w62rl\") pod \"c04220bd-ec64-427a-bcc4-b95638c34318\" (UID: \"c04220bd-ec64-427a-bcc4-b95638c34318\") "
Sep 11 13:04:14.378515 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378427    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwfbb\" (UniqueName: \"kubernetes.io/projected/e022af07-2792-4331-8e05-888fe746da91-kube-api-access-hwfbb\") pod \"e022af07-2792-4331-8e05-888fe746da91\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") "
Sep 11 13:04:14.378515 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378443    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-metrics-certs\") pod \"e022af07-2792-4331-8e05-888fe746da91\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") "
Sep 11 13:04:14.378515 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378468    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e022af07-2792-4331-8e05-888fe746da91-openshift-service-ca\") pod \"e022af07-2792-4331-8e05-888fe746da91\" (UID: \"e022af07-2792-4331-8e05-888fe746da91\") "
Sep 11 13:04:14.378675 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378581    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e31698-21b1-4ab9-93f4-4f5b63be8983-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e7e31698-21b1-4ab9-93f4-4f5b63be8983" (UID: "e7e31698-21b1-4ab9-93f4-4f5b63be8983"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:14.378675 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378661    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c04220bd-ec64-427a-bcc4-b95638c34318-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c04220bd-ec64-427a-bcc4-b95638c34318" (UID: "c04220bd-ec64-427a-bcc4-b95638c34318"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:14.378929 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378902    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e022af07-2792-4331-8e05-888fe746da91-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e022af07-2792-4331-8e05-888fe746da91" (UID: "e022af07-2792-4331-8e05-888fe746da91"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:14.379030 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378973    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e31698-21b1-4ab9-93f4-4f5b63be8983-plugins-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:14.379030 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.378996    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04220bd-ec64-427a-bcc4-b95638c34318-plugins-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:14.380904 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.380878    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c04220bd-ec64-427a-bcc4-b95638c34318-kube-api-access-w62rl" (OuterVolumeSpecName: "kube-api-access-w62rl") pod "c04220bd-ec64-427a-bcc4-b95638c34318" (UID: "c04220bd-ec64-427a-bcc4-b95638c34318"). InnerVolumeSpecName "kube-api-access-w62rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:14.380998 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.380957    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e022af07-2792-4331-8e05-888fe746da91-kube-api-access-hwfbb" (OuterVolumeSpecName: "kube-api-access-hwfbb") pod "e022af07-2792-4331-8e05-888fe746da91" (UID: "e022af07-2792-4331-8e05-888fe746da91"). InnerVolumeSpecName "kube-api-access-hwfbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:14.381044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.381006    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e022af07-2792-4331-8e05-888fe746da91" (UID: "e022af07-2792-4331-8e05-888fe746da91"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:04:14.381044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.381008    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e31698-21b1-4ab9-93f4-4f5b63be8983-kube-api-access-dmwx2" (OuterVolumeSpecName: "kube-api-access-dmwx2") pod "e7e31698-21b1-4ab9-93f4-4f5b63be8983" (UID: "e7e31698-21b1-4ab9-93f4-4f5b63be8983"). InnerVolumeSpecName "kube-api-access-dmwx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:14.381121 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.381097    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e022af07-2792-4331-8e05-888fe746da91" (UID: "e022af07-2792-4331-8e05-888fe746da91"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:04:14.480043 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.479969    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmwx2\" (UniqueName: \"kubernetes.io/projected/e7e31698-21b1-4ab9-93f4-4f5b63be8983-kube-api-access-dmwx2\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:14.480043 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.479993    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w62rl\" (UniqueName: \"kubernetes.io/projected/c04220bd-ec64-427a-bcc4-b95638c34318-kube-api-access-w62rl\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:14.480043 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.480003    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwfbb\" (UniqueName: \"kubernetes.io/projected/e022af07-2792-4331-8e05-888fe746da91-kube-api-access-hwfbb\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:14.480043 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.480011    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-metrics-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:14.480043 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.480020    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e022af07-2792-4331-8e05-888fe746da91-openshift-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:14.480043 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.480028    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e022af07-2792-4331-8e05-888fe746da91-maas-api-tls\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:14.657188 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.657140    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"]
Sep 11 13:04:14.664361 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.664331    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6a731442-5ff467d76b-fkkmb"]
Sep 11 13:04:14.682197 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.682144    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"]
Sep 11 13:04:14.689217 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.689196    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6a731442-6f5f755849-2tq84"]
Sep 11 13:04:14.709192 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.709125    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"]
Sep 11 13:04:14.711996 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.711976    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6a731442-76bdf47786-zbpvq"]
Sep 11 13:04:14.811231 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:14.811196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:15.134573 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:15.134475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:15.203147 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:15.203103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:16.518287 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:16.518255    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c04220bd-ec64-427a-bcc4-b95638c34318" path="/var/lib/kubelet/pods/c04220bd-ec64-427a-bcc4-b95638c34318/volumes"
Sep 11 13:04:16.518699 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:16.518684    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e022af07-2792-4331-8e05-888fe746da91" path="/var/lib/kubelet/pods/e022af07-2792-4331-8e05-888fe746da91/volumes"
Sep 11 13:04:16.519004 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:16.518991    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e31698-21b1-4ab9-93f4-4f5b63be8983" path="/var/lib/kubelet/pods/e7e31698-21b1-4ab9-93f4-4f5b63be8983/volumes"
Sep 11 13:04:17.924885 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:17.924850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:18.025483 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:18.025449    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:19.109263 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109227    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"]
Sep 11 13:04:19.109804 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109783    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04220bd-ec64-427a-bcc4-b95638c34318" containerName="payload-processing"
Sep 11 13:04:19.109895 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109808    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04220bd-ec64-427a-bcc4-b95638c34318" containerName="payload-processing"
Sep 11 13:04:19.109895 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109824    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e022af07-2792-4331-8e05-888fe746da91" containerName="maas-api"
Sep 11 13:04:19.109895 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109833    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e022af07-2792-4331-8e05-888fe746da91" containerName="maas-api"
Sep 11 13:04:19.109895 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109851    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e31698-21b1-4ab9-93f4-4f5b63be8983" containerName="payload-pre-processing"
Sep 11 13:04:19.109895 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109861    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e31698-21b1-4ab9-93f4-4f5b63be8983" containerName="payload-pre-processing"
Sep 11 13:04:19.110145 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109983    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c04220bd-ec64-427a-bcc4-b95638c34318" containerName="payload-processing"
Sep 11 13:04:19.110145 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.109996    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e022af07-2792-4331-8e05-888fe746da91" containerName="maas-api"
Sep 11 13:04:19.110145 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.110006    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e31698-21b1-4ab9-93f4-4f5b63be8983" containerName="payload-pre-processing"
Sep 11 13:04:19.115056 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.115032    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.119692 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.119667    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b19d54a4-serving-cert\""
Sep 11 13:04:19.132685 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.132663    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"]
Sep 11 13:04:19.157523 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.157495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:19.215480 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.215455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-maas-api-tls\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.215634 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.215483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f574412b-fe92-4760-aa01-e87ec1b8836e-openshift-service-ca\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.215634 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.215515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp45h\" (UniqueName: \"kubernetes.io/projected/f574412b-fe92-4760-aa01-e87ec1b8836e-kube-api-access-mp45h\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.215634 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.215623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-metrics-certs\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.260480 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.260443    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:19.316340 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.316309    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp45h\" (UniqueName: \"kubernetes.io/projected/f574412b-fe92-4760-aa01-e87ec1b8836e-kube-api-access-mp45h\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.316488 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.316404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-metrics-certs\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.316488 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.316449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-maas-api-tls\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.316488 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.316464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f574412b-fe92-4760-aa01-e87ec1b8836e-openshift-service-ca\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.317024 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.317003    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f574412b-fe92-4760-aa01-e87ec1b8836e-openshift-service-ca\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.319041 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.319018    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-maas-api-tls\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.319165 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.319059    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-metrics-certs\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.327951 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.327924    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp45h\" (UniqueName: \"kubernetes.io/projected/f574412b-fe92-4760-aa01-e87ec1b8836e-kube-api-access-mp45h\") pod \"maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.358239 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.358193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:19.426741 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.426658    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:19.679581 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.679462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:19.713987 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.713956    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"]
Sep 11 13:04:19.718060 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:04:19.718025    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf574412b_fe92_4760_aa01_e87ec1b8836e.slice/crio-518da7709497ee71b5b9c69514effdb49a12dc1c33f9c37328136c0bd306f144 WatchSource:0}: Error finding container 518da7709497ee71b5b9c69514effdb49a12dc1c33f9c37328136c0bd306f144: Status 404 returned error can't find the container with id 518da7709497ee71b5b9c69514effdb49a12dc1c33f9c37328136c0bd306f144
Sep 11 13:04:19.778187 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.778136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:19.829269 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.829237    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"]
Sep 11 13:04:19.841360 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.841328    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:19.843817 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.843790    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b19d54a4-dockercfg-v6qqq\""
Sep 11 13:04:19.843969 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.843935    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b19d54a4\""
Sep 11 13:04:19.849796 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.849762    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"]
Sep 11 13:04:19.920637 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.920593    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942ef131-893d-4fab-8a79-879f159f3fe7-plugins-config-volume\") pod \"payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j\" (UID: \"942ef131-893d-4fab-8a79-879f159f3fe7\") " pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:19.920833 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:19.920656    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjlc\" (UniqueName: \"kubernetes.io/projected/942ef131-893d-4fab-8a79-879f159f3fe7-kube-api-access-bgjlc\") pod \"payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j\" (UID: \"942ef131-893d-4fab-8a79-879f159f3fe7\") " pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:20.021662 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.021580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942ef131-893d-4fab-8a79-879f159f3fe7-plugins-config-volume\") pod \"payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j\" (UID: \"942ef131-893d-4fab-8a79-879f159f3fe7\") " pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:20.021662 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.021637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjlc\" (UniqueName: \"kubernetes.io/projected/942ef131-893d-4fab-8a79-879f159f3fe7-kube-api-access-bgjlc\") pod \"payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j\" (UID: \"942ef131-893d-4fab-8a79-879f159f3fe7\") " pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:20.022377 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.022359    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942ef131-893d-4fab-8a79-879f159f3fe7-plugins-config-volume\") pod \"payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j\" (UID: \"942ef131-893d-4fab-8a79-879f159f3fe7\") " pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:20.042220 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.042190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjlc\" (UniqueName: \"kubernetes.io/projected/942ef131-893d-4fab-8a79-879f159f3fe7-kube-api-access-bgjlc\") pod \"payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j\" (UID: \"942ef131-893d-4fab-8a79-879f159f3fe7\") " pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:20.153430 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.153399    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:20.369080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.369040    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk" event={"ID":"f574412b-fe92-4760-aa01-e87ec1b8836e","Type":"ContainerStarted","Data":"dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14"}
Sep 11 13:04:20.369448 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.369104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk" event={"ID":"f574412b-fe92-4760-aa01-e87ec1b8836e","Type":"ContainerStarted","Data":"518da7709497ee71b5b9c69514effdb49a12dc1c33f9c37328136c0bd306f144"}
Sep 11 13:04:20.369448 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.369130    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:20.389586 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.389543    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk" podStartSLOduration=0.883137295 podStartE2EDuration="1.38952747s" totalImagesPullingTime="506.390175ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:20.387049376 +0000 UTC m=+1038.461512140" watchObservedRunningTime="2026-09-11 13:04:20.38952747 +0000 UTC m=+1038.463990233"
Sep 11 13:04:20.428212 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.428187    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"]
Sep 11 13:04:20.430514 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:04:20.430492    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942ef131_893d_4fab_8a79_879f159f3fe7.slice/crio-05f3f3f7d004f7ff12760ecb6b6b2e16cbc35ba0caa7defc9f0303c58472a1ec WatchSource:0}: Error finding container 05f3f3f7d004f7ff12760ecb6b6b2e16cbc35ba0caa7defc9f0303c58472a1ec: Status 404 returned error can't find the container with id 05f3f3f7d004f7ff12760ecb6b6b2e16cbc35ba0caa7defc9f0303c58472a1ec
Sep 11 13:04:20.806259 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.806213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:20.905994 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:20.905957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:21.376660 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:21.376624    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j" event={"ID":"942ef131-893d-4fab-8a79-879f159f3fe7","Type":"ContainerStarted","Data":"5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8"}
Sep 11 13:04:21.376660 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:21.376676    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j" event={"ID":"942ef131-893d-4fab-8a79-879f159f3fe7","Type":"ContainerStarted","Data":"05f3f3f7d004f7ff12760ecb6b6b2e16cbc35ba0caa7defc9f0303c58472a1ec"}
Sep 11 13:04:21.399400 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:21.399349    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j" podStartSLOduration=2.399333349 podStartE2EDuration="2.399333349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:21.396936312 +0000 UTC m=+1039.471399076" watchObservedRunningTime="2026-09-11 13:04:21.399333349 +0000 UTC m=+1039.473796113"
Sep 11 13:04:22.382563 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:22.382519    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:26.382488 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:26.382457    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:29.800970 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.800928    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"]
Sep 11 13:04:29.804436 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.804419    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.807815 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.807781    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0e2299\"/\"kube-root-ca.crt\""
Sep 11 13:04:29.807815 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.807808    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0e2299\"/\"default-dockercfg-r8tjg\""
Sep 11 13:04:29.807815 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.807816    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0e2299\"/\"openshift-service-ca.crt\""
Sep 11 13:04:29.808036 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.807861    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0e2299\"/\"test-model-0e2299-kserve-self-signed-certs\""
Sep 11 13:04:29.814251 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.814222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"]
Sep 11 13:04:29.896246 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.896212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-home\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.896246 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.896249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-dshm\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.896464 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.896268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-tmp-dir\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.896464 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.896374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-model-cache\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.896464 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.896429    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gqg9\" (UniqueName: \"kubernetes.io/projected/5d1d1c06-894f-486b-921c-5e367079f5f6-kube-api-access-4gqg9\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.896573 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.896478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d1d1c06-894f-486b-921c-5e367079f5f6-tls-certs\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.997996 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.997962    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-home\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.998159 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.998005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-dshm\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.998159 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.998026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-tmp-dir\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.998264 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.998149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-model-cache\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.998307 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.998264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gqg9\" (UniqueName: \"kubernetes.io/projected/5d1d1c06-894f-486b-921c-5e367079f5f6-kube-api-access-4gqg9\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.998307 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.998302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d1d1c06-894f-486b-921c-5e367079f5f6-tls-certs\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.998458 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.998433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-home\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.998568 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.998456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-tmp-dir\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:29.998659 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:29.998639    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-model-cache\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:30.000457 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:30.000433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-dshm\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:30.000785 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:30.000765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d1d1c06-894f-486b-921c-5e367079f5f6-tls-certs\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:30.011096 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:30.011072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gqg9\" (UniqueName: \"kubernetes.io/projected/5d1d1c06-894f-486b-921c-5e367079f5f6-kube-api-access-4gqg9\") pod \"test-model-0e2299-kserve-566cbf76f9-hhqc7\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") " pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:30.012448 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:30.012423    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:30.114977 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:30.114939    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:30.394392 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:30.394215    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"]
Sep 11 13:04:30.396758 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:04:30.396731    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d1d1c06_894f_486b_921c_5e367079f5f6.slice/crio-d35a32529b806528f2489d9ae2722d49aa0b720fff52d35255d9334d3bafbf13 WatchSource:0}: Error finding container d35a32529b806528f2489d9ae2722d49aa0b720fff52d35255d9334d3bafbf13: Status 404 returned error can't find the container with id d35a32529b806528f2489d9ae2722d49aa0b720fff52d35255d9334d3bafbf13
Sep 11 13:04:30.427443 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:30.427411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7" event={"ID":"5d1d1c06-894f-486b-921c-5e367079f5f6","Type":"ContainerStarted","Data":"d35a32529b806528f2489d9ae2722d49aa0b720fff52d35255d9334d3bafbf13"}
Sep 11 13:04:31.434395 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:31.434361    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7" event={"ID":"5d1d1c06-894f-486b-921c-5e367079f5f6","Type":"ContainerStarted","Data":"b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733"}
Sep 11 13:04:31.458368 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:31.458321    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7" podStartSLOduration=2.458306571 podStartE2EDuration="2.458306571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:31.455801903 +0000 UTC m=+1049.530264669" watchObservedRunningTime="2026-09-11 13:04:31.458306571 +0000 UTC m=+1049.532769334"
Sep 11 13:04:32.141689 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:32.141651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:33.390608 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:33.390574    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:35.076932 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:35.076895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:35.427907 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:35.427820    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:04:35.873839 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:35.873800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:37.237525 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:37.237469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:40.115317 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:40.115270    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:40.115317 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:40.115321    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:40.128047 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:40.128021    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:40.504084 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:40.504002    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:04:41.468104 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:41.468068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:42.149549 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.149512    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"]
Sep 11 13:04:42.149807 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.149773    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq" podUID="76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" containerName="maas-api" containerID="cri-o://31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff" gracePeriod=30
Sep 11 13:04:42.191246 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.191198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:42.315970 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.315592    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"]
Sep 11 13:04:42.315970 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.315829    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn" podUID="bd1a4424-fb6a-467d-b4f6-67e1732a5f31" containerName="payload-processing" containerID="cri-o://8f907aa942da0d7119ce83242a9ffdfd7656935a554092efc31cceb8de663c87" gracePeriod=30
Sep 11 13:04:42.365129 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.365092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:42.444374 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.444344    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:04:42.468692 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.468590    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:42.506123 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.506097    2573 generic.go:356] "Generic (PLEG): container finished" podID="bd1a4424-fb6a-467d-b4f6-67e1732a5f31" containerID="8f907aa942da0d7119ce83242a9ffdfd7656935a554092efc31cceb8de663c87" exitCode=0
Sep 11 13:04:42.506325 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.506200    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn" event={"ID":"bd1a4424-fb6a-467d-b4f6-67e1732a5f31","Type":"ContainerDied","Data":"8f907aa942da0d7119ce83242a9ffdfd7656935a554092efc31cceb8de663c87"}
Sep 11 13:04:42.507570 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.507549    2573 generic.go:356] "Generic (PLEG): container finished" podID="76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" containerID="31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff" exitCode=0
Sep 11 13:04:42.507675 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.507605    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"
Sep 11 13:04:42.507675 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.507627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq" event={"ID":"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c","Type":"ContainerDied","Data":"31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff"}
Sep 11 13:04:42.507675 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.507661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq" event={"ID":"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c","Type":"ContainerDied","Data":"75c150d3943083c7eca2899a40a05fc53a5191489de079bfa573cd59570e8f17"}
Sep 11 13:04:42.507799 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.507681    2573 scope.go:117] "RemoveContainer" containerID="31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff"
Sep 11 13:04:42.519301 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.519273    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls\") pod \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") "
Sep 11 13:04:42.519432 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.519318    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-openshift-service-ca\") pod \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") "
Sep 11 13:04:42.519560 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.519535    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4829b\" (UniqueName: \"kubernetes.io/projected/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-kube-api-access-4829b\") pod \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") "
Sep 11 13:04:42.519638 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.519623    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-metrics-certs\") pod \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\" (UID: \"76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c\") "
Sep 11 13:04:42.520207 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.520160    2573 scope.go:117] "RemoveContainer" containerID="31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff"
Sep 11 13:04:42.520752 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.520720    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" (UID: "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:42.520909 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:04:42.520875    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff\": container with ID starting with 31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff not found: ID does not exist" containerID="31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff"
Sep 11 13:04:42.521162 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.520916    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff"} err="failed to get container status \"31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff\": rpc error: code = NotFound desc = could not find container \"31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff\": container with ID starting with 31c2e7c71ec8057aab8584e68b2ca21838048188fd1253274b0fd71a9160f5ff not found: ID does not exist"
Sep 11 13:04:42.522674 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.522651    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" (UID: "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:04:42.522847 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.522829    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" (UID: "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:04:42.523155 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.523141    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-kube-api-access-4829b" (OuterVolumeSpecName: "kube-api-access-4829b") pod "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" (UID: "76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c"). InnerVolumeSpecName "kube-api-access-4829b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:42.565229 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.565201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:42.565541 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.565524    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:04:42.620942 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.620912    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-plugins-config-volume\") pod \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\" (UID: \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\") "
Sep 11 13:04:42.621109 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.620958    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb746\" (UniqueName: \"kubernetes.io/projected/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-kube-api-access-qb746\") pod \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\" (UID: \"bd1a4424-fb6a-467d-b4f6-67e1732a5f31\") "
Sep 11 13:04:42.621212 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.621166    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4829b\" (UniqueName: \"kubernetes.io/projected/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-kube-api-access-4829b\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:42.621212 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.621208    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-metrics-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:42.621336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.621217    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-maas-api-tls\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:42.621336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.621225    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c-openshift-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:42.621336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.621245    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd1a4424-fb6a-467d-b4f6-67e1732a5f31" (UID: "bd1a4424-fb6a-467d-b4f6-67e1732a5f31"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:42.623247 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.623224    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-kube-api-access-qb746" (OuterVolumeSpecName: "kube-api-access-qb746") pod "bd1a4424-fb6a-467d-b4f6-67e1732a5f31" (UID: "bd1a4424-fb6a-467d-b4f6-67e1732a5f31"). InnerVolumeSpecName "kube-api-access-qb746". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:42.666336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.666265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:42.722190 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.722150    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb746\" (UniqueName: \"kubernetes.io/projected/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-kube-api-access-qb746\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:42.722190 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.722188    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1a4424-fb6a-467d-b4f6-67e1732a5f31-plugins-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:42.832651 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.832621    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"]
Sep 11 13:04:42.835098 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.835075    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5f1b61-68f9bdbfc4-pvjxq"]
Sep 11 13:04:42.948482 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:42.948381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:43.514948 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:43.514919    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"
Sep 11 13:04:43.514948 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:43.514933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn" event={"ID":"bd1a4424-fb6a-467d-b4f6-67e1732a5f31","Type":"ContainerDied","Data":"2d8d13c79019ea4ac01a688a0a09f20fcd6c617aa6e2c7d1ba1fc338551e254b"}
Sep 11 13:04:43.515519 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:43.515000    2573 scope.go:117] "RemoveContainer" containerID="8f907aa942da0d7119ce83242a9ffdfd7656935a554092efc31cceb8de663c87"
Sep 11 13:04:43.537341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:43.537307    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"]
Sep 11 13:04:43.548369 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:43.546093    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5f1b61-7c64549df5-2ltnn"]
Sep 11 13:04:44.517930 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:44.517898    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" path="/var/lib/kubelet/pods/76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c/volumes"
Sep 11 13:04:44.518356 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:44.518341    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd1a4424-fb6a-467d-b4f6-67e1732a5f31" path="/var/lib/kubelet/pods/bd1a4424-fb6a-467d-b4f6-67e1732a5f31/volumes"
Sep 11 13:04:48.148970 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:48.148935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:50.058685 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.058656    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"]
Sep 11 13:04:50.059090 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.058884    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk" podUID="f574412b-fe92-4760-aa01-e87ec1b8836e" containerName="maas-api" containerID="cri-o://dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14" gracePeriod=30
Sep 11 13:04:50.099256 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.099221    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:50.125537 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.125508    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"]
Sep 11 13:04:50.125782 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.125752    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j" podUID="942ef131-893d-4fab-8a79-879f159f3fe7" containerName="payload-processing" containerID="cri-o://5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8" gracePeriod=30
Sep 11 13:04:50.198489 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.198454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:50.298879 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.298846    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:50.376754 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.376725    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:50.400965 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.400930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:50.408088 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.408063    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:50.494363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.494329    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp45h\" (UniqueName: \"kubernetes.io/projected/f574412b-fe92-4760-aa01-e87ec1b8836e-kube-api-access-mp45h\") pod \"f574412b-fe92-4760-aa01-e87ec1b8836e\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") "
Sep 11 13:04:50.494363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.494372    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f574412b-fe92-4760-aa01-e87ec1b8836e-openshift-service-ca\") pod \"f574412b-fe92-4760-aa01-e87ec1b8836e\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") "
Sep 11 13:04:50.494599 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.494428    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgjlc\" (UniqueName: \"kubernetes.io/projected/942ef131-893d-4fab-8a79-879f159f3fe7-kube-api-access-bgjlc\") pod \"942ef131-893d-4fab-8a79-879f159f3fe7\" (UID: \"942ef131-893d-4fab-8a79-879f159f3fe7\") "
Sep 11 13:04:50.494599 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.494504    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942ef131-893d-4fab-8a79-879f159f3fe7-plugins-config-volume\") pod \"942ef131-893d-4fab-8a79-879f159f3fe7\" (UID: \"942ef131-893d-4fab-8a79-879f159f3fe7\") "
Sep 11 13:04:50.494599 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.494554    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-metrics-certs\") pod \"f574412b-fe92-4760-aa01-e87ec1b8836e\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") "
Sep 11 13:04:50.494780 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.494740    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-maas-api-tls\") pod \"f574412b-fe92-4760-aa01-e87ec1b8836e\" (UID: \"f574412b-fe92-4760-aa01-e87ec1b8836e\") "
Sep 11 13:04:50.494981 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.494954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/942ef131-893d-4fab-8a79-879f159f3fe7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "942ef131-893d-4fab-8a79-879f159f3fe7" (UID: "942ef131-893d-4fab-8a79-879f159f3fe7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:50.495377 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.495192    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f574412b-fe92-4760-aa01-e87ec1b8836e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f574412b-fe92-4760-aa01-e87ec1b8836e" (UID: "f574412b-fe92-4760-aa01-e87ec1b8836e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:50.495377 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.495299    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942ef131-893d-4fab-8a79-879f159f3fe7-plugins-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.496902 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.496863    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f574412b-fe92-4760-aa01-e87ec1b8836e" (UID: "f574412b-fe92-4760-aa01-e87ec1b8836e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:04:50.496996 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.496923    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/942ef131-893d-4fab-8a79-879f159f3fe7-kube-api-access-bgjlc" (OuterVolumeSpecName: "kube-api-access-bgjlc") pod "942ef131-893d-4fab-8a79-879f159f3fe7" (UID: "942ef131-893d-4fab-8a79-879f159f3fe7"). InnerVolumeSpecName "kube-api-access-bgjlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:50.496996 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.496953    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f574412b-fe92-4760-aa01-e87ec1b8836e" (UID: "f574412b-fe92-4760-aa01-e87ec1b8836e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:04:50.496996 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.496992    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f574412b-fe92-4760-aa01-e87ec1b8836e-kube-api-access-mp45h" (OuterVolumeSpecName: "kube-api-access-mp45h") pod "f574412b-fe92-4760-aa01-e87ec1b8836e" (UID: "f574412b-fe92-4760-aa01-e87ec1b8836e"). InnerVolumeSpecName "kube-api-access-mp45h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:50.555906 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.555874    2573 generic.go:356] "Generic (PLEG): container finished" podID="942ef131-893d-4fab-8a79-879f159f3fe7" containerID="5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8" exitCode=0
Sep 11 13:04:50.556040 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.555925    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"
Sep 11 13:04:50.556040 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.555920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j" event={"ID":"942ef131-893d-4fab-8a79-879f159f3fe7","Type":"ContainerDied","Data":"5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8"}
Sep 11 13:04:50.556143 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.556045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j" event={"ID":"942ef131-893d-4fab-8a79-879f159f3fe7","Type":"ContainerDied","Data":"05f3f3f7d004f7ff12760ecb6b6b2e16cbc35ba0caa7defc9f0303c58472a1ec"}
Sep 11 13:04:50.556143 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.556068    2573 scope.go:117] "RemoveContainer" containerID="5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8"
Sep 11 13:04:50.557695 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.557668    2573 generic.go:356] "Generic (PLEG): container finished" podID="f574412b-fe92-4760-aa01-e87ec1b8836e" containerID="dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14" exitCode=0
Sep 11 13:04:50.557801 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.557758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk" event={"ID":"f574412b-fe92-4760-aa01-e87ec1b8836e","Type":"ContainerDied","Data":"dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14"}
Sep 11 13:04:50.557872 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.557802    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk" event={"ID":"f574412b-fe92-4760-aa01-e87ec1b8836e","Type":"ContainerDied","Data":"518da7709497ee71b5b9c69514effdb49a12dc1c33f9c37328136c0bd306f144"}
Sep 11 13:04:50.557922 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.557872    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"
Sep 11 13:04:50.565468 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.565452    2573 scope.go:117] "RemoveContainer" containerID="5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8"
Sep 11 13:04:50.565761 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:04:50.565742    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8\": container with ID starting with 5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8 not found: ID does not exist" containerID="5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8"
Sep 11 13:04:50.565824 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.565770    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8"} err="failed to get container status \"5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8\": rpc error: code = NotFound desc = could not find container \"5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8\": container with ID starting with 5e15f1dc49c3ad41074145d260a74f39bb86c1a7b1ab4a8f0eba2b16738d73b8 not found: ID does not exist"
Sep 11 13:04:50.565824 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.565786    2573 scope.go:117] "RemoveContainer" containerID="dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14"
Sep 11 13:04:50.573228 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.573205    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"]
Sep 11 13:04:50.574304 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.574287    2573 scope.go:117] "RemoveContainer" containerID="dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14"
Sep 11 13:04:50.574599 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:04:50.574572    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14\": container with ID starting with dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14 not found: ID does not exist" containerID="dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14"
Sep 11 13:04:50.574697 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.574614    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14"} err="failed to get container status \"dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14\": rpc error: code = NotFound desc = could not find container \"dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14\": container with ID starting with dfb37cfde28e1c22e8f38cf03cf129ad96475dd26b688b438340c1f072246c14 not found: ID does not exist"
Sep 11 13:04:50.577630 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.577583    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b19d54a4-6c56fdcd8c-gm87j"]
Sep 11 13:04:50.590905 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.590886    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"]
Sep 11 13:04:50.595880 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.595856    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b19d54a4-5579f99fdd-5hctk"]
Sep 11 13:04:50.596339 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.596320    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-maas-api-tls\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.596398 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.596347    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp45h\" (UniqueName: \"kubernetes.io/projected/f574412b-fe92-4760-aa01-e87ec1b8836e-kube-api-access-mp45h\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.596398 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.596361    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f574412b-fe92-4760-aa01-e87ec1b8836e-openshift-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.596398 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.596376    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgjlc\" (UniqueName: \"kubernetes.io/projected/942ef131-893d-4fab-8a79-879f159f3fe7-kube-api-access-bgjlc\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.596398 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:50.596388    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f574412b-fe92-4760-aa01-e87ec1b8836e-metrics-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:04:51.526333 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:51.526234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:51.974791 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:51.974754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:52.442653 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:52.442607    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:52.520160 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:52.520115    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="942ef131-893d-4fab-8a79-879f159f3fe7" path="/var/lib/kubelet/pods/942ef131-893d-4fab-8a79-879f159f3fe7/volumes"
Sep 11 13:04:52.520680 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:52.520652    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f574412b-fe92-4760-aa01-e87ec1b8836e" path="/var/lib/kubelet/pods/f574412b-fe92-4760-aa01-e87ec1b8836e/volumes"
Sep 11 13:04:53.029739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:53.029694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:55.215149 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:55.215070    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:55.345142 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:55.345108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:55.476235 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:55.476121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:55.975861 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:55.975824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:56.242782 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.242706    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"]
Sep 11 13:04:56.243140 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243089    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f574412b-fe92-4760-aa01-e87ec1b8836e" containerName="maas-api"
Sep 11 13:04:56.243140 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243101    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f574412b-fe92-4760-aa01-e87ec1b8836e" containerName="maas-api"
Sep 11 13:04:56.243140 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243110    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="942ef131-893d-4fab-8a79-879f159f3fe7" containerName="payload-processing"
Sep 11 13:04:56.243140 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243116    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="942ef131-893d-4fab-8a79-879f159f3fe7" containerName="payload-processing"
Sep 11 13:04:56.243140 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243131    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1a4424-fb6a-467d-b4f6-67e1732a5f31" containerName="payload-processing"
Sep 11 13:04:56.243140 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243137    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1a4424-fb6a-467d-b4f6-67e1732a5f31" containerName="payload-processing"
Sep 11 13:04:56.243371 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243147    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" containerName="maas-api"
Sep 11 13:04:56.243371 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243153    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" containerName="maas-api"
Sep 11 13:04:56.243371 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243234    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c5e20c-7a9c-4d9d-9eed-e7874cd45c2c" containerName="maas-api"
Sep 11 13:04:56.243371 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243242    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="942ef131-893d-4fab-8a79-879f159f3fe7" containerName="payload-processing"
Sep 11 13:04:56.243371 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243251    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f574412b-fe92-4760-aa01-e87ec1b8836e" containerName="maas-api"
Sep 11 13:04:56.243371 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.243257    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd1a4424-fb6a-467d-b4f6-67e1732a5f31" containerName="payload-processing"
Sep 11 13:04:56.247995 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.247979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.250104 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.250081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-3dec4b-openshift-default-dockercfg-8hvs6\""
Sep 11 13:04:56.250381 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.250361    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:04:56.273378 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.273358    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"]
Sep 11 13:04:56.309793 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.309767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:56.355038 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-podinfo\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.355241 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355046    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-certs\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.355241 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-data\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.355241 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-envoy\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.355241 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964decff-ea0e-41bd-9637-a42246cf7ba8-istiod-ca-cert\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.355241 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-socket\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.355241 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355237    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-credential-socket\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.355476 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjvww\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-kube-api-access-gjvww\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.355476 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.355293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-token\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.456883 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.456842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-podinfo\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.456894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-certs\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.456927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-data\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.456960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-envoy\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.456994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964decff-ea0e-41bd-9637-a42246cf7ba8-istiod-ca-cert\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.457038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-socket\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457353 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.457116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-credential-socket\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457353 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.457162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjvww\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-kube-api-access-gjvww\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457353 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.457222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-token\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457707 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.457678    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-certs\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.457809 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.457702    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-credential-socket\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.458070 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.457983    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-socket\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.458705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.458389    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964decff-ea0e-41bd-9637-a42246cf7ba8-istiod-ca-cert\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.458836 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.458616    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-data\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.460486 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.460461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-podinfo\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.460608 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.460504    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-envoy\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.484917 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.484891    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-token\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.495281 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.495214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjvww\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-kube-api-access-gjvww\") pod \"e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") " pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.525660 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.525617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:56.558510 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.558477    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:04:56.635294 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.635241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:56.715847 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.715815    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:04:56.857267 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.857067    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"]
Sep 11 13:04:56.860326 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:04:56.860300    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964decff_ea0e_41bd_9637_a42246cf7ba8.slice/crio-d4e3c81facd2b820485391d2c779803de9ba96c8522465586a76b8bbef02ee52 WatchSource:0}: Error finding container d4e3c81facd2b820485391d2c779803de9ba96c8522465586a76b8bbef02ee52: Status 404 returned error can't find the container with id d4e3c81facd2b820485391d2c779803de9ba96c8522465586a76b8bbef02ee52
Sep 11 13:04:56.989408 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:56.989372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:57.192335 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.192249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:57.315103 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.315067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:04:57.329283 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.329253    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"]
Sep 11 13:04:57.333944 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.333927    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:57.336279 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.336258    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-25a0b392-dockercfg-6ppw2\""
Sep 11 13:04:57.336411 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.336306    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-25a0b392\""
Sep 11 13:04:57.343118 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.343091    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"]
Sep 11 13:04:57.468714 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.468633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79aba74a-4e9a-4601-b648-ee8873b7917f-plugins-config-volume\") pod \"payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh\" (UID: \"79aba74a-4e9a-4601-b648-ee8873b7917f\") " pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:57.468864 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.468779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kdcm\" (UniqueName: \"kubernetes.io/projected/79aba74a-4e9a-4601-b648-ee8873b7917f-kube-api-access-9kdcm\") pod \"payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh\" (UID: \"79aba74a-4e9a-4601-b648-ee8873b7917f\") " pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:57.570122 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.570087    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kdcm\" (UniqueName: \"kubernetes.io/projected/79aba74a-4e9a-4601-b648-ee8873b7917f-kube-api-access-9kdcm\") pod \"payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh\" (UID: \"79aba74a-4e9a-4601-b648-ee8873b7917f\") " pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:57.570302 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.570144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79aba74a-4e9a-4601-b648-ee8873b7917f-plugins-config-volume\") pod \"payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh\" (UID: \"79aba74a-4e9a-4601-b648-ee8873b7917f\") " pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:57.570843 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.570824    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79aba74a-4e9a-4601-b648-ee8873b7917f-plugins-config-volume\") pod \"payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh\" (UID: \"79aba74a-4e9a-4601-b648-ee8873b7917f\") " pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:57.581376 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.581344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kdcm\" (UniqueName: \"kubernetes.io/projected/79aba74a-4e9a-4601-b648-ee8873b7917f-kube-api-access-9kdcm\") pod \"payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh\" (UID: \"79aba74a-4e9a-4601-b648-ee8873b7917f\") " pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:57.602854 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.602824    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" event={"ID":"964decff-ea0e-41bd-9637-a42246cf7ba8","Type":"ContainerStarted","Data":"d4e3c81facd2b820485391d2c779803de9ba96c8522465586a76b8bbef02ee52"}
Sep 11 13:04:57.645906 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.645877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:57.922140 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:57.922109    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"]
Sep 11 13:04:57.923794 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:04:57.923764    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79aba74a_4e9a_4601_b648_ee8873b7917f.slice/crio-0a6a2d273428724ee3806901874e77fe46153b2acb7544b6b5fb0722502ea5b4 WatchSource:0}: Error finding container 0a6a2d273428724ee3806901874e77fe46153b2acb7544b6b5fb0722502ea5b4: Status 404 returned error can't find the container with id 0a6a2d273428724ee3806901874e77fe46153b2acb7544b6b5fb0722502ea5b4
Sep 11 13:04:58.612707 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:58.612649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh" event={"ID":"79aba74a-4e9a-4601-b648-ee8873b7917f","Type":"ContainerStarted","Data":"399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8"}
Sep 11 13:04:58.612707 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:58.612712    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh" event={"ID":"79aba74a-4e9a-4601-b648-ee8873b7917f","Type":"ContainerStarted","Data":"0a6a2d273428724ee3806901874e77fe46153b2acb7544b6b5fb0722502ea5b4"}
Sep 11 13:04:58.613317 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:58.612770    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:04:58.638164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:58.638096    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh" podStartSLOduration=1.638078722 podStartE2EDuration="1.638078722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:58.636718602 +0000 UTC m=+1076.711181366" watchObservedRunningTime="2026-09-11 13:04:58.638078722 +0000 UTC m=+1076.712541492"
Sep 11 13:04:59.813678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:59.813638    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:04:59.813968 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:59.813714    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:04:59.813968 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:04:59.813746    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:05:00.629231 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:00.629195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" event={"ID":"964decff-ea0e-41bd-9637-a42246cf7ba8","Type":"ContainerStarted","Data":"e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab"}
Sep 11 13:05:01.558835 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:01.558798    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:05:01.564893 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:01.564862    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:05:01.586736 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:01.586688    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" podStartSLOduration=2.6363325890000002 podStartE2EDuration="5.586672222s" totalImagesPullingTime="2.950339633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:05:00.657427534 +0000 UTC m=+1078.731890298" watchObservedRunningTime="2026-09-11 13:05:01.586672222 +0000 UTC m=+1079.661134985"
Sep 11 13:05:01.635315 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:01.635287    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:05:01.636260 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:01.636238    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:05:02.646175 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:02.646138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:02.749807 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:02.749770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:03.795657 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:03.795617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:03.909166 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:03.909123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:04.113545 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:04.113438    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:04.449684 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:04.449571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:04.727211 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:04.727096    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:09.623544 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:09.623512    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:05:10.037739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:10.037705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:11.325473 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:11.325437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:12.045322 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:12.045268    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:05:19.534353 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:19.534311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:21.814308 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:21.814268    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"]
Sep 11 13:05:21.860765 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:21.860724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:23.071351 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:23.071312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:23.762116 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:23.762033    2573 generic.go:356] "Generic (PLEG): container finished" podID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerID="e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab" exitCode=0
Sep 11 13:05:23.762309 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:23.762109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" event={"ID":"964decff-ea0e-41bd-9637-a42246cf7ba8","Type":"ContainerDied","Data":"e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab"}
Sep 11 13:05:23.762578 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:23.762563    2573 scope.go:117] "RemoveContainer" containerID="e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab"
Sep 11 13:05:23.763774 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:23.763745    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:05:23.763850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:23.763822    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:05:23.763888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:23.763856    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:05:24.774147 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:24.774101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" event={"ID":"964decff-ea0e-41bd-9637-a42246cf7ba8","Type":"ContainerStarted","Data":"f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad"}
Sep 11 13:05:25.131381 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.131343    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:25.190457 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.190418    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"]
Sep 11 13:05:25.192977 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.192958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"
Sep 11 13:05:25.195286 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.195265    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:05:25.195576 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.195560    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:05:25.202811 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.202788    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"]
Sep 11 13:05:25.263897 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.263683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e7820c-b132-476a-98c8-c5ebc7b084e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v\" (UID: \"d7e7820c-b132-476a-98c8-c5ebc7b084e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"
Sep 11 13:05:25.364993 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.364940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e7820c-b132-476a-98c8-c5ebc7b084e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v\" (UID: \"d7e7820c-b132-476a-98c8-c5ebc7b084e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"
Sep 11 13:05:25.365937 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.365907    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e7820c-b132-476a-98c8-c5ebc7b084e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v\" (UID: \"d7e7820c-b132-476a-98c8-c5ebc7b084e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"
Sep 11 13:05:25.504915 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.504829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"
Sep 11 13:05:25.565313 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.564317    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:05:25.565313 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.564365    2573 patch_prober.go:28] interesting pod/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:05:25.565313 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.564556    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:05:25.802849 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.802827    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"]
Sep 11 13:05:25.804981 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:05:25.804954    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e7820c_b132_476a_98c8_c5ebc7b084e8.slice/crio-667a99a258c17520fd927d60a5b09fcd83e2fdd860e179f8e27f8a3fd8143efa WatchSource:0}: Error finding container 667a99a258c17520fd927d60a5b09fcd83e2fdd860e179f8e27f8a3fd8143efa: Status 404 returned error can't find the container with id 667a99a258c17520fd927d60a5b09fcd83e2fdd860e179f8e27f8a3fd8143efa
Sep 11 13:05:25.998375 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:25.998335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:26.559637 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:26.559594    2573 patch_prober.go:28] interesting pod/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:05:26.559853 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:26.559675    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:05:26.789613 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:26.789580    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v" event={"ID":"d7e7820c-b132-476a-98c8-c5ebc7b084e8","Type":"ContainerStarted","Data":"667a99a258c17520fd927d60a5b09fcd83e2fdd860e179f8e27f8a3fd8143efa"}
Sep 11 13:05:26.931741 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:26.931645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:27.573203 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:27.569854    2573 patch_prober.go:28] interesting pod/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:05:27.573203 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:27.569916    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:05:27.577286 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:27.575772    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:28.570098 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:28.569624    2573 patch_prober.go:28] interesting pod/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:05:28.570098 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:28.569693    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:05:29.310731 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:29.310693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:05:29.559548 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:29.559086    2573 patch_prober.go:28] interesting pod/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:05:29.559548 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:29.559146    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:05:29.811729 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:29.811643    2573 generic.go:356] "Generic (PLEG): container finished" podID="d7e7820c-b132-476a-98c8-c5ebc7b084e8" containerID="2b684ef6d68dab2b0446ed51eed9d62ebc40a4ab1631ac175ad225e351510805" exitCode=0
Sep 11 13:05:29.812098 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:29.811737    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v" event={"ID":"d7e7820c-b132-476a-98c8-c5ebc7b084e8","Type":"ContainerDied","Data":"2b684ef6d68dab2b0446ed51eed9d62ebc40a4ab1631ac175ad225e351510805"}
Sep 11 13:05:30.563966 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:30.563937    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:05:30.564303 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:30.564280    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:05:30.564901 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:30.564880    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:05:30.951118 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:30.951093    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"
Sep 11 13:05:31.032548 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.032511    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e7820c-b132-476a-98c8-c5ebc7b084e8-maas-api-service-ca\") pod \"d7e7820c-b132-476a-98c8-c5ebc7b084e8\" (UID: \"d7e7820c-b132-476a-98c8-c5ebc7b084e8\") "
Sep 11 13:05:31.032865 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.032842    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e7820c-b132-476a-98c8-c5ebc7b084e8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d7e7820c-b132-476a-98c8-c5ebc7b084e8" (UID: "d7e7820c-b132-476a-98c8-c5ebc7b084e8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:05:31.133503 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.133419    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e7820c-b132-476a-98c8-c5ebc7b084e8-maas-api-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:31.716522 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.716488    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"]
Sep 11 13:05:31.716917 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.716904    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e7820c-b132-476a-98c8-c5ebc7b084e8" containerName="revoke-keys"
Sep 11 13:05:31.716964 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.716919    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e7820c-b132-476a-98c8-c5ebc7b084e8" containerName="revoke-keys"
Sep 11 13:05:31.716999 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.716982    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e7820c-b132-476a-98c8-c5ebc7b084e8" containerName="revoke-keys"
Sep 11 13:05:31.719088 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.719071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.721421 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.721399    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-de3842\"/\"openshift-service-ca.crt\""
Sep 11 13:05:31.721584 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.721577    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-de3842\"/\"default-dockercfg-sfhf7\""
Sep 11 13:05:31.722413 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.722398    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-de3842\"/\"test-model-de3842-kserve-self-signed-certs\""
Sep 11 13:05:31.722480 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.722408    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-de3842\"/\"kube-root-ca.crt\""
Sep 11 13:05:31.731743 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.731717    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"]
Sep 11 13:05:31.748367 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.748333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:31.824777 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.824750    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"
Sep 11 13:05:31.824940 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.824748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v" event={"ID":"d7e7820c-b132-476a-98c8-c5ebc7b084e8","Type":"ContainerDied","Data":"667a99a258c17520fd927d60a5b09fcd83e2fdd860e179f8e27f8a3fd8143efa"}
Sep 11 13:05:31.824940 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.824874    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="667a99a258c17520fd927d60a5b09fcd83e2fdd860e179f8e27f8a3fd8143efa"
Sep 11 13:05:31.839265 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.839244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-model-cache\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.839384 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.839280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-tmp-dir\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.839384 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.839366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpbmk\" (UniqueName: \"kubernetes.io/projected/39215caa-733d-4421-9a45-3f12b2b83743-kube-api-access-wpbmk\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.839458 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.839395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39215caa-733d-4421-9a45-3f12b2b83743-tls-certs\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.839458 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.839433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-home\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.839458 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.839448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-dshm\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.940557 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.940529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpbmk\" (UniqueName: \"kubernetes.io/projected/39215caa-733d-4421-9a45-3f12b2b83743-kube-api-access-wpbmk\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.940705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.940576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39215caa-733d-4421-9a45-3f12b2b83743-tls-certs\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.940705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.940635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-home\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.940705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.940661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-dshm\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.940817 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.940720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-model-cache\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.940817 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.940780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-tmp-dir\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.941074 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.941034    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-home\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.941221 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.941102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-tmp-dir\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.941289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.941247    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-model-cache\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.943145 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.943126    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-dshm\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.943336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.943316    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39215caa-733d-4421-9a45-3f12b2b83743-tls-certs\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:31.949038 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:31.949015    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpbmk\" (UniqueName: \"kubernetes.io/projected/39215caa-733d-4421-9a45-3f12b2b83743-kube-api-access-wpbmk\") pod \"test-model-de3842-kserve-96489cdf-w85wh\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") " pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:32.028434 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:32.028354    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:32.304219 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:32.304189    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"]
Sep 11 13:05:32.305477 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:05:32.305445    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39215caa_733d_4421_9a45_3f12b2b83743.slice/crio-52a10ded4737200484e2b2c660bd965199ae2fd7d13ce180fd59a8167cf105bf WatchSource:0}: Error finding container 52a10ded4737200484e2b2c660bd965199ae2fd7d13ce180fd59a8167cf105bf: Status 404 returned error can't find the container with id 52a10ded4737200484e2b2c660bd965199ae2fd7d13ce180fd59a8167cf105bf
Sep 11 13:05:32.831564 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:32.831530    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh" event={"ID":"39215caa-733d-4421-9a45-3f12b2b83743","Type":"ContainerStarted","Data":"ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf"}
Sep 11 13:05:32.831564 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:32.831572    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh" event={"ID":"39215caa-733d-4421-9a45-3f12b2b83743","Type":"ContainerStarted","Data":"52a10ded4737200484e2b2c660bd965199ae2fd7d13ce180fd59a8167cf105bf"}
Sep 11 13:05:32.859878 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:32.859827    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh" podStartSLOduration=1.8598118769999998 podStartE2EDuration="1.859811877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:05:32.855737995 +0000 UTC m=+1110.930200758" watchObservedRunningTime="2026-09-11 13:05:32.859811877 +0000 UTC m=+1110.934274640"
Sep 11 13:05:36.833887 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:36.833846    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm" podUID="54560aa4-b8e7-495e-9658-7550028fcade" containerName="main" containerID="cri-o://25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563" gracePeriod=45
Sep 11 13:05:36.864477 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:36.864420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:37.093480 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.093413    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:05:37.190426 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190396    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knsq2\" (UniqueName: \"kubernetes.io/projected/54560aa4-b8e7-495e-9658-7550028fcade-kube-api-access-knsq2\") pod \"54560aa4-b8e7-495e-9658-7550028fcade\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") "
Sep 11 13:05:37.190601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190444    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-tmp-dir\") pod \"54560aa4-b8e7-495e-9658-7550028fcade\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") "
Sep 11 13:05:37.190601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190467    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-home\") pod \"54560aa4-b8e7-495e-9658-7550028fcade\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") "
Sep 11 13:05:37.190601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190506    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-model-cache\") pod \"54560aa4-b8e7-495e-9658-7550028fcade\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") "
Sep 11 13:05:37.190601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190530    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-dshm\") pod \"54560aa4-b8e7-495e-9658-7550028fcade\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") "
Sep 11 13:05:37.190601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190568    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54560aa4-b8e7-495e-9658-7550028fcade-tls-certs\") pod \"54560aa4-b8e7-495e-9658-7550028fcade\" (UID: \"54560aa4-b8e7-495e-9658-7550028fcade\") "
Sep 11 13:05:37.190888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190743    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-home" (OuterVolumeSpecName: "home") pod "54560aa4-b8e7-495e-9658-7550028fcade" (UID: "54560aa4-b8e7-495e-9658-7550028fcade"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:37.190888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190727    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "54560aa4-b8e7-495e-9658-7550028fcade" (UID: "54560aa4-b8e7-495e-9658-7550028fcade"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:37.190888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190795    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-model-cache" (OuterVolumeSpecName: "model-cache") pod "54560aa4-b8e7-495e-9658-7550028fcade" (UID: "54560aa4-b8e7-495e-9658-7550028fcade"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:37.191020 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190919    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:37.191020 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190933    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:37.191020 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.190943    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:37.192850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.192817    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-dshm" (OuterVolumeSpecName: "dshm") pod "54560aa4-b8e7-495e-9658-7550028fcade" (UID: "54560aa4-b8e7-495e-9658-7550028fcade"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:37.192943 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.192845    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54560aa4-b8e7-495e-9658-7550028fcade-kube-api-access-knsq2" (OuterVolumeSpecName: "kube-api-access-knsq2") pod "54560aa4-b8e7-495e-9658-7550028fcade" (UID: "54560aa4-b8e7-495e-9658-7550028fcade"). InnerVolumeSpecName "kube-api-access-knsq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:05:37.192943 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.192860    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54560aa4-b8e7-495e-9658-7550028fcade-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "54560aa4-b8e7-495e-9658-7550028fcade" (UID: "54560aa4-b8e7-495e-9658-7550028fcade"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:05:37.292067 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.292033    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knsq2\" (UniqueName: \"kubernetes.io/projected/54560aa4-b8e7-495e-9658-7550028fcade-kube-api-access-knsq2\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:37.292067 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.292061    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54560aa4-b8e7-495e-9658-7550028fcade-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:37.292067 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.292073    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54560aa4-b8e7-495e-9658-7550028fcade-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:37.716831 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.716797    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:37.749358 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.749324    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"]
Sep 11 13:05:37.749629 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.749587    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh" podUID="79aba74a-4e9a-4601-b648-ee8873b7917f" containerName="payload-processing" containerID="cri-o://399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8" gracePeriod=30
Sep 11 13:05:37.820442 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.820397    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:37.863428 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.863370    2573 generic.go:356] "Generic (PLEG): container finished" podID="54560aa4-b8e7-495e-9658-7550028fcade" containerID="25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563" exitCode=0
Sep 11 13:05:37.863857 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.863434    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"
Sep 11 13:05:37.863857 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.863468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm" event={"ID":"54560aa4-b8e7-495e-9658-7550028fcade","Type":"ContainerDied","Data":"25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563"}
Sep 11 13:05:37.863857 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.863518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm" event={"ID":"54560aa4-b8e7-495e-9658-7550028fcade","Type":"ContainerDied","Data":"8eed3f873950cc2e17c1e2ef3a37e4a851ee80d0cb7aebde6ac7244079901da8"}
Sep 11 13:05:37.863857 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.863539    2573 scope.go:117] "RemoveContainer" containerID="25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563"
Sep 11 13:05:37.873598 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.873568    2573 scope.go:117] "RemoveContainer" containerID="25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563"
Sep 11 13:05:37.873867 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:05:37.873847    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563\": container with ID starting with 25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563 not found: ID does not exist" containerID="25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563"
Sep 11 13:05:37.873925 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.873876    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563"} err="failed to get container status \"25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563\": rpc error: code = NotFound desc = could not find container \"25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563\": container with ID starting with 25f0993f9f4646d650205f83b9ee9bab2a090ee1eb76716f8701c8cd4401e563 not found: ID does not exist"
Sep 11 13:05:37.889867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.889838    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"]
Sep 11 13:05:37.893018 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.892996    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-b18cb0e6-kserve-7cdcb9988b-s5vwm"]
Sep 11 13:05:37.923847 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.923504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:37.959456 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.959425    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"]
Sep 11 13:05:37.962675 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.962649    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-25a0b392-lqz6v"]
Sep 11 13:05:37.992570 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:37.992544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:38.009090 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.009068    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:05:38.100427 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.100280    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kdcm\" (UniqueName: \"kubernetes.io/projected/79aba74a-4e9a-4601-b648-ee8873b7917f-kube-api-access-9kdcm\") pod \"79aba74a-4e9a-4601-b648-ee8873b7917f\" (UID: \"79aba74a-4e9a-4601-b648-ee8873b7917f\") "
Sep 11 13:05:38.101111 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.100666    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79aba74a-4e9a-4601-b648-ee8873b7917f-plugins-config-volume\") pod \"79aba74a-4e9a-4601-b648-ee8873b7917f\" (UID: \"79aba74a-4e9a-4601-b648-ee8873b7917f\") "
Sep 11 13:05:38.101469 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.101427    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79aba74a-4e9a-4601-b648-ee8873b7917f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "79aba74a-4e9a-4601-b648-ee8873b7917f" (UID: "79aba74a-4e9a-4601-b648-ee8873b7917f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:05:38.102893 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.102861    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79aba74a-4e9a-4601-b648-ee8873b7917f-kube-api-access-9kdcm" (OuterVolumeSpecName: "kube-api-access-9kdcm") pod "79aba74a-4e9a-4601-b648-ee8873b7917f" (UID: "79aba74a-4e9a-4601-b648-ee8873b7917f"). InnerVolumeSpecName "kube-api-access-9kdcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:05:38.129601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.129577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:38.202688 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.202658    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kdcm\" (UniqueName: \"kubernetes.io/projected/79aba74a-4e9a-4601-b648-ee8873b7917f-kube-api-access-9kdcm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:38.202688 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.202683    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79aba74a-4e9a-4601-b648-ee8873b7917f-plugins-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:05:38.517541 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.517504    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54560aa4-b8e7-495e-9658-7550028fcade" path="/var/lib/kubelet/pods/54560aa4-b8e7-495e-9658-7550028fcade/volumes"
Sep 11 13:05:38.517854 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.517841    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e7820c-b132-476a-98c8-c5ebc7b084e8" path="/var/lib/kubelet/pods/d7e7820c-b132-476a-98c8-c5ebc7b084e8/volumes"
Sep 11 13:05:38.871424 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.871384    2573 generic.go:356] "Generic (PLEG): container finished" podID="79aba74a-4e9a-4601-b648-ee8873b7917f" containerID="399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8" exitCode=0
Sep 11 13:05:38.871424 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.871425    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"
Sep 11 13:05:38.871969 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.871462    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh" event={"ID":"79aba74a-4e9a-4601-b648-ee8873b7917f","Type":"ContainerDied","Data":"399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8"}
Sep 11 13:05:38.871969 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.871508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh" event={"ID":"79aba74a-4e9a-4601-b648-ee8873b7917f","Type":"ContainerDied","Data":"0a6a2d273428724ee3806901874e77fe46153b2acb7544b6b5fb0722502ea5b4"}
Sep 11 13:05:38.871969 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.871533    2573 scope.go:117] "RemoveContainer" containerID="399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8"
Sep 11 13:05:38.881270 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.881252    2573 scope.go:117] "RemoveContainer" containerID="399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8"
Sep 11 13:05:38.881591 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:05:38.881565    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8\": container with ID starting with 399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8 not found: ID does not exist" containerID="399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8"
Sep 11 13:05:38.881645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.881603    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8"} err="failed to get container status \"399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8\": rpc error: code = NotFound desc = could not find container \"399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8\": container with ID starting with 399e5d157e656abec93e337eee23f37e8d3d0f5504c3dee4a207339d3b863ec8 not found: ID does not exist"
Sep 11 13:05:38.892767 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.892745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:38.908873 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.908847    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"]
Sep 11 13:05:38.911909 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.911888    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-25a0b392-d9977f95c-77mzh"]
Sep 11 13:05:38.970341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:38.970318    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:40.517758 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:40.517724    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79aba74a-4e9a-4601-b648-ee8873b7917f" path="/var/lib/kubelet/pods/79aba74a-4e9a-4601-b648-ee8873b7917f/volumes"
Sep 11 13:05:40.539246 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:40.539217    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:42.029029 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:42.028992    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:42.029464 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:42.029310    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:42.041545 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:42.041521    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:42.916963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:42.916933    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:05:46.996974 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:46.996938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:47.164554 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:47.164519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:47.312830 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:47.312791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:47.751644 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:47.751547    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:05:48.729517 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:48.729475    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:05:54.239670 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:05:54.239632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:08.502264 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:08.502227    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:06:13.675360 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:13.675314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:14.324053 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:14.324021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:14.565076 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:14.565042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:19.845095 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:19.845055    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:20.021806 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:20.021758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:20.126605 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:20.126503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:25.035545 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:25.035457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:25.115042 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:25.115008    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:25.190013 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:25.189974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:25.280337 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:25.280299    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:25.367094 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:25.367007    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:25.644776 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:25.644683    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:06:25.656206 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:25.656158    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:31.610334 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:31.610288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:31.710819 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:31.710785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:31.845639 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:31.845598    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"]
Sep 11 13:06:31.845914 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:31.845853    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy" containerID="cri-o://f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad" gracePeriod=30
Sep 11 13:06:31.871636 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:31.871565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:32.312112 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:32.312063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:32.696371 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:32.696279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:32.805700 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:32.805643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:33.723269 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:33.723234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:33.814213 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:33.814163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:33.913904 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:33.913870    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:35.980979 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:35.980945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:37.101438 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.101413    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:06:37.158165 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158085    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-envoy\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158165 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158118    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-credential-socket\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158165 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158136    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-podinfo\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158165 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158156    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964decff-ea0e-41bd-9637-a42246cf7ba8-istiod-ca-cert\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158526 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158236    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-socket\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158526 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-data\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158526 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158289    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-certs\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158526 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158328    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-token\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158526 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158352    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjvww\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-kube-api-access-gjvww\") pod \"964decff-ea0e-41bd-9637-a42246cf7ba8\" (UID: \"964decff-ea0e-41bd-9637-a42246cf7ba8\") "
Sep 11 13:06:37.158526 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158462    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:37.158844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158563    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:37.158844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158583    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-data" (OuterVolumeSpecName: "istio-data") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:37.158844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158671    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/964decff-ea0e-41bd-9637-a42246cf7ba8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:06:37.158844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158765    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-credential-socket\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:37.158844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158772    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:37.158844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158783    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-socket\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:37.158844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.158804    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-data\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:37.160573 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.160547    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:37.160696 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.160635    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:06:37.160696 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.160663    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-kube-api-access-gjvww" (OuterVolumeSpecName: "kube-api-access-gjvww") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "kube-api-access-gjvww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:06:37.160775 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.160732    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-token" (OuterVolumeSpecName: "istio-token") pod "964decff-ea0e-41bd-9637-a42246cf7ba8" (UID: "964decff-ea0e-41bd-9637-a42246cf7ba8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:06:37.201800 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.201768    2573 generic.go:356] "Generic (PLEG): container finished" podID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerID="f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad" exitCode=0
Sep 11 13:06:37.201933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.201817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" event={"ID":"964decff-ea0e-41bd-9637-a42246cf7ba8","Type":"ContainerDied","Data":"f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad"}
Sep 11 13:06:37.201933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.201833    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"
Sep 11 13:06:37.201933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.201892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz" event={"ID":"964decff-ea0e-41bd-9637-a42246cf7ba8","Type":"ContainerDied","Data":"d4e3c81facd2b820485391d2c779803de9ba96c8522465586a76b8bbef02ee52"}
Sep 11 13:06:37.201933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.201915    2573 scope.go:117] "RemoveContainer" containerID="f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad"
Sep 11 13:06:37.211437 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.211417    2573 scope.go:117] "RemoveContainer" containerID="e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab"
Sep 11 13:06:37.219558 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.219542    2573 scope.go:117] "RemoveContainer" containerID="f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad"
Sep 11 13:06:37.219808 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:06:37.219789    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad\": container with ID starting with f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad not found: ID does not exist" containerID="f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad"
Sep 11 13:06:37.219882 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.219820    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad"} err="failed to get container status \"f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad\": rpc error: code = NotFound desc = could not find container \"f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad\": container with ID starting with f4f4f5d26a7d53c29ba531de877291dcb075ad64f124c28a4f25a6f06d3addad not found: ID does not exist"
Sep 11 13:06:37.219882 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.219844    2573 scope.go:117] "RemoveContainer" containerID="e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab"
Sep 11 13:06:37.220130 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:06:37.220109    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab\": container with ID starting with e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab not found: ID does not exist" containerID="e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab"
Sep 11 13:06:37.220194 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.220138    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab"} err="failed to get container status \"e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab\": rpc error: code = NotFound desc = could not find container \"e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab\": container with ID starting with e96220f7e2f94f9035fd12a87c397b13505502e11a3a89bbc15e25db9b465bab not found: ID does not exist"
Sep 11 13:06:37.224085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.224051    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"]
Sep 11 13:06:37.229263 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.229232    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-3dec4b-openshift-default-77b7c8b49b-fs2kz"]
Sep 11 13:06:37.259822 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.259802    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-workload-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:37.259822 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.259821    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-token\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:37.259952 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.259830    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjvww\" (UniqueName: \"kubernetes.io/projected/964decff-ea0e-41bd-9637-a42246cf7ba8-kube-api-access-gjvww\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:37.259952 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.259840    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-envoy\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:37.259952 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.259849    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964decff-ea0e-41bd-9637-a42246cf7ba8-istio-podinfo\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:37.259952 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:37.259857    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964decff-ea0e-41bd-9637-a42246cf7ba8-istiod-ca-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:06:38.518014 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:38.517979    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" path="/var/lib/kubelet/pods/964decff-ea0e-41bd-9637-a42246cf7ba8/volumes"
Sep 11 13:06:40.706032 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:40.706001    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:06:41.889791 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:41.889745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:42.009164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:42.009120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:42.102544 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:42.102512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:52.578252 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:52.578214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:53.345400 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:53.345347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:59.284017 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:59.283973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:59.395057 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:59.395020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:59.490036 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:59.490002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:06:59.585245 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:06:59.585129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:00.289340 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:00.289305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:00.403101 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:00.403066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:01.955689 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:01.955647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:02.519762 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.519728    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"]
Sep 11 13:07:02.520102 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520087    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54560aa4-b8e7-495e-9658-7550028fcade" containerName="main"
Sep 11 13:07:02.520102 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520101    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="54560aa4-b8e7-495e-9658-7550028fcade" containerName="main"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520109    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79aba74a-4e9a-4601-b648-ee8873b7917f" containerName="payload-processing"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520115    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="79aba74a-4e9a-4601-b648-ee8873b7917f" containerName="payload-processing"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520126    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520133    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520148    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520153    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520236    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520246    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="964decff-ea0e-41bd-9637-a42246cf7ba8" containerName="istio-proxy"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520253    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="54560aa4-b8e7-495e-9658-7550028fcade" containerName="main"
Sep 11 13:07:02.520341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.520263    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="79aba74a-4e9a-4601-b648-ee8873b7917f" containerName="payload-processing"
Sep 11 13:07:02.522383 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.522362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.525551 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.525531    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-bfc1b3\"/\"openshift-service-ca.crt\""
Sep 11 13:07:02.526209 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.526193    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-bfc1b3\"/\"kube-root-ca.crt\""
Sep 11 13:07:02.526271 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.526246    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-bfc1b3\"/\"noten-model-bfc1b3-kserve-self-signed-certs\""
Sep 11 13:07:02.526506 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.526490    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-bfc1b3\"/\"default-dockercfg-5cq4k\""
Sep 11 13:07:02.532592 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.532527    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"]
Sep 11 13:07:02.537336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.537306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:02.596380 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.596354    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:07:02.599946 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.599921    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:07:02.600148 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.600130    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:07:02.601277 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.601254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-model-cache\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.601388 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.601331    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-home\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.601388 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.601366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-dshm\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.601546 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.601397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51da0f48-5179-4986-9abb-0ec54891a76b-tls-certs\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.601546 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.601436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-tmp-dir\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.601546 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.601465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjfwd\" (UniqueName: \"kubernetes.io/projected/51da0f48-5179-4986-9abb-0ec54891a76b-kube-api-access-sjfwd\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.603933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.603911    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:07:02.702716 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.702682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-model-cache\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.702860 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.702741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-home\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.702860 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.702763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-dshm\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.702860 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.702790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51da0f48-5179-4986-9abb-0ec54891a76b-tls-certs\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.702860 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.702810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-tmp-dir\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.703079 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.702973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjfwd\" (UniqueName: \"kubernetes.io/projected/51da0f48-5179-4986-9abb-0ec54891a76b-kube-api-access-sjfwd\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.703079 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.703065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-model-cache\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.703235 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.703109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-home\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.703235 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.703154    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-tmp-dir\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.705225 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.705205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-dshm\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.705401 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.705385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51da0f48-5179-4986-9abb-0ec54891a76b-tls-certs\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.711413 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.711389    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjfwd\" (UniqueName: \"kubernetes.io/projected/51da0f48-5179-4986-9abb-0ec54891a76b-kube-api-access-sjfwd\") pod \"noten-model-bfc1b3-kserve-7d7fc87979-mphrb\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") " pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:02.832364 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:02.832339    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:03.106349 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:03.106287    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"]
Sep 11 13:07:03.108676 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:07:03.108646    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51da0f48_5179_4986_9abb_0ec54891a76b.slice/crio-8e9f4911513da06561ec40e3e3b986b7d80abd778483fe4a07d3f6fb1be7ecf5 WatchSource:0}: Error finding container 8e9f4911513da06561ec40e3e3b986b7d80abd778483fe4a07d3f6fb1be7ecf5: Status 404 returned error can't find the container with id 8e9f4911513da06561ec40e3e3b986b7d80abd778483fe4a07d3f6fb1be7ecf5
Sep 11 13:07:03.350043 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:03.350000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb" event={"ID":"51da0f48-5179-4986-9abb-0ec54891a76b","Type":"ContainerStarted","Data":"96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52"}
Sep 11 13:07:03.350263 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:03.350060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb" event={"ID":"51da0f48-5179-4986-9abb-0ec54891a76b","Type":"ContainerStarted","Data":"8e9f4911513da06561ec40e3e3b986b7d80abd778483fe4a07d3f6fb1be7ecf5"}
Sep 11 13:07:03.368795 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:03.368701    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb" podStartSLOduration=1.3686851930000001 podStartE2EDuration="1.368685193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:07:03.367962855 +0000 UTC m=+1201.442425620" watchObservedRunningTime="2026-09-11 13:07:03.368685193 +0000 UTC m=+1201.443147956"
Sep 11 13:07:05.299395 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:05.299361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:05.400879 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:05.400838    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:05.608142 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:05.608055    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:07:07.607916 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:07.607876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:07.674194 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:07.674139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:08.315409 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:08.315373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:10.012516 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:10.012482    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"]
Sep 11 13:07:10.035625 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:10.035594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:10.990123 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:10.990086    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"]
Sep 11 13:07:11.012708 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:11.012670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:11.126273 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:11.126241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:11.352843 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:11.352806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:11.462931 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:11.462892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:12.083938 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:12.083908    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"]
Sep 11 13:07:12.106867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:12.106815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:12.466527 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:12.466429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:12.832445 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:12.832412    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:14.542775 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:14.542739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:14.650358 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:14.650300    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:14.768933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:14.768901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:15.105638 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:15.105602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:15.283320 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:15.283275    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:16.478966 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:16.478930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:18.741184 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:18.741142    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:18.852957 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:18.852923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:19.876090 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:19.876057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:19.973029 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:19.972991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:20.214767 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:20.214680    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:07:20.466991 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:20.466901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:20.567163 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:20.567115    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:20.739085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:20.738991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:22.337067 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:22.337033    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:22.430840 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:22.430797    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:22.525714 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:22.525660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:22.597739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:22.597638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:22.962785 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:22.962680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:25.032336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.032286    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7" podUID="5d1d1c06-894f-486b-921c-5e367079f5f6" containerName="main" containerID="cri-o://b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733" gracePeriod=45
Sep 11 13:07:25.283750 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.283729    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:07:25.424801 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.424764    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-dshm\") pod \"5d1d1c06-894f-486b-921c-5e367079f5f6\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") "
Sep 11 13:07:25.424981 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.424815    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-home\") pod \"5d1d1c06-894f-486b-921c-5e367079f5f6\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") "
Sep 11 13:07:25.424981 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.424856    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gqg9\" (UniqueName: \"kubernetes.io/projected/5d1d1c06-894f-486b-921c-5e367079f5f6-kube-api-access-4gqg9\") pod \"5d1d1c06-894f-486b-921c-5e367079f5f6\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") "
Sep 11 13:07:25.424981 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.424892    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d1d1c06-894f-486b-921c-5e367079f5f6-tls-certs\") pod \"5d1d1c06-894f-486b-921c-5e367079f5f6\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") "
Sep 11 13:07:25.424981 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.424913    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-tmp-dir\") pod \"5d1d1c06-894f-486b-921c-5e367079f5f6\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") "
Sep 11 13:07:25.424981 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.424957    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-model-cache\") pod \"5d1d1c06-894f-486b-921c-5e367079f5f6\" (UID: \"5d1d1c06-894f-486b-921c-5e367079f5f6\") "
Sep 11 13:07:25.425274 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.425102    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-home" (OuterVolumeSpecName: "home") pod "5d1d1c06-894f-486b-921c-5e367079f5f6" (UID: "5d1d1c06-894f-486b-921c-5e367079f5f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:25.425274 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.425217    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d1d1c06-894f-486b-921c-5e367079f5f6" (UID: "5d1d1c06-894f-486b-921c-5e367079f5f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:25.425380 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.425323    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d1d1c06-894f-486b-921c-5e367079f5f6" (UID: "5d1d1c06-894f-486b-921c-5e367079f5f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:25.425380 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.425350    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:25.425380 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.425364    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:25.427313 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.427290    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d1d1c06-894f-486b-921c-5e367079f5f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d1d1c06-894f-486b-921c-5e367079f5f6" (UID: "5d1d1c06-894f-486b-921c-5e367079f5f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:07:25.427530 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.427509    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-dshm" (OuterVolumeSpecName: "dshm") pod "5d1d1c06-894f-486b-921c-5e367079f5f6" (UID: "5d1d1c06-894f-486b-921c-5e367079f5f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:25.427585 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.427529    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1d1c06-894f-486b-921c-5e367079f5f6-kube-api-access-4gqg9" (OuterVolumeSpecName: "kube-api-access-4gqg9") pod "5d1d1c06-894f-486b-921c-5e367079f5f6" (UID: "5d1d1c06-894f-486b-921c-5e367079f5f6"). InnerVolumeSpecName "kube-api-access-4gqg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:25.471054 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.471020    2573 generic.go:356] "Generic (PLEG): container finished" podID="5d1d1c06-894f-486b-921c-5e367079f5f6" containerID="b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733" exitCode=0
Sep 11 13:07:25.471198 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.471063    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"
Sep 11 13:07:25.471198 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.471095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7" event={"ID":"5d1d1c06-894f-486b-921c-5e367079f5f6","Type":"ContainerDied","Data":"b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733"}
Sep 11 13:07:25.471198 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.471135    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7" event={"ID":"5d1d1c06-894f-486b-921c-5e367079f5f6","Type":"ContainerDied","Data":"d35a32529b806528f2489d9ae2722d49aa0b720fff52d35255d9334d3bafbf13"}
Sep 11 13:07:25.471198 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.471152    2573 scope.go:117] "RemoveContainer" containerID="b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733"
Sep 11 13:07:25.480475 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.480456    2573 scope.go:117] "RemoveContainer" containerID="b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733"
Sep 11 13:07:25.480732 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:07:25.480716    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733\": container with ID starting with b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733 not found: ID does not exist" containerID="b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733"
Sep 11 13:07:25.480778 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.480741    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733"} err="failed to get container status \"b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733\": rpc error: code = NotFound desc = could not find container \"b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733\": container with ID starting with b59dcc2349c286249a975f6f7184ab2ee6e0faf2287c3618a3ff461591d8e733 not found: ID does not exist"
Sep 11 13:07:25.493848 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.493821    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"]
Sep 11 13:07:25.496161 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.496143    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0e2299/test-model-0e2299-kserve-566cbf76f9-hhqc7"]
Sep 11 13:07:25.526582 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.526550    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gqg9\" (UniqueName: \"kubernetes.io/projected/5d1d1c06-894f-486b-921c-5e367079f5f6-kube-api-access-4gqg9\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:25.526582 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.526581    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d1d1c06-894f-486b-921c-5e367079f5f6-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:25.526688 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.526591    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:25.526688 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:25.526598    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d1d1c06-894f-486b-921c-5e367079f5f6-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:26.010385 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.010344    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb" podUID="51da0f48-5179-4986-9abb-0ec54891a76b" containerName="main" containerID="cri-o://96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52" gracePeriod=45
Sep 11 13:07:26.295464 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.295433    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:26.436425 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436388    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-tmp-dir\") pod \"51da0f48-5179-4986-9abb-0ec54891a76b\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") "
Sep 11 13:07:26.436621 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436445    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjfwd\" (UniqueName: \"kubernetes.io/projected/51da0f48-5179-4986-9abb-0ec54891a76b-kube-api-access-sjfwd\") pod \"51da0f48-5179-4986-9abb-0ec54891a76b\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") "
Sep 11 13:07:26.436621 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436481    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51da0f48-5179-4986-9abb-0ec54891a76b-tls-certs\") pod \"51da0f48-5179-4986-9abb-0ec54891a76b\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") "
Sep 11 13:07:26.436621 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436515    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-home\") pod \"51da0f48-5179-4986-9abb-0ec54891a76b\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") "
Sep 11 13:07:26.436621 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-model-cache\") pod \"51da0f48-5179-4986-9abb-0ec54891a76b\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") "
Sep 11 13:07:26.436621 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436582    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-dshm\") pod \"51da0f48-5179-4986-9abb-0ec54891a76b\" (UID: \"51da0f48-5179-4986-9abb-0ec54891a76b\") "
Sep 11 13:07:26.436859 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436675    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "51da0f48-5179-4986-9abb-0ec54891a76b" (UID: "51da0f48-5179-4986-9abb-0ec54891a76b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:26.436859 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436741    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-home" (OuterVolumeSpecName: "home") pod "51da0f48-5179-4986-9abb-0ec54891a76b" (UID: "51da0f48-5179-4986-9abb-0ec54891a76b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:26.436859 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436808    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-model-cache" (OuterVolumeSpecName: "model-cache") pod "51da0f48-5179-4986-9abb-0ec54891a76b" (UID: "51da0f48-5179-4986-9abb-0ec54891a76b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:26.437014 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.436988    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:26.437014 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.437010    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:26.437095 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.437024    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:26.438908 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.438889    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-dshm" (OuterVolumeSpecName: "dshm") pod "51da0f48-5179-4986-9abb-0ec54891a76b" (UID: "51da0f48-5179-4986-9abb-0ec54891a76b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:26.439341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.439320    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51da0f48-5179-4986-9abb-0ec54891a76b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "51da0f48-5179-4986-9abb-0ec54891a76b" (UID: "51da0f48-5179-4986-9abb-0ec54891a76b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:07:26.439386 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.439336    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51da0f48-5179-4986-9abb-0ec54891a76b-kube-api-access-sjfwd" (OuterVolumeSpecName: "kube-api-access-sjfwd") pod "51da0f48-5179-4986-9abb-0ec54891a76b" (UID: "51da0f48-5179-4986-9abb-0ec54891a76b"). InnerVolumeSpecName "kube-api-access-sjfwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:26.481966 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.481934    2573 generic.go:356] "Generic (PLEG): container finished" podID="51da0f48-5179-4986-9abb-0ec54891a76b" containerID="96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52" exitCode=0
Sep 11 13:07:26.482132 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.481981    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"
Sep 11 13:07:26.482132 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.482015    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb" event={"ID":"51da0f48-5179-4986-9abb-0ec54891a76b","Type":"ContainerDied","Data":"96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52"}
Sep 11 13:07:26.482132 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.482067    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb" event={"ID":"51da0f48-5179-4986-9abb-0ec54891a76b","Type":"ContainerDied","Data":"8e9f4911513da06561ec40e3e3b986b7d80abd778483fe4a07d3f6fb1be7ecf5"}
Sep 11 13:07:26.482132 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.482090    2573 scope.go:117] "RemoveContainer" containerID="96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52"
Sep 11 13:07:26.494048 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.494025    2573 scope.go:117] "RemoveContainer" containerID="96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52"
Sep 11 13:07:26.494395 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:07:26.494370    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52\": container with ID starting with 96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52 not found: ID does not exist" containerID="96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52"
Sep 11 13:07:26.494489 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.494402    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52"} err="failed to get container status \"96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52\": rpc error: code = NotFound desc = could not find container \"96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52\": container with ID starting with 96a0bd5e6d042c37fa32c77b2906f78b022997a24f81cac36d62df09f28bec52 not found: ID does not exist"
Sep 11 13:07:26.509927 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.509904    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"]
Sep 11 13:07:26.518026 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.517999    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d1d1c06-894f-486b-921c-5e367079f5f6" path="/var/lib/kubelet/pods/5d1d1c06-894f-486b-921c-5e367079f5f6/volumes"
Sep 11 13:07:26.518290 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.518275    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-bfc1b3/noten-model-bfc1b3-kserve-7d7fc87979-mphrb"]
Sep 11 13:07:26.538012 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.537991    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjfwd\" (UniqueName: \"kubernetes.io/projected/51da0f48-5179-4986-9abb-0ec54891a76b-kube-api-access-sjfwd\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:26.538012 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.538011    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51da0f48-5179-4986-9abb-0ec54891a76b-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:26.538108 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.538020    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51da0f48-5179-4986-9abb-0ec54891a76b-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:26.739352 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:26.739296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:27.103645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.103603    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh" podUID="39215caa-733d-4421-9a45-3f12b2b83743" containerName="main" containerID="cri-o://ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf" gracePeriod=45
Sep 11 13:07:27.347647 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.347620    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:07:27.447661 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447572    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpbmk\" (UniqueName: \"kubernetes.io/projected/39215caa-733d-4421-9a45-3f12b2b83743-kube-api-access-wpbmk\") pod \"39215caa-733d-4421-9a45-3f12b2b83743\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") "
Sep 11 13:07:27.447661 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447632    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-home\") pod \"39215caa-733d-4421-9a45-3f12b2b83743\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") "
Sep 11 13:07:27.447893 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447674    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-tmp-dir\") pod \"39215caa-733d-4421-9a45-3f12b2b83743\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") "
Sep 11 13:07:27.447893 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447715    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-model-cache\") pod \"39215caa-733d-4421-9a45-3f12b2b83743\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") "
Sep 11 13:07:27.447893 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39215caa-733d-4421-9a45-3f12b2b83743-tls-certs\") pod \"39215caa-733d-4421-9a45-3f12b2b83743\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") "
Sep 11 13:07:27.447893 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447792    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-dshm\") pod \"39215caa-733d-4421-9a45-3f12b2b83743\" (UID: \"39215caa-733d-4421-9a45-3f12b2b83743\") "
Sep 11 13:07:27.448073 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447892    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-home" (OuterVolumeSpecName: "home") pod "39215caa-733d-4421-9a45-3f12b2b83743" (UID: "39215caa-733d-4421-9a45-3f12b2b83743"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:27.448073 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447957    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "39215caa-733d-4421-9a45-3f12b2b83743" (UID: "39215caa-733d-4421-9a45-3f12b2b83743"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:27.448073 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.447976    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-model-cache" (OuterVolumeSpecName: "model-cache") pod "39215caa-733d-4421-9a45-3f12b2b83743" (UID: "39215caa-733d-4421-9a45-3f12b2b83743"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:27.448210 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.448138    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:27.448210 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.448158    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:27.448210 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.448199    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:27.450110 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.450077    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-dshm" (OuterVolumeSpecName: "dshm") pod "39215caa-733d-4421-9a45-3f12b2b83743" (UID: "39215caa-733d-4421-9a45-3f12b2b83743"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:27.450198 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.450155    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39215caa-733d-4421-9a45-3f12b2b83743-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "39215caa-733d-4421-9a45-3f12b2b83743" (UID: "39215caa-733d-4421-9a45-3f12b2b83743"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:07:27.450236 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.450202    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39215caa-733d-4421-9a45-3f12b2b83743-kube-api-access-wpbmk" (OuterVolumeSpecName: "kube-api-access-wpbmk") pod "39215caa-733d-4421-9a45-3f12b2b83743" (UID: "39215caa-733d-4421-9a45-3f12b2b83743"). InnerVolumeSpecName "kube-api-access-wpbmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:27.489077 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.489042    2573 generic.go:356] "Generic (PLEG): container finished" podID="39215caa-733d-4421-9a45-3f12b2b83743" containerID="ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf" exitCode=0
Sep 11 13:07:27.489191 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.489089    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"
Sep 11 13:07:27.489191 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.489126    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh" event={"ID":"39215caa-733d-4421-9a45-3f12b2b83743","Type":"ContainerDied","Data":"ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf"}
Sep 11 13:07:27.489285 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.489198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh" event={"ID":"39215caa-733d-4421-9a45-3f12b2b83743","Type":"ContainerDied","Data":"52a10ded4737200484e2b2c660bd965199ae2fd7d13ce180fd59a8167cf105bf"}
Sep 11 13:07:27.489285 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.489226    2573 scope.go:117] "RemoveContainer" containerID="ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf"
Sep 11 13:07:27.499002 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.498983    2573 scope.go:117] "RemoveContainer" containerID="ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf"
Sep 11 13:07:27.499261 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:07:27.499240    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf\": container with ID starting with ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf not found: ID does not exist" containerID="ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf"
Sep 11 13:07:27.499343 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.499274    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf"} err="failed to get container status \"ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf\": rpc error: code = NotFound desc = could not find container \"ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf\": container with ID starting with ec296b2f101697f35d7e38ae88b021b8df53622602f3e6dd9fa6a55e4b893abf not found: ID does not exist"
Sep 11 13:07:27.510074 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.510054    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"]
Sep 11 13:07:27.514127 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.514107    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-de3842/test-model-de3842-kserve-96489cdf-w85wh"]
Sep 11 13:07:27.549002 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.548978    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39215caa-733d-4421-9a45-3f12b2b83743-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:27.549100 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.549004    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpbmk\" (UniqueName: \"kubernetes.io/projected/39215caa-733d-4421-9a45-3f12b2b83743-kube-api-access-wpbmk\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:27.549100 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:27.549019    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39215caa-733d-4421-9a45-3f12b2b83743-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:28.516545 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:28.516510    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39215caa-733d-4421-9a45-3f12b2b83743" path="/var/lib/kubelet/pods/39215caa-733d-4421-9a45-3f12b2b83743/volumes"
Sep 11 13:07:28.516913 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:28.516893    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51da0f48-5179-4986-9abb-0ec54891a76b" path="/var/lib/kubelet/pods/51da0f48-5179-4986-9abb-0ec54891a76b/volumes"
Sep 11 13:07:28.901732 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:28.901690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:29.004904 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.004871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:29.163768 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.163650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:29.497018 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.496931    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"]
Sep 11 13:07:29.497359 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497345    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51da0f48-5179-4986-9abb-0ec54891a76b" containerName="main"
Sep 11 13:07:29.497429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497361    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="51da0f48-5179-4986-9abb-0ec54891a76b" containerName="main"
Sep 11 13:07:29.497429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497370    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1d1c06-894f-486b-921c-5e367079f5f6" containerName="main"
Sep 11 13:07:29.497429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497375    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1d1c06-894f-486b-921c-5e367079f5f6" containerName="main"
Sep 11 13:07:29.497429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497383    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39215caa-733d-4421-9a45-3f12b2b83743" containerName="main"
Sep 11 13:07:29.497429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497388    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="39215caa-733d-4421-9a45-3f12b2b83743" containerName="main"
Sep 11 13:07:29.497607 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497449    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="51da0f48-5179-4986-9abb-0ec54891a76b" containerName="main"
Sep 11 13:07:29.497607 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497458    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="39215caa-733d-4421-9a45-3f12b2b83743" containerName="main"
Sep 11 13:07:29.497607 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.497466    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1d1c06-894f-486b-921c-5e367079f5f6" containerName="main"
Sep 11 13:07:29.501935 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.501913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"
Sep 11 13:07:29.505632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.505612    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:07:29.505760 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.505638    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:07:29.510608 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.510588    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"]
Sep 11 13:07:29.666373 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.666317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270ef1b4-7e14-4220-81be-e68ec86905f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-de3842-zczj6\" (UID: \"270ef1b4-7e14-4220-81be-e68ec86905f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"
Sep 11 13:07:29.767893 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.767806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270ef1b4-7e14-4220-81be-e68ec86905f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-de3842-zczj6\" (UID: \"270ef1b4-7e14-4220-81be-e68ec86905f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"
Sep 11 13:07:29.768408 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.768388    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270ef1b4-7e14-4220-81be-e68ec86905f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-de3842-zczj6\" (UID: \"270ef1b4-7e14-4220-81be-e68ec86905f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"
Sep 11 13:07:29.770604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.770574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:29.813541 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:29.813514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"
Sep 11 13:07:30.087038 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:30.087011    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"]
Sep 11 13:07:30.088796 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:07:30.088770    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270ef1b4_7e14_4220_81be_e68ec86905f6.slice/crio-b7ddc0f9daa971a031aa89f868011883a2741bf66471d028200bcf40ee6a4a74 WatchSource:0}: Error finding container b7ddc0f9daa971a031aa89f868011883a2741bf66471d028200bcf40ee6a4a74: Status 404 returned error can't find the container with id b7ddc0f9daa971a031aa89f868011883a2741bf66471d028200bcf40ee6a4a74
Sep 11 13:07:30.509148 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:30.509109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6" event={"ID":"270ef1b4-7e14-4220-81be-e68ec86905f6","Type":"ContainerStarted","Data":"d7c15ef5c4167cfd10f5260b9ce0e3cc24d514c8125e6dff7e064cd47672e3b5"}
Sep 11 13:07:30.509362 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:30.509192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6" event={"ID":"270ef1b4-7e14-4220-81be-e68ec86905f6","Type":"ContainerStarted","Data":"b7ddc0f9daa971a031aa89f868011883a2741bf66471d028200bcf40ee6a4a74"}
Sep 11 13:07:30.524802 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:30.524754    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6" podStartSLOduration=1.524739865 podStartE2EDuration="1.524739865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:07:30.523215125 +0000 UTC m=+1228.597677889" watchObservedRunningTime="2026-09-11 13:07:30.524739865 +0000 UTC m=+1228.599202630"
Sep 11 13:07:31.516443 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:31.516407    2573 generic.go:356] "Generic (PLEG): container finished" podID="270ef1b4-7e14-4220-81be-e68ec86905f6" containerID="d7c15ef5c4167cfd10f5260b9ce0e3cc24d514c8125e6dff7e064cd47672e3b5" exitCode=0
Sep 11 13:07:31.516850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:31.516490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6" event={"ID":"270ef1b4-7e14-4220-81be-e68ec86905f6","Type":"ContainerDied","Data":"d7c15ef5c4167cfd10f5260b9ce0e3cc24d514c8125e6dff7e064cd47672e3b5"}
Sep 11 13:07:32.118380 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:32.118345    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:07:32.652568 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:32.652544    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"
Sep 11 13:07:32.797153 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:32.797129    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270ef1b4-7e14-4220-81be-e68ec86905f6-maas-api-service-ca\") pod \"270ef1b4-7e14-4220-81be-e68ec86905f6\" (UID: \"270ef1b4-7e14-4220-81be-e68ec86905f6\") "
Sep 11 13:07:32.797519 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:32.797491    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/270ef1b4-7e14-4220-81be-e68ec86905f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "270ef1b4-7e14-4220-81be-e68ec86905f6" (UID: "270ef1b4-7e14-4220-81be-e68ec86905f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:07:32.898431 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:32.898405    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/270ef1b4-7e14-4220-81be-e68ec86905f6-maas-api-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:33.527697 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:33.527669    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"
Sep 11 13:07:33.527872 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:33.527717    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6" event={"ID":"270ef1b4-7e14-4220-81be-e68ec86905f6","Type":"ContainerDied","Data":"b7ddc0f9daa971a031aa89f868011883a2741bf66471d028200bcf40ee6a4a74"}
Sep 11 13:07:33.527872 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:33.527761    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7ddc0f9daa971a031aa89f868011883a2741bf66471d028200bcf40ee6a4a74"
Sep 11 13:07:40.239950 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:40.239916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:40.416611 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:40.416567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:40.510047 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:40.509959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:40.609881 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:40.609850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:40.615453 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:40.615424    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"]
Sep 11 13:07:40.623142 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:40.623109    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de3842-zczj6"]
Sep 11 13:07:40.688347 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:40.688317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:40.926087 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:40.926054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:41.028772 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:41.028732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:42.517798 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:42.517765    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="270ef1b4-7e14-4220-81be-e68ec86905f6" path="/var/lib/kubelet/pods/270ef1b4-7e14-4220-81be-e68ec86905f6/volumes"
Sep 11 13:07:43.057215 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:43.057157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:43.344391 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:43.344306    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:07:43.556110 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:43.556081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:44.424193 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:44.424142    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:44.630895 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:44.630855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:44.862162 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:44.862121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:47.780552 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:47.780523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:47.863957 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:47.863922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:48.124352 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:48.124313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:48.656934 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:48.656904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:49.024030 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.023953    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"]
Sep 11 13:07:49.024413 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.024361    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270ef1b4-7e14-4220-81be-e68ec86905f6" containerName="revoke-keys"
Sep 11 13:07:49.024413 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.024379    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="270ef1b4-7e14-4220-81be-e68ec86905f6" containerName="revoke-keys"
Sep 11 13:07:49.024489 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.024471    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="270ef1b4-7e14-4220-81be-e68ec86905f6" containerName="revoke-keys"
Sep 11 13:07:49.028757 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.028736    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.033527 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.033506    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-d4b0b9-openshift-default-dockercfg-xrmll\""
Sep 11 13:07:49.033868 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.033852    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:07:49.050483 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.050457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:49.053065 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.053040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"]
Sep 11 13:07:49.145320 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-data\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.145508 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-socket\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.145508 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-credential-socket\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.145508 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-certs\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.145508 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-token\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.145508 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istiod-ca-cert\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.145726 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-podinfo\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.145726 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p26qj\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-kube-api-access-p26qj\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.145726 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.145583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-envoy\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.194237 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.194206    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:49.246387 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-credential-socket\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.246387 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-certs\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.246632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246409    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-token\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.246632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246426    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istiod-ca-cert\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.246632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-podinfo\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.246632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p26qj\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-kube-api-access-p26qj\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.246632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-envoy\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.246632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-data\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.246632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.246629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-socket\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.247114 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.247091    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-certs\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.247362 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.247338    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-socket\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.247433 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.247355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-data\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.247795 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.247760    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-credential-socket\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.254983 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.248627    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istiod-ca-cert\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.255464 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.255440    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-envoy\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.257053 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.257028    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-podinfo\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.259084 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.259065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p26qj\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-kube-api-access-p26qj\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.259154 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.259092    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-token\") pod \"e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") " pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.340096 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.340069    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:49.639129 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.639103    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"]
Sep 11 13:07:49.641784 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:07:49.641755    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad3375a_b0d8_495f_9bbc_6a678f10482a.slice/crio-4f4600aa008fe4a134e81ecf64d5a8cc35986818121d567640b002660fae3d57 WatchSource:0}: Error finding container 4f4600aa008fe4a134e81ecf64d5a8cc35986818121d567640b002660fae3d57: Status 404 returned error can't find the container with id 4f4600aa008fe4a134e81ecf64d5a8cc35986818121d567640b002660fae3d57
Sep 11 13:07:49.643947 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.643914    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:07:49.644027 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.643981    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:07:49.644027 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:49.644009    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:07:50.621541 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:50.621499    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" event={"ID":"1ad3375a-b0d8-495f-9bbc-6a678f10482a","Type":"ContainerStarted","Data":"e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8"}
Sep 11 13:07:50.622023 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:50.621559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" event={"ID":"1ad3375a-b0d8-495f-9bbc-6a678f10482a","Type":"ContainerStarted","Data":"4f4600aa008fe4a134e81ecf64d5a8cc35986818121d567640b002660fae3d57"}
Sep 11 13:07:50.653430 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:50.653382    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" podStartSLOduration=2.653364916 podStartE2EDuration="2.653364916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:07:50.649597977 +0000 UTC m=+1248.724060741" watchObservedRunningTime="2026-09-11 13:07:50.653364916 +0000 UTC m=+1248.727827680"
Sep 11 13:07:51.341031 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:51.340994    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:51.345756 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:51.345729    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:51.628490 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:51.628396    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:51.629317 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:51.629297    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:07:52.470672 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.470631    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:52.786516 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.786486    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:52.923129 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.923097    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"]
Sep 11 13:07:52.926559 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.926536    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"
Sep 11 13:07:52.931383 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.931360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:07:52.931591 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.931573    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:07:52.952315 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.952287    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"]
Sep 11 13:07:52.963057 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.963029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:52.982547 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:52.982514    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54824e8d-a886-4225-97b9-c36a87f2408e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl\" (UID: \"54824e8d-a886-4225-97b9-c36a87f2408e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"
Sep 11 13:07:53.084108 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:53.084032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54824e8d-a886-4225-97b9-c36a87f2408e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl\" (UID: \"54824e8d-a886-4225-97b9-c36a87f2408e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"
Sep 11 13:07:53.084637 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:53.084617    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54824e8d-a886-4225-97b9-c36a87f2408e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl\" (UID: \"54824e8d-a886-4225-97b9-c36a87f2408e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"
Sep 11 13:07:53.237110 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:53.237078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"
Sep 11 13:07:53.518909 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:53.518880    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"]
Sep 11 13:07:53.520582 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:07:53.520553    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54824e8d_a886_4225_97b9_c36a87f2408e.slice/crio-c0bd0f1cfe14145876ef727aa8e318ff9225d8616bddec4d2ff527431fef9262 WatchSource:0}: Error finding container c0bd0f1cfe14145876ef727aa8e318ff9225d8616bddec4d2ff527431fef9262: Status 404 returned error can't find the container with id c0bd0f1cfe14145876ef727aa8e318ff9225d8616bddec4d2ff527431fef9262
Sep 11 13:07:53.640635 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:53.640597    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl" event={"ID":"54824e8d-a886-4225-97b9-c36a87f2408e","Type":"ContainerStarted","Data":"c0bd0f1cfe14145876ef727aa8e318ff9225d8616bddec4d2ff527431fef9262"}
Sep 11 13:07:54.649686 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:54.649652    2573 generic.go:356] "Generic (PLEG): container finished" podID="54824e8d-a886-4225-97b9-c36a87f2408e" containerID="6bca1a38cf658f1c856f3029e3e46fe36eac803d2f84eb6093278bff6a117b10" exitCode=0
Sep 11 13:07:54.650071 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:54.649702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl" event={"ID":"54824e8d-a886-4225-97b9-c36a87f2408e","Type":"ContainerDied","Data":"6bca1a38cf658f1c856f3029e3e46fe36eac803d2f84eb6093278bff6a117b10"}
Sep 11 13:07:54.722330 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:54.722264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:54.836072 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:54.836032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:55.252335 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.252298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:55.352463 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.352430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:55.479402 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.479365    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"]
Sep 11 13:07:55.483030 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.483006    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:55.485063 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.485043    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-d4b0b9-dockercfg-b26bq\""
Sep 11 13:07:55.485341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.485324    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-d4b0b9\""
Sep 11 13:07:55.495116 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.495098    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"]
Sep 11 13:07:55.606924 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.606888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00748354-757b-4d42-a9ce-30ce3340259f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67\" (UID: \"00748354-757b-4d42-a9ce-30ce3340259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:55.606924 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.606920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkmw\" (UniqueName: \"kubernetes.io/projected/00748354-757b-4d42-a9ce-30ce3340259f-kube-api-access-8pkmw\") pod \"payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67\" (UID: \"00748354-757b-4d42-a9ce-30ce3340259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:55.707839 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.707756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00748354-757b-4d42-a9ce-30ce3340259f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67\" (UID: \"00748354-757b-4d42-a9ce-30ce3340259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:55.707839 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.707811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkmw\" (UniqueName: \"kubernetes.io/projected/00748354-757b-4d42-a9ce-30ce3340259f-kube-api-access-8pkmw\") pod \"payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67\" (UID: \"00748354-757b-4d42-a9ce-30ce3340259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:55.708740 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.708711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00748354-757b-4d42-a9ce-30ce3340259f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67\" (UID: \"00748354-757b-4d42-a9ce-30ce3340259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:55.718124 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.718089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkmw\" (UniqueName: \"kubernetes.io/projected/00748354-757b-4d42-a9ce-30ce3340259f-kube-api-access-8pkmw\") pod \"payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67\" (UID: \"00748354-757b-4d42-a9ce-30ce3340259f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:55.786248 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.786220    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"
Sep 11 13:07:55.793894 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.793877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:55.854404 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.854353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:07:55.909665 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.909588    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54824e8d-a886-4225-97b9-c36a87f2408e-maas-api-service-ca\") pod \"54824e8d-a886-4225-97b9-c36a87f2408e\" (UID: \"54824e8d-a886-4225-97b9-c36a87f2408e\") "
Sep 11 13:07:55.909995 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:55.909973    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54824e8d-a886-4225-97b9-c36a87f2408e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54824e8d-a886-4225-97b9-c36a87f2408e" (UID: "54824e8d-a886-4225-97b9-c36a87f2408e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:07:56.010760 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.010722    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54824e8d-a886-4225-97b9-c36a87f2408e-maas-api-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:07:56.072738 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.072711    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"]
Sep 11 13:07:56.074981 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:07:56.074954    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00748354_757b_4d42_a9ce_30ce3340259f.slice/crio-10ebc415277d8b659a008b60976f752998ded4b25f9ddd2b56c0b117935cb71c WatchSource:0}: Error finding container 10ebc415277d8b659a008b60976f752998ded4b25f9ddd2b56c0b117935cb71c: Status 404 returned error can't find the container with id 10ebc415277d8b659a008b60976f752998ded4b25f9ddd2b56c0b117935cb71c
Sep 11 13:07:56.665355 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.665312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67" event={"ID":"00748354-757b-4d42-a9ce-30ce3340259f","Type":"ContainerStarted","Data":"ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0"}
Sep 11 13:07:56.665529 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.665387    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67" event={"ID":"00748354-757b-4d42-a9ce-30ce3340259f","Type":"ContainerStarted","Data":"10ebc415277d8b659a008b60976f752998ded4b25f9ddd2b56c0b117935cb71c"}
Sep 11 13:07:56.665529 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.665418    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:07:56.666844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.666813    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"
Sep 11 13:07:56.666971 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.666811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl" event={"ID":"54824e8d-a886-4225-97b9-c36a87f2408e","Type":"ContainerDied","Data":"c0bd0f1cfe14145876ef727aa8e318ff9225d8616bddec4d2ff527431fef9262"}
Sep 11 13:07:56.666971 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.666933    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0bd0f1cfe14145876ef727aa8e318ff9225d8616bddec4d2ff527431fef9262"
Sep 11 13:07:56.686087 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:56.686033    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67" podStartSLOduration=1.686015647 podStartE2EDuration="1.686015647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:07:56.683487894 +0000 UTC m=+1254.757950660" watchObservedRunningTime="2026-09-11 13:07:56.686015647 +0000 UTC m=+1254.760478412"
Sep 11 13:07:58.205474 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:07:58.205435    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:08:03.060094 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:03.060058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:03.729984 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:03.729939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:03.830462 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:03.830421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:03.929035 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:03.928999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:03.941087 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:03.941056    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"]
Sep 11 13:08:03.943713 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:03.943691    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f294ac01-tfrfl"]
Sep 11 13:08:04.030327 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:04.030250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:04.313699 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:04.313658    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:04.517436 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:04.517395    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54824e8d-a886-4225-97b9-c36a87f2408e" path="/var/lib/kubelet/pods/54824e8d-a886-4225-97b9-c36a87f2408e/volumes"
Sep 11 13:08:07.537284 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.536590    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": read tcp 10.132.0.2:54052->10.132.0.61:15021: read: connection reset by peer" start-of-body=
Sep 11 13:08:07.537284 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.536667    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": read tcp 10.132.0.2:54052->10.132.0.61:15021: read: connection reset by peer"
Sep 11 13:08:07.605639 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.605596    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:08:07.673311 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.673282    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:08:07.736442 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.736360    2573 generic.go:356] "Generic (PLEG): container finished" podID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerID="e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8" exitCode=0
Sep 11 13:08:07.736442 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.736431    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" event={"ID":"1ad3375a-b0d8-495f-9bbc-6a678f10482a","Type":"ContainerDied","Data":"e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8"}
Sep 11 13:08:07.736849 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.736831    2573 scope.go:117] "RemoveContainer" containerID="e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8"
Sep 11 13:08:07.737958 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.737929    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:08:07.738037 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.738019    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:08:07.738088 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:07.738071    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:08:08.743692 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:08.743661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" event={"ID":"1ad3375a-b0d8-495f-9bbc-6a678f10482a","Type":"ContainerStarted","Data":"04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc"}
Sep 11 13:08:09.340391 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:09.340355    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:08:09.340647 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:09.340624    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:08:09.340734 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:09.340682    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 13:08:10.175879 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:10.175844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:10.260751 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:10.260719    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:10.340593 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:10.340562    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:08:10.340763 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:10.340617    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 13:08:10.471256 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:10.466698    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:10.872997 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:10.872956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:10.992871 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:10.992830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:11.120536 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:11.120503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:11.341415 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:11.341377    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:08:11.341898 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:11.341461    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 13:08:12.341308 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:12.341273    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:08:12.341494 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:12.341341    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 13:08:13.341212 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:13.341145    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:08:13.341422 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:13.341245    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 13:08:14.343908 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:14.343876    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:08:14.344425 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:14.344282    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:08:14.344903 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:14.344886    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:08:15.861081 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:15.861039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:17.605401 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:17.605364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:17.734042 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:17.734009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:17.841459 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:17.841417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:17.948590 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:17.948492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:18.041519 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:18.041482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:18.140784 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:18.140751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:18.403700 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:18.403588    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:18.576615 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:18.576580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:22.265619 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:22.265582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:22.412284 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:22.412242    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:23.513837 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:23.513801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:23.613425 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:23.613383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:23.876688 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:23.876649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:24.619933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:24.619901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:24.799610 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:24.799574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:27.584509 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:27.584475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:27.898357 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:27.898254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:28.658246 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:28.658199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:28.785525 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:28.785489    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:08:29.314011 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:29.313963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:29.709989 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:29.709903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:32.057387 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:32.057348    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:32.290152 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:32.290116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:33.318870 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:33.318835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:33.413111 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:33.413076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:33.713940 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:33.713840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:34.008063 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:34.007965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:34.101475 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:34.101428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:39.130569 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:39.130522    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:08:47.361150 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:47.361103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:52.255021 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:52.254985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:54.744574 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:54.744532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:57.017669 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.017637    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:57.358874 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.358837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:57.749754 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.749566    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"]
Sep 11 13:08:57.749956 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.749943    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54824e8d-a886-4225-97b9-c36a87f2408e" containerName="revoke-keys"
Sep 11 13:08:57.750013 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.749959    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="54824e8d-a886-4225-97b9-c36a87f2408e" containerName="revoke-keys"
Sep 11 13:08:57.750086 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.750076    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="54824e8d-a886-4225-97b9-c36a87f2408e" containerName="revoke-keys"
Sep 11 13:08:57.753406 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.753390    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.756036 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.756014    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-7c542a-openshift-default-dockercfg-xz2sh\""
Sep 11 13:08:57.801500 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-credential-socket\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.801656 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-certs\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.801656 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv6ww\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-kube-api-access-sv6ww\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.801656 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-envoy\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.801656 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fe28c4-2026-4092-b62a-59b2424f4f7c-istiod-ca-cert\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.801881 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-data\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.801881 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-socket\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.801881 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-token\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.801881 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.801808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-podinfo\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.805111 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.805086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:57.853205 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.853158    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"]
Sep 11 13:08:57.902911 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.902875    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fe28c4-2026-4092-b62a-59b2424f4f7c-istiod-ca-cert\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.902911 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.902912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-data\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903110 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.902957    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-socket\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903110 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-token\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903110 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-podinfo\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903110 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-credential-socket\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903323 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-certs\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903323 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6ww\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-kube-api-access-sv6ww\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903323 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-envoy\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903519 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903493    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-socket\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903594 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903568    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-data\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903741 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-certs\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903805 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fe28c4-2026-4092-b62a-59b2424f4f7c-istiod-ca-cert\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.903919 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.903903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-credential-socket\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.906105 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.906085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-envoy\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.906255 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.906238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-podinfo\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.915352 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.915327    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-token\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.916297 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.916277    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv6ww\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-kube-api-access-sv6ww\") pod \"e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") " pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:57.970624 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:57.970594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:08:58.065066 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:58.065034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:58.345906 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:58.345883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"]
Sep 11 13:08:58.347815 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:08:58.347781    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fe28c4_2026_4092_b62a_59b2424f4f7c.slice/crio-9436c7a06dcf724a60c548986a3d27dec32124a5d1342540bea9c9353cc6d3dd WatchSource:0}: Error finding container 9436c7a06dcf724a60c548986a3d27dec32124a5d1342540bea9c9353cc6d3dd: Status 404 returned error can't find the container with id 9436c7a06dcf724a60c548986a3d27dec32124a5d1342540bea9c9353cc6d3dd
Sep 11 13:08:58.349993 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:58.349964    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:08:58.350077 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:58.350033    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:08:58.350117 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:58.350081    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:08:59.057516 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:59.057467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" event={"ID":"59fe28c4-2026-4092-b62a-59b2424f4f7c","Type":"ContainerStarted","Data":"35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f"}
Sep 11 13:08:59.057723 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:59.057527    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" event={"ID":"59fe28c4-2026-4092-b62a-59b2424f4f7c","Type":"ContainerStarted","Data":"9436c7a06dcf724a60c548986a3d27dec32124a5d1342540bea9c9353cc6d3dd"}
Sep 11 13:08:59.065520 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:59.065493    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:59.070716 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:59.070697    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:08:59.081293 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:08:59.081244    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" podStartSLOduration=2.081230773 podStartE2EDuration="2.081230773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:59.080054193 +0000 UTC m=+1317.154516962" watchObservedRunningTime="2026-09-11 13:08:59.081230773 +0000 UTC m=+1317.155693536"
Sep 11 13:09:00.064852 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:00.064815    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:09:00.065846 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:00.065822    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:09:01.059766 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:01.059728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:01.159542 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:01.159507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:02.253367 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:02.253318    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:02.354501 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:02.354461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:02.580353 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:02.580321    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:02.894201 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:02.894089    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:03.029334 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.029291    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:03.132739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.132707    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"]
Sep 11 13:09:03.136664 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.136641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:03.139286 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.139260    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-7c542a-dockercfg-d9prc\""
Sep 11 13:09:03.139419 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.139260    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-7c542a\""
Sep 11 13:09:03.149776 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.149719    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"]
Sep 11 13:09:03.154606 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.154573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khh4h\" (UniqueName: \"kubernetes.io/projected/8ec0d41f-6198-44db-b0a9-18b696fbcd51-kube-api-access-khh4h\") pod \"payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9\" (UID: \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:03.154706 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.154621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ec0d41f-6198-44db-b0a9-18b696fbcd51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9\" (UID: \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:03.255429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.255383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khh4h\" (UniqueName: \"kubernetes.io/projected/8ec0d41f-6198-44db-b0a9-18b696fbcd51-kube-api-access-khh4h\") pod \"payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9\" (UID: \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:03.255429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.255443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ec0d41f-6198-44db-b0a9-18b696fbcd51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9\" (UID: \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:03.256093 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.256074    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ec0d41f-6198-44db-b0a9-18b696fbcd51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9\" (UID: \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:03.265159 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.265132    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khh4h\" (UniqueName: \"kubernetes.io/projected/8ec0d41f-6198-44db-b0a9-18b696fbcd51-kube-api-access-khh4h\") pod \"payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9\" (UID: \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:03.448149 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.448057    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:03.735501 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:03.735474    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"]
Sep 11 13:09:03.737151 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:09:03.737125    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec0d41f_6198_44db_b0a9_18b696fbcd51.slice/crio-22d17cb86577e093efc692435b7bf1846b3ddafeadb98b147063ae164ac328a4 WatchSource:0}: Error finding container 22d17cb86577e093efc692435b7bf1846b3ddafeadb98b147063ae164ac328a4: Status 404 returned error can't find the container with id 22d17cb86577e093efc692435b7bf1846b3ddafeadb98b147063ae164ac328a4
Sep 11 13:09:04.093925 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:04.093892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9" event={"ID":"8ec0d41f-6198-44db-b0a9-18b696fbcd51","Type":"ContainerStarted","Data":"1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99"}
Sep 11 13:09:04.094130 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:04.093945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9" event={"ID":"8ec0d41f-6198-44db-b0a9-18b696fbcd51","Type":"ContainerStarted","Data":"22d17cb86577e093efc692435b7bf1846b3ddafeadb98b147063ae164ac328a4"}
Sep 11 13:09:04.094130 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:04.094019    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:04.111799 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:04.111752    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9" podStartSLOduration=1.111737242 podStartE2EDuration="1.111737242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:04.110598472 +0000 UTC m=+1322.185061229" watchObservedRunningTime="2026-09-11 13:09:04.111737242 +0000 UTC m=+1322.186200006"
Sep 11 13:09:09.127364 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:09.127319    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:09:15.101797 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:15.101762    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:09:20.212773 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:20.212736    2573 generic.go:356] "Generic (PLEG): container finished" podID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerID="35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f" exitCode=0
Sep 11 13:09:20.213298 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:20.212792    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" event={"ID":"59fe28c4-2026-4092-b62a-59b2424f4f7c","Type":"ContainerDied","Data":"35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f"}
Sep 11 13:09:20.213298 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:20.213216    2573 scope.go:117] "RemoveContainer" containerID="35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f"
Sep 11 13:09:20.214339 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:20.214305    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:09:20.214434 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:20.214371    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:09:20.214434 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:20.214401    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:09:21.220542 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:21.220502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" event={"ID":"59fe28c4-2026-4092-b62a-59b2424f4f7c","Type":"ContainerStarted","Data":"0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd"}
Sep 11 13:09:22.066131 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:22.066096    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:09:22.066472 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:22.066440    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:09:22.066591 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:22.066502    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:09:22.120984 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:22.120938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:23.066445 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:23.066399    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:09:23.066961 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:23.066475    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:09:24.065977 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:24.065936    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:09:24.066217 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:24.066010    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:09:25.065805 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:25.065764    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:09:25.066511 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:25.066475    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:09:26.011935 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:26.011893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:26.066573 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:26.066520    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:09:26.067073 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:26.066603    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:09:26.509142 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:26.509102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:09:26.812681 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:26.812641    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7794-ef4150"]
Sep 11 13:09:26.815396 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:26.815376    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:26.817833 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:26.817807    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-52h42\""
Sep 11 13:09:26.821607 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:26.821583    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7794-ef4150"]
Sep 11 13:09:27.006377 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.006334    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgksn\" (UniqueName: \"kubernetes.io/projected/0d7c5367-8d52-4c45-a83c-0df88234f62c-kube-api-access-rgksn\") pod \"test-curl-7794-ef4150\" (UID: \"0d7c5367-8d52-4c45-a83c-0df88234f62c\") " pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:27.070812 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.070728    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:09:27.071254 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.071235    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:09:27.071882 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.071859    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:09:27.107663 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.107618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgksn\" (UniqueName: \"kubernetes.io/projected/0d7c5367-8d52-4c45-a83c-0df88234f62c-kube-api-access-rgksn\") pod \"test-curl-7794-ef4150\" (UID: \"0d7c5367-8d52-4c45-a83c-0df88234f62c\") " pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:27.117893 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.117867    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgksn\" (UniqueName: \"kubernetes.io/projected/0d7c5367-8d52-4c45-a83c-0df88234f62c-kube-api-access-rgksn\") pod \"test-curl-7794-ef4150\" (UID: \"0d7c5367-8d52-4c45-a83c-0df88234f62c\") " pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:27.126889 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.126856    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:27.473741 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.473712    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7794-ef4150"]
Sep 11 13:09:27.475680 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:09:27.475650    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d7c5367_8d52_4c45_a83c_0df88234f62c.slice/crio-fecc2ff208dc4607cfe7d74c7d470be90ad27322036356b7ab4396d00ea2d3e3 WatchSource:0}: Error finding container fecc2ff208dc4607cfe7d74c7d470be90ad27322036356b7ab4396d00ea2d3e3: Status 404 returned error can't find the container with id fecc2ff208dc4607cfe7d74c7d470be90ad27322036356b7ab4396d00ea2d3e3
Sep 11 13:09:27.478129 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:27.478112    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:09:28.265194 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:28.265130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7794-ef4150" event={"ID":"0d7c5367-8d52-4c45-a83c-0df88234f62c","Type":"ContainerStarted","Data":"fecc2ff208dc4607cfe7d74c7d470be90ad27322036356b7ab4396d00ea2d3e3"}
Sep 11 13:09:30.279472 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:30.279430    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7794-ef4150" event={"ID":"0d7c5367-8d52-4c45-a83c-0df88234f62c","Type":"ContainerStarted","Data":"6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25"}
Sep 11 13:09:30.296189 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:30.296117    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7794-ef4150" podStartSLOduration=2.515941438 podStartE2EDuration="4.296100097s" totalImagesPullingTime="1.780158659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:30.293689314 +0000 UTC m=+1348.368152079" watchObservedRunningTime="2026-09-11 13:09:30.296100097 +0000 UTC m=+1348.370562861"
Sep 11 13:09:30.908432 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:30.908394    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7794-ef4150"]
Sep 11 13:09:30.912428 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:30.912403    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7794-ef4150"]
Sep 11 13:09:31.285236 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:31.285205    2573 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7794-ef4150" container="test-curl-7794-ef4150"
Sep 11 13:09:32.289925 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:32.289889    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7794-ef4150" podUID="0d7c5367-8d52-4c45-a83c-0df88234f62c" containerName="test-curl-7794-ef4150" containerID="cri-o://6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25" gracePeriod=2
Sep 11 13:09:32.292287 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:32.292256    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7794-ef4150\" is forbidden: User \"system:node:ip-10-0-128-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-225.ec2.internal' and this object" podUID="0d7c5367-8d52-4c45-a83c-0df88234f62c" pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:32.516574 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:32.516532    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7794-ef4150\" is forbidden: User \"system:node:ip-10-0-128-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-225.ec2.internal' and this object" podUID="0d7c5367-8d52-4c45-a83c-0df88234f62c" pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:34.435588 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:34.435559    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:34.479601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:34.479572    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgksn\" (UniqueName: \"kubernetes.io/projected/0d7c5367-8d52-4c45-a83c-0df88234f62c-kube-api-access-rgksn\") pod \"0d7c5367-8d52-4c45-a83c-0df88234f62c\" (UID: \"0d7c5367-8d52-4c45-a83c-0df88234f62c\") "
Sep 11 13:09:34.481830 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:34.481807    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d7c5367-8d52-4c45-a83c-0df88234f62c-kube-api-access-rgksn" (OuterVolumeSpecName: "kube-api-access-rgksn") pod "0d7c5367-8d52-4c45-a83c-0df88234f62c" (UID: "0d7c5367-8d52-4c45-a83c-0df88234f62c"). InnerVolumeSpecName "kube-api-access-rgksn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:34.518147 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:34.518120    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d7c5367-8d52-4c45-a83c-0df88234f62c" path="/var/lib/kubelet/pods/0d7c5367-8d52-4c45-a83c-0df88234f62c/volumes"
Sep 11 13:09:34.580889 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:34.580820    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgksn\" (UniqueName: \"kubernetes.io/projected/0d7c5367-8d52-4c45-a83c-0df88234f62c-kube-api-access-rgksn\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:09:35.172781 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.172747    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7794-735f4a"]
Sep 11 13:09:35.173166 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.173153    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7c5367-8d52-4c45-a83c-0df88234f62c" containerName="test-curl-7794-ef4150"
Sep 11 13:09:35.173230 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.173185    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7c5367-8d52-4c45-a83c-0df88234f62c" containerName="test-curl-7794-ef4150"
Sep 11 13:09:35.173279 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.173270    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7c5367-8d52-4c45-a83c-0df88234f62c" containerName="test-curl-7794-ef4150"
Sep 11 13:09:35.176400 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.176381    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:35.182249 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.182222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7794-735f4a"]
Sep 11 13:09:35.286228 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.286197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6jrw\" (UniqueName: \"kubernetes.io/projected/5cff2b11-1a60-459b-a0db-08583fcfffac-kube-api-access-m6jrw\") pod \"test-curl-7794-735f4a\" (UID: \"5cff2b11-1a60-459b-a0db-08583fcfffac\") " pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:35.310534 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.310501    2573 generic.go:356] "Generic (PLEG): container finished" podID="0d7c5367-8d52-4c45-a83c-0df88234f62c" containerID="6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25" exitCode=137
Sep 11 13:09:35.310710 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.310545    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-ef4150"
Sep 11 13:09:35.310710 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.310551    2573 scope.go:117] "RemoveContainer" containerID="6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25"
Sep 11 13:09:35.321895 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.321879    2573 scope.go:117] "RemoveContainer" containerID="6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25"
Sep 11 13:09:35.322231 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:35.322212    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25\": container with ID starting with 6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25 not found: ID does not exist" containerID="6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25"
Sep 11 13:09:35.322293 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.322241    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25"} err="failed to get container status \"6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25\": rpc error: code = NotFound desc = could not find container \"6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25\": container with ID starting with 6b432104c4db193a1cd139bbfea98dd45cb27894212545e27f6ad24b59b4ab25 not found: ID does not exist"
Sep 11 13:09:35.387034 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.387005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6jrw\" (UniqueName: \"kubernetes.io/projected/5cff2b11-1a60-459b-a0db-08583fcfffac-kube-api-access-m6jrw\") pod \"test-curl-7794-735f4a\" (UID: \"5cff2b11-1a60-459b-a0db-08583fcfffac\") " pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:35.395715 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.395689    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6jrw\" (UniqueName: \"kubernetes.io/projected/5cff2b11-1a60-459b-a0db-08583fcfffac-kube-api-access-m6jrw\") pod \"test-curl-7794-735f4a\" (UID: \"5cff2b11-1a60-459b-a0db-08583fcfffac\") " pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:35.486490 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.486409    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:35.759615 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:35.759583    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7794-735f4a"]
Sep 11 13:09:35.761155 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:09:35.761124    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cff2b11_1a60_459b_a0db_08583fcfffac.slice/crio-6eb07ca4ffd32440a3c3385515c999d09e4974d2afadeb11f3a6dd9e4736dab2 WatchSource:0}: Error finding container 6eb07ca4ffd32440a3c3385515c999d09e4974d2afadeb11f3a6dd9e4736dab2: Status 404 returned error can't find the container with id 6eb07ca4ffd32440a3c3385515c999d09e4974d2afadeb11f3a6dd9e4736dab2
Sep 11 13:09:36.319296 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:36.319255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7794-735f4a" event={"ID":"5cff2b11-1a60-459b-a0db-08583fcfffac","Type":"ContainerStarted","Data":"80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5"}
Sep 11 13:09:36.319296 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:36.319297    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7794-735f4a" event={"ID":"5cff2b11-1a60-459b-a0db-08583fcfffac","Type":"ContainerStarted","Data":"6eb07ca4ffd32440a3c3385515c999d09e4974d2afadeb11f3a6dd9e4736dab2"}
Sep 11 13:09:36.333654 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:36.333578    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7794-735f4a" podStartSLOduration=1.333560547 podStartE2EDuration="1.333560547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:36.333228109 +0000 UTC m=+1354.407690875" watchObservedRunningTime="2026-09-11 13:09:36.333560547 +0000 UTC m=+1354.408023311"
Sep 11 13:09:36.961984 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:36.961947    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7794-735f4a"]
Sep 11 13:09:36.966739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:36.966711    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7794-735f4a"]
Sep 11 13:09:37.326039 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:37.326009    2573 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7794-735f4a" container="test-curl-7794-735f4a"
Sep 11 13:09:37.580140 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:37.580037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:37.935938 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:37.935832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:38.099999 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:38.099963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:38.331254 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:38.331193    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7794-735f4a" podUID="5cff2b11-1a60-459b-a0db-08583fcfffac" containerName="test-curl-7794-735f4a" containerID="cri-o://80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5" gracePeriod=2
Sep 11 13:09:38.333308 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:38.333280    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7794-735f4a\" is forbidden: User \"system:node:ip-10-0-128-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-225.ec2.internal' and this object" podUID="5cff2b11-1a60-459b-a0db-08583fcfffac" pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:40.532759 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:40.532734    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:40.634996 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:40.634908    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6jrw\" (UniqueName: \"kubernetes.io/projected/5cff2b11-1a60-459b-a0db-08583fcfffac-kube-api-access-m6jrw\") pod \"5cff2b11-1a60-459b-a0db-08583fcfffac\" (UID: \"5cff2b11-1a60-459b-a0db-08583fcfffac\") "
Sep 11 13:09:40.637202 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:40.637150    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cff2b11-1a60-459b-a0db-08583fcfffac-kube-api-access-m6jrw" (OuterVolumeSpecName: "kube-api-access-m6jrw") pod "5cff2b11-1a60-459b-a0db-08583fcfffac" (UID: "5cff2b11-1a60-459b-a0db-08583fcfffac"). InnerVolumeSpecName "kube-api-access-m6jrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:40.735825 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:40.735791    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6jrw\" (UniqueName: \"kubernetes.io/projected/5cff2b11-1a60-459b-a0db-08583fcfffac-kube-api-access-m6jrw\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:09:41.350697 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:41.350659    2573 generic.go:356] "Generic (PLEG): container finished" podID="5cff2b11-1a60-459b-a0db-08583fcfffac" containerID="80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5" exitCode=137
Sep 11 13:09:41.350918 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:41.350705    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:41.350918 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:41.350766    2573 scope.go:117] "RemoveContainer" containerID="80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5"
Sep 11 13:09:41.360802 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:41.360781    2573 scope.go:117] "RemoveContainer" containerID="80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5"
Sep 11 13:09:41.361056 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:41.361037    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5\": container with ID starting with 80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5 not found: ID does not exist" containerID="80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5"
Sep 11 13:09:41.361108 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:41.361062    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5"} err="failed to get container status \"80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5\": rpc error: code = NotFound desc = could not find container \"80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5\": container with ID starting with 80d091491c3da4a2ce77695bc683b27ca750b807d99b2c681744a8721c1b9db5 not found: ID does not exist"
Sep 11 13:09:41.363963 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:41.363934    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7794-735f4a\" is forbidden: User \"system:node:ip-10-0-128-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-225.ec2.internal' and this object" podUID="5cff2b11-1a60-459b-a0db-08583fcfffac" pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:41.409705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:41.409670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:41.508091 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:41.508056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:42.515696 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:09:42.515659    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7794-735f4a\" is forbidden: User \"system:node:ip-10-0-128-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-225.ec2.internal' and this object" podUID="5cff2b11-1a60-459b-a0db-08583fcfffac" pod="opendatahub/test-curl-7794-735f4a"
Sep 11 13:09:42.517504 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:42.517475    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cff2b11-1a60-459b-a0db-08583fcfffac" path="/var/lib/kubelet/pods/5cff2b11-1a60-459b-a0db-08583fcfffac/volumes"
Sep 11 13:09:42.585596 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:42.585535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:42.785670 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:42.785633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:42.882867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:42.882824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:43.231963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.231861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:43.328297 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.328259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:43.354244 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.354215    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"]
Sep 11 13:09:43.354668 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.354652    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cff2b11-1a60-459b-a0db-08583fcfffac" containerName="test-curl-7794-735f4a"
Sep 11 13:09:43.354715 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.354670    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cff2b11-1a60-459b-a0db-08583fcfffac" containerName="test-curl-7794-735f4a"
Sep 11 13:09:43.354752 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.354743    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cff2b11-1a60-459b-a0db-08583fcfffac" containerName="test-curl-7794-735f4a"
Sep 11 13:09:43.359336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.359311    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:43.361672 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.361644    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f27fde90\""
Sep 11 13:09:43.374754 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.374731    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"]
Sep 11 13:09:43.460594 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.460547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5rl9\" (UniqueName: \"kubernetes.io/projected/d3678736-c8dd-4f31-b5b2-300fae6893d4-kube-api-access-v5rl9\") pod \"payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst\" (UID: \"d3678736-c8dd-4f31-b5b2-300fae6893d4\") " pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:43.460791 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.460622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3678736-c8dd-4f31-b5b2-300fae6893d4-plugins-config-volume\") pod \"payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst\" (UID: \"d3678736-c8dd-4f31-b5b2-300fae6893d4\") " pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:43.561309 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.561279    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5rl9\" (UniqueName: \"kubernetes.io/projected/d3678736-c8dd-4f31-b5b2-300fae6893d4-kube-api-access-v5rl9\") pod \"payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst\" (UID: \"d3678736-c8dd-4f31-b5b2-300fae6893d4\") " pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:43.561768 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.561335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3678736-c8dd-4f31-b5b2-300fae6893d4-plugins-config-volume\") pod \"payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst\" (UID: \"d3678736-c8dd-4f31-b5b2-300fae6893d4\") " pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:43.561992 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.561974    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3678736-c8dd-4f31-b5b2-300fae6893d4-plugins-config-volume\") pod \"payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst\" (UID: \"d3678736-c8dd-4f31-b5b2-300fae6893d4\") " pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:43.571346 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.571320    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5rl9\" (UniqueName: \"kubernetes.io/projected/d3678736-c8dd-4f31-b5b2-300fae6893d4-kube-api-access-v5rl9\") pod \"payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst\" (UID: \"d3678736-c8dd-4f31-b5b2-300fae6893d4\") " pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:43.670360 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.670322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:43.952012 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:43.951985    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"]
Sep 11 13:09:43.953199 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:09:43.953149    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3678736_c8dd_4f31_b5b2_300fae6893d4.slice/crio-72d013ae61a031b2fd03a7a30cdd00b660a655af0780af23a58ea635f3cb19c7 WatchSource:0}: Error finding container 72d013ae61a031b2fd03a7a30cdd00b660a655af0780af23a58ea635f3cb19c7: Status 404 returned error can't find the container with id 72d013ae61a031b2fd03a7a30cdd00b660a655af0780af23a58ea635f3cb19c7
Sep 11 13:09:44.373839 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:44.373805    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst" event={"ID":"d3678736-c8dd-4f31-b5b2-300fae6893d4","Type":"ContainerStarted","Data":"46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c"}
Sep 11 13:09:44.374057 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:44.373860    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst" event={"ID":"d3678736-c8dd-4f31-b5b2-300fae6893d4","Type":"ContainerStarted","Data":"72d013ae61a031b2fd03a7a30cdd00b660a655af0780af23a58ea635f3cb19c7"}
Sep 11 13:09:44.374057 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:44.373882    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:09:44.399672 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:44.399622    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst" podStartSLOduration=1.399605753 podStartE2EDuration="1.399605753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:44.396232153 +0000 UTC m=+1362.470694917" watchObservedRunningTime="2026-09-11 13:09:44.399605753 +0000 UTC m=+1362.474068529"
Sep 11 13:09:52.114069 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:52.114035    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:09:53.588264 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.588222    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"]
Sep 11 13:09:53.592238 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.592223    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.594950 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.594924    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"openshift-service-ca.crt\""
Sep 11 13:09:53.594950 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.594937    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"kube-root-ca.crt\""
Sep 11 13:09:53.595107 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.594956    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"default-dockercfg-9sghz\""
Sep 11 13:09:53.595107 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.594947    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"auth-test-model-2e7f38-kserve-self-signed-certs\""
Sep 11 13:09:53.601085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.601056    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"]
Sep 11 13:09:53.658901 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.658869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-dshm\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.659039 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.658904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-home\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.659039 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.658951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc7vc\" (UniqueName: \"kubernetes.io/projected/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-kube-api-access-zc7vc\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.659039 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.658990    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tmp-dir\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.659039 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.659033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tls-certs\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.659210 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.659083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-model-cache\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.760592 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.760560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7vc\" (UniqueName: \"kubernetes.io/projected/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-kube-api-access-zc7vc\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.760707 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.760600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tmp-dir\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.760707 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.760652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tls-certs\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.760825 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.760806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-model-cache\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.760945 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.760914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-dshm\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.761079 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.760952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-home\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.761079 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.761016    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tmp-dir\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.761237 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.761216    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-model-cache\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.761353 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.761338    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-home\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.763301 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.763279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-dshm\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.763423 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.763410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tls-certs\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.768891 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.768864    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc7vc\" (UniqueName: \"kubernetes.io/projected/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-kube-api-access-zc7vc\") pod \"auth-test-model-2e7f38-kserve-6c449769cf-h6kqc\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.902355 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.902260    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:09:53.997975 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:53.997936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:54.178296 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:54.178273    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"]
Sep 11 13:09:54.180285 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:09:54.180255    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod160d44b1_70ce_4b0c_b97b_690c9f6e6be8.slice/crio-a10ea0fb5f257884ca85272d73ca6e637636b2f7a706094b80ee9fc44f541fcc WatchSource:0}: Error finding container a10ea0fb5f257884ca85272d73ca6e637636b2f7a706094b80ee9fc44f541fcc: Status 404 returned error can't find the container with id a10ea0fb5f257884ca85272d73ca6e637636b2f7a706094b80ee9fc44f541fcc
Sep 11 13:09:54.439740 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:54.439645    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc" event={"ID":"160d44b1-70ce-4b0c-b97b-690c9f6e6be8","Type":"ContainerStarted","Data":"f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392"}
Sep 11 13:09:54.439740 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:54.439691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc" event={"ID":"160d44b1-70ce-4b0c-b97b-690c9f6e6be8","Type":"ContainerStarted","Data":"a10ea0fb5f257884ca85272d73ca6e637636b2f7a706094b80ee9fc44f541fcc"}
Sep 11 13:09:54.457859 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:54.457806    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc" podStartSLOduration=1.457792568 podStartE2EDuration="1.457792568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:54.456136346 +0000 UTC m=+1372.530599112" watchObservedRunningTime="2026-09-11 13:09:54.457792568 +0000 UTC m=+1372.532255332"
Sep 11 13:09:55.085255 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:55.085219    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:09:55.381396 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:09:55.381316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:10:03.903426 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:03.903368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:10:03.903925 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:03.903449    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:10:03.916007 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:03.915981    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:10:04.508868 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:04.508839    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:10:05.610239 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:05.610205    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:10:06.467978 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:06.467947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:10.871612 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:10.871567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:11.756842 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:11.756799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:19.447560 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:19.447518    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:23.197939 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:23.197902    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:10:23.826079 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:23.826036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:10:42.606710 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:42.606672    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:10:46.945133 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:10:46.945097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:01.761272 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:01.761149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:01.798355 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:01.798327    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"]
Sep 11 13:11:01.798557 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:01.798532    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst" podUID="d3678736-c8dd-4f31-b5b2-300fae6893d4" containerName="payload-processing" containerID="cri-o://46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c" gracePeriod=30
Sep 11 13:11:01.859420 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:01.859380    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:01.911553 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:01.911522    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:11:01.959013 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:01.958979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:02.054899 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.054872    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:11:02.070292 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.070254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:02.112531 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.112504    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5rl9\" (UniqueName: \"kubernetes.io/projected/d3678736-c8dd-4f31-b5b2-300fae6893d4-kube-api-access-v5rl9\") pod \"d3678736-c8dd-4f31-b5b2-300fae6893d4\" (UID: \"d3678736-c8dd-4f31-b5b2-300fae6893d4\") "
Sep 11 13:11:02.112706 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.112541    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3678736-c8dd-4f31-b5b2-300fae6893d4-plugins-config-volume\") pod \"d3678736-c8dd-4f31-b5b2-300fae6893d4\" (UID: \"d3678736-c8dd-4f31-b5b2-300fae6893d4\") "
Sep 11 13:11:02.112968 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.112944    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3678736-c8dd-4f31-b5b2-300fae6893d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3678736-c8dd-4f31-b5b2-300fae6893d4" (UID: "d3678736-c8dd-4f31-b5b2-300fae6893d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:02.114903 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.114880    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3678736-c8dd-4f31-b5b2-300fae6893d4-kube-api-access-v5rl9" (OuterVolumeSpecName: "kube-api-access-v5rl9") pod "d3678736-c8dd-4f31-b5b2-300fae6893d4" (UID: "d3678736-c8dd-4f31-b5b2-300fae6893d4"). InnerVolumeSpecName "kube-api-access-v5rl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:02.213290 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.213256    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5rl9\" (UniqueName: \"kubernetes.io/projected/d3678736-c8dd-4f31-b5b2-300fae6893d4-kube-api-access-v5rl9\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:11:02.213290 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.213282    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3678736-c8dd-4f31-b5b2-300fae6893d4-plugins-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:11:02.846569 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.846523    2573 generic.go:356] "Generic (PLEG): container finished" podID="d3678736-c8dd-4f31-b5b2-300fae6893d4" containerID="46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c" exitCode=0
Sep 11 13:11:02.847002 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.846587    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"
Sep 11 13:11:02.847002 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.846613    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst" event={"ID":"d3678736-c8dd-4f31-b5b2-300fae6893d4","Type":"ContainerDied","Data":"46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c"}
Sep 11 13:11:02.847002 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.846667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst" event={"ID":"d3678736-c8dd-4f31-b5b2-300fae6893d4","Type":"ContainerDied","Data":"72d013ae61a031b2fd03a7a30cdd00b660a655af0780af23a58ea635f3cb19c7"}
Sep 11 13:11:02.847002 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.846696    2573 scope.go:117] "RemoveContainer" containerID="46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c"
Sep 11 13:11:02.859246 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.859223    2573 scope.go:117] "RemoveContainer" containerID="46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c"
Sep 11 13:11:02.859708 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:11:02.859686    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c\": container with ID starting with 46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c not found: ID does not exist" containerID="46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c"
Sep 11 13:11:02.859798 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.859719    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c"} err="failed to get container status \"46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c\": rpc error: code = NotFound desc = could not find container \"46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c\": container with ID starting with 46c46aa0f4f82ef79ccd6b539dce0ddb58ff681c0a3b904a0281765ff6dde13c not found: ID does not exist"
Sep 11 13:11:02.864614 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.864589    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"]
Sep 11 13:11:02.871415 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:02.871395    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f27fde90-6ddf97d769-n9fst"]
Sep 11 13:11:04.518270 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:04.518232    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3678736-c8dd-4f31-b5b2-300fae6893d4" path="/var/lib/kubelet/pods/d3678736-c8dd-4f31-b5b2-300fae6893d4/volumes"
Sep 11 13:11:06.107544 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:06.107495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:10.413495 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:10.413453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:20.404298 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:20.404261    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:11:36.422292 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:36.422257    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:11:46.639048 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:46.639008    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:48.151057 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:48.151018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:51.709353 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:51.709312    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:11:53.781724 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:53.781681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:53.852323 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:53.852290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:54.063052 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:54.063018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:55.383014 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:55.382977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:55.464083 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:55.464040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:55.565662 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:55.565629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:56.159521 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:56.159487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:56.340672 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:56.340642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:56.495974 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:56.495883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:11:57.635460 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:11:57.635427    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:02.649601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:02.649565    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:12:02.657789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:02.657763    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:12:02.658879 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:02.658853    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:12:02.662020 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:02.661999    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:12:02.751978 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:02.751935    2573 scope.go:117] "RemoveContainer" containerID="2b684ef6d68dab2b0446ed51eed9d62ebc40a4ab1631ac175ad225e351510805"
Sep 11 13:12:04.110340 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:04.110296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:04.240715 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:04.240679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:04.854881 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:04.854848    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:10.850741 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:10.850689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:10.962505 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:10.962465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:11.036595 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:11.036563    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:12:11.050850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:11.050815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:17.391835 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:17.391803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:18.593007 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:18.592970    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"]
Sep 11 13:12:18.612002 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:18.611956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:21.532396 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:21.532356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:21.745640 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:21.745603    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:23.009789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:23.009753    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:12:29.207205 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.207109    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"]
Sep 11 13:12:29.207575 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.207541    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3678736-c8dd-4f31-b5b2-300fae6893d4" containerName="payload-processing"
Sep 11 13:12:29.207575 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.207554    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3678736-c8dd-4f31-b5b2-300fae6893d4" containerName="payload-processing"
Sep 11 13:12:29.207655 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.207625    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3678736-c8dd-4f31-b5b2-300fae6893d4" containerName="payload-processing"
Sep 11 13:12:29.212052 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.212030    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.214965 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.214940    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"default-dockercfg-9rsc5\""
Sep 11 13:12:29.215111 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.214979    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"kube-root-ca.crt\""
Sep 11 13:12:29.215111 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.214940    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"openshift-service-ca.crt\""
Sep 11 13:12:29.215111 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.214938    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"sub-test-model-d4b0b9-kserve-self-signed-certs\""
Sep 11 13:12:29.225451 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.225424    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"]
Sep 11 13:12:29.246479 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.246443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-dshm\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.246643 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.246485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tls-certs\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.246643 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.246532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tmp-dir\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.246643 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.246601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-model-cache\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.246812 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.246667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npr8b\" (UniqueName: \"kubernetes.io/projected/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-kube-api-access-npr8b\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.246812 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.246711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-home\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.259688 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.259663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:29.347875 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.347839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-home\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.348048 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.347904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-dshm\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.348048 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.347936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tls-certs\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.348048 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.347997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tmp-dir\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.348048 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.348023    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-model-cache\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.348304 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.348150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npr8b\" (UniqueName: \"kubernetes.io/projected/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-kube-api-access-npr8b\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.348363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.348318    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-home\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.348463 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.348435    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-model-cache\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.348463 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.348455    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tmp-dir\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.350445 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.350423    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-dshm\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.350744 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.350722    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tls-certs\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.362741 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.362721    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npr8b\" (UniqueName: \"kubernetes.io/projected/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-kube-api-access-npr8b\") pod \"sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.521857 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.521770    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:29.799652 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:29.799624    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"]
Sep 11 13:12:29.801183 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:12:29.801136    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod614c95d9_f6e5_4067_b5f0_5e6bb2ce46b1.slice/crio-2a02846adf4000045fb2ac07c1495e5a079e16a58682cd58707fc25c5865c996 WatchSource:0}: Error finding container 2a02846adf4000045fb2ac07c1495e5a079e16a58682cd58707fc25c5865c996: Status 404 returned error can't find the container with id 2a02846adf4000045fb2ac07c1495e5a079e16a58682cd58707fc25c5865c996
Sep 11 13:12:30.349840 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:30.349742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9" event={"ID":"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1","Type":"ContainerStarted","Data":"479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6"}
Sep 11 13:12:30.349840 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:30.349797    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9" event={"ID":"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1","Type":"ContainerStarted","Data":"2a02846adf4000045fb2ac07c1495e5a079e16a58682cd58707fc25c5865c996"}
Sep 11 13:12:30.369466 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:30.369413    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9" podStartSLOduration=1.369397359 podStartE2EDuration="1.369397359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:12:30.366142868 +0000 UTC m=+1528.440605633" watchObservedRunningTime="2026-09-11 13:12:30.369397359 +0000 UTC m=+1528.443860123"
Sep 11 13:12:33.613639 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:33.613596    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc" podUID="160d44b1-70ce-4b0c-b97b-690c9f6e6be8" containerName="main" containerID="cri-o://f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392" gracePeriod=45
Sep 11 13:12:33.813822 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:33.813784    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:12:33.869002 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:33.868937    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:12:34.004571 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.004527    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tls-certs\") pod \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") "
Sep 11 13:12:34.004571 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.004573    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc7vc\" (UniqueName: \"kubernetes.io/projected/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-kube-api-access-zc7vc\") pod \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") "
Sep 11 13:12:34.004838 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.004700    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-home\") pod \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") "
Sep 11 13:12:34.004838 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.004722    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tmp-dir\") pod \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") "
Sep 11 13:12:34.004838 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.004745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-dshm\") pod \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") "
Sep 11 13:12:34.004838 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.004771    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-model-cache\") pod \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\" (UID: \"160d44b1-70ce-4b0c-b97b-690c9f6e6be8\") "
Sep 11 13:12:34.005062 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.004948    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-home" (OuterVolumeSpecName: "home") pod "160d44b1-70ce-4b0c-b97b-690c9f6e6be8" (UID: "160d44b1-70ce-4b0c-b97b-690c9f6e6be8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:34.005062 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.004965    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "160d44b1-70ce-4b0c-b97b-690c9f6e6be8" (UID: "160d44b1-70ce-4b0c-b97b-690c9f6e6be8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:34.005200 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.005120    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-model-cache" (OuterVolumeSpecName: "model-cache") pod "160d44b1-70ce-4b0c-b97b-690c9f6e6be8" (UID: "160d44b1-70ce-4b0c-b97b-690c9f6e6be8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:34.005200 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.005127    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:12:34.005200 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.005147    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:12:34.007042 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.007009    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-kube-api-access-zc7vc" (OuterVolumeSpecName: "kube-api-access-zc7vc") pod "160d44b1-70ce-4b0c-b97b-690c9f6e6be8" (UID: "160d44b1-70ce-4b0c-b97b-690c9f6e6be8"). InnerVolumeSpecName "kube-api-access-zc7vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:34.007042 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.007031    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-dshm" (OuterVolumeSpecName: "dshm") pod "160d44b1-70ce-4b0c-b97b-690c9f6e6be8" (UID: "160d44b1-70ce-4b0c-b97b-690c9f6e6be8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:34.007292 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.007069    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "160d44b1-70ce-4b0c-b97b-690c9f6e6be8" (UID: "160d44b1-70ce-4b0c-b97b-690c9f6e6be8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:12:34.106085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.106050    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:12:34.106085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.106081    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:12:34.106085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.106090    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc7vc\" (UniqueName: \"kubernetes.io/projected/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-kube-api-access-zc7vc\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:12:34.106365 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.106099    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/160d44b1-70ce-4b0c-b97b-690c9f6e6be8-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:12:34.375881 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.375845    2573 generic.go:356] "Generic (PLEG): container finished" podID="160d44b1-70ce-4b0c-b97b-690c9f6e6be8" containerID="f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392" exitCode=0
Sep 11 13:12:34.376085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.375889    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc" event={"ID":"160d44b1-70ce-4b0c-b97b-690c9f6e6be8","Type":"ContainerDied","Data":"f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392"}
Sep 11 13:12:34.376085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.375892    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"
Sep 11 13:12:34.376085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.375940    2573 scope.go:117] "RemoveContainer" containerID="f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392"
Sep 11 13:12:34.376085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.375927    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc" event={"ID":"160d44b1-70ce-4b0c-b97b-690c9f6e6be8","Type":"ContainerDied","Data":"a10ea0fb5f257884ca85272d73ca6e637636b2f7a706094b80ee9fc44f541fcc"}
Sep 11 13:12:34.386306 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.386289    2573 scope.go:117] "RemoveContainer" containerID="f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392"
Sep 11 13:12:34.386566 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:12:34.386541    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392\": container with ID starting with f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392 not found: ID does not exist" containerID="f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392"
Sep 11 13:12:34.386623 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.386574    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392"} err="failed to get container status \"f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392\": rpc error: code = NotFound desc = could not find container \"f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392\": container with ID starting with f2c3583e382a850c5401cf9bdcfadae973f224301e52a981257b1eb1455ff392 not found: ID does not exist"
Sep 11 13:12:34.400679 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.400648    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"]
Sep 11 13:12:34.403148 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.403121    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/auth-test-model-2e7f38-kserve-6c449769cf-h6kqc"]
Sep 11 13:12:34.519347 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:34.519312    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160d44b1-70ce-4b0c-b97b-690c9f6e6be8" path="/var/lib/kubelet/pods/160d44b1-70ce-4b0c-b97b-690c9f6e6be8/volumes"
Sep 11 13:12:39.522594 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:39.522551    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:39.522594 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:39.522605    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:39.535071 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:39.535045    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:40.422841 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:40.422802    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:12:42.732653 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:42.732610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:48.601735 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:48.601691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:48.678998 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:48.678954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:48.964331 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:48.964232    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:49.291349 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:49.291315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:49.427770 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:49.427736    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:52.444461 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:52.444424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:52.541923 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:52.541872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:53.663844 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:53.663808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:53.766033 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:53.765994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:54.138793 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:54.138753    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:54.261872 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:54.261835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:54.364143 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:54.364111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:57.496603 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:57.496567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:12:57.552643 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:12:57.552610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:02.747902 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:02.747860    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:13:06.411461 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.411418    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"]
Sep 11 13:13:06.412017 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.411996    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160d44b1-70ce-4b0c-b97b-690c9f6e6be8" containerName="main"
Sep 11 13:13:06.412103 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.412020    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="160d44b1-70ce-4b0c-b97b-690c9f6e6be8" containerName="main"
Sep 11 13:13:06.412160 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.412152    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="160d44b1-70ce-4b0c-b97b-690c9f6e6be8" containerName="main"
Sep 11 13:13:06.415342 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.415322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.417576 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.417557    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"openshift-service-ca.crt\""
Sep 11 13:13:06.419244 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.419224    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"kube-root-ca.crt\""
Sep 11 13:13:06.419336 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.419254    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"default-dockercfg-9sghz\""
Sep 11 13:13:06.419389 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.419338    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"sub-test-model-2e7f38-kserve-self-signed-certs\""
Sep 11 13:13:06.426705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.426681    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"]
Sep 11 13:13:06.501861 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.501828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:06.518765 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.518727    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-home\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.518927 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.518775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-model-cache\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.518927 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.518847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tls-certs\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.518927 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.518899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-dshm\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.519122 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.518948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tmp-dir\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.519122 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.519034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvbcq\" (UniqueName: \"kubernetes.io/projected/2e9a722d-86aa-4915-b5f7-e274d7863ccb-kube-api-access-cvbcq\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.620485 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tmp-dir\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.620657 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvbcq\" (UniqueName: \"kubernetes.io/projected/2e9a722d-86aa-4915-b5f7-e274d7863ccb-kube-api-access-cvbcq\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.620657 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-home\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.620657 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-model-cache\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.620657 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tls-certs\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.620657 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-dshm\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.620935 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tmp-dir\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.620935 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620900    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-model-cache\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.621056 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.620943    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-home\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.623086 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.623062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-dshm\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.623311 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.623295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tls-certs\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.629645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.629626    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvbcq\" (UniqueName: \"kubernetes.io/projected/2e9a722d-86aa-4915-b5f7-e274d7863ccb-kube-api-access-cvbcq\") pod \"sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:06.725418 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:06.725319    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:07.004826 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:07.004802    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"]
Sep 11 13:13:07.006938 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:13:07.006909    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e9a722d_86aa_4915_b5f7_e274d7863ccb.slice/crio-5df1c6ca3deb244d5c7476bc519d7d8c3933bc95f11deefbba0ebab6b8973d81 WatchSource:0}: Error finding container 5df1c6ca3deb244d5c7476bc519d7d8c3933bc95f11deefbba0ebab6b8973d81: Status 404 returned error can't find the container with id 5df1c6ca3deb244d5c7476bc519d7d8c3933bc95f11deefbba0ebab6b8973d81
Sep 11 13:13:07.576432 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:07.576394    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq" event={"ID":"2e9a722d-86aa-4915-b5f7-e274d7863ccb","Type":"ContainerStarted","Data":"e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc"}
Sep 11 13:13:07.576862 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:07.576445    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq" event={"ID":"2e9a722d-86aa-4915-b5f7-e274d7863ccb","Type":"ContainerStarted","Data":"5df1c6ca3deb244d5c7476bc519d7d8c3933bc95f11deefbba0ebab6b8973d81"}
Sep 11 13:13:07.595753 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:07.595699    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq" podStartSLOduration=1.5956858779999998 podStartE2EDuration="1.595685878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:07.59322532 +0000 UTC m=+1565.667688086" watchObservedRunningTime="2026-09-11 13:13:07.595685878 +0000 UTC m=+1565.670148641"
Sep 11 13:13:16.725814 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:16.725778    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:16.726442 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:16.725832    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:16.738596 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:16.738573    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:16.763858 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:16.763824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:17.450028 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:17.449993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:17.647789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:17.647755    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:13:17.914221 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:17.914159    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:18.233026 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:18.232944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:18.440095 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:18.440046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:20.302209 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:20.302159    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:13:21.630112 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:21.630046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:21.713434 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:21.713401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:22.799557 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.799522    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"]
Sep 11 13:13:22.803245 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.803218    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.806446 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.806139    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:13:22.806446 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.806133    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ccae06-serving-cert\""
Sep 11 13:13:22.806446 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.806420    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2t5gt\""
Sep 11 13:13:22.806745 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.806710    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:13:22.806957 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.806809    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:13:22.813992 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.813969    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"]
Sep 11 13:13:22.842831 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.842798    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:22.879708 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.879679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-metrics-certs\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.879861 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.879725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-openshift-service-ca\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.879861 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.879819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.879980 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.879885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fsxk\" (UniqueName: \"kubernetes.io/projected/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-kube-api-access-8fsxk\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.941348 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.941313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:22.980617 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.980583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-metrics-certs\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.980780 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.980632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-openshift-service-ca\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.980780 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.980665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.980780 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.980699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fsxk\" (UniqueName: \"kubernetes.io/projected/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-kube-api-access-8fsxk\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.980956 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:13:22.980835    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-serving-cert: secret "maas-api-e2e-api-b-ccae06-serving-cert" not found
Sep 11 13:13:22.980956 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:13:22.980909    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls podName:adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2 nodeName:}" failed. No retries permitted until 2026-09-11 13:13:23.48088798 +0000 UTC m=+1581.555350728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls") pod "maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b" (UID: "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2") : secret "maas-api-e2e-api-b-ccae06-serving-cert" not found
Sep 11 13:13:22.981391 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.981373    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-openshift-service-ca\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.983257 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.983239    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-metrics-certs\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:22.989152 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:22.989128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fsxk\" (UniqueName: \"kubernetes.io/projected/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-kube-api-access-8fsxk\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:23.173117 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:23.173030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:23.338827 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:23.338792    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:23.433781 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:23.433673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:23.486465 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:23.486430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:23.488941 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:23.488923    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls\") pod \"maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:23.719062 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:23.718961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:23.992865 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:23.992839    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"]
Sep 11 13:13:23.994522 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:13:23.994495    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc0a8a5_3acc_4df0_8b78_30c3a10e1cc2.slice/crio-a886974832160178931d4c3fb5f64ffc81e0ca2b3fa9fd02c8ac4d7a1c821459 WatchSource:0}: Error finding container a886974832160178931d4c3fb5f64ffc81e0ca2b3fa9fd02c8ac4d7a1c821459: Status 404 returned error can't find the container with id a886974832160178931d4c3fb5f64ffc81e0ca2b3fa9fd02c8ac4d7a1c821459
Sep 11 13:13:24.679069 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:24.678975    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b" event={"ID":"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2","Type":"ContainerStarted","Data":"ea65cef55432daa4d2bd973cf32395b75dfcd81d27a71dbad1e46bed92ddefd1"}
Sep 11 13:13:24.679069 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:24.679033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b" event={"ID":"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2","Type":"ContainerStarted","Data":"a886974832160178931d4c3fb5f64ffc81e0ca2b3fa9fd02c8ac4d7a1c821459"}
Sep 11 13:13:24.679302 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:24.679135    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:24.697805 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:24.697750    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b" podStartSLOduration=2.332119735 podStartE2EDuration="2.697732737s" totalImagesPullingTime="365.613002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:24.69544257 +0000 UTC m=+1582.769905334" watchObservedRunningTime="2026-09-11 13:13:24.697732737 +0000 UTC m=+1582.772195501"
Sep 11 13:13:30.690099 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:30.690071    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:13:31.575618 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:31.575574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:40.712743 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:40.712699    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:13:46.653899 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:46.653860    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:48.241047 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:48.241004    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:49.670114 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:49.670075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:55.614803 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:55.614726    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:13:59.721725 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:13:59.721686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:02.800247 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:02.800213    2573 scope.go:117] "RemoveContainer" containerID="d7c15ef5c4167cfd10f5260b9ce0e3cc24d514c8125e6dff7e064cd47672e3b5"
Sep 11 13:14:02.809257 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:02.809238    2573 scope.go:117] "RemoveContainer" containerID="6bca1a38cf658f1c856f3029e3e46fe36eac803d2f84eb6093278bff6a117b10"
Sep 11 13:14:05.526604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:05.526555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:05.638072 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:05.638028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:05.727163 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:05.727131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:05.801163 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:05.801125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:06.163253 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:06.163149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:11.108631 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:11.108597    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:14:12.872910 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:12.872877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:13.055648 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:13.055614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:13.189962 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:13.189874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:13.647524 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:13.647482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:24.255461 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:24.255419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:29.937114 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:29.937079    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"]
Sep 11 13:14:29.937564 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:29.937394    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b" podUID="adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" containerName="maas-api" containerID="cri-o://ea65cef55432daa4d2bd973cf32395b75dfcd81d27a71dbad1e46bed92ddefd1" gracePeriod=30
Sep 11 13:14:29.960853 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:29.960794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:30.039272 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.039241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:30.066142 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.066104    2573 generic.go:356] "Generic (PLEG): container finished" podID="adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" containerID="ea65cef55432daa4d2bd973cf32395b75dfcd81d27a71dbad1e46bed92ddefd1" exitCode=0
Sep 11 13:14:30.066357 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.066165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b" event={"ID":"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2","Type":"ContainerDied","Data":"ea65cef55432daa4d2bd973cf32395b75dfcd81d27a71dbad1e46bed92ddefd1"}
Sep 11 13:14:30.105376 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.105339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:30.187800 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.187707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:30.194079 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.194058    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:14:30.224999 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.224967    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-openshift-service-ca\") pod \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") "
Sep 11 13:14:30.225164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.225056    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls\") pod \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") "
Sep 11 13:14:30.225164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.225080    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-metrics-certs\") pod \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") "
Sep 11 13:14:30.225164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.225110    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fsxk\" (UniqueName: \"kubernetes.io/projected/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-kube-api-access-8fsxk\") pod \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\" (UID: \"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2\") "
Sep 11 13:14:30.225407 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.225385    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" (UID: "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:30.227392 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.227369    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" (UID: "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:14:30.227853 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.227824    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-kube-api-access-8fsxk" (OuterVolumeSpecName: "kube-api-access-8fsxk") pod "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" (UID: "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2"). InnerVolumeSpecName "kube-api-access-8fsxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:30.227853 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.227836    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" (UID: "adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:14:30.250350 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.250319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:30.326739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.326711    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-maas-api-tls\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:14:30.326739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.326738    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-metrics-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:14:30.326739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.326747    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fsxk\" (UniqueName: \"kubernetes.io/projected/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-kube-api-access-8fsxk\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:14:30.327022 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.326757    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2-openshift-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:14:30.560011 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:30.559976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:31.073607 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:31.073577    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"
Sep 11 13:14:31.074096 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:31.073610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b" event={"ID":"adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2","Type":"ContainerDied","Data":"a886974832160178931d4c3fb5f64ffc81e0ca2b3fa9fd02c8ac4d7a1c821459"}
Sep 11 13:14:31.074096 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:31.073677    2573 scope.go:117] "RemoveContainer" containerID="ea65cef55432daa4d2bd973cf32395b75dfcd81d27a71dbad1e46bed92ddefd1"
Sep 11 13:14:31.090094 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:31.090068    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"]
Sep 11 13:14:31.095843 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:31.095821    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ccae06-6c88877f47-qwm6b"]
Sep 11 13:14:32.524455 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:32.524421    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" path="/var/lib/kubelet/pods/adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2/volumes"
Sep 11 13:14:36.362219 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:36.362150    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:36.442904 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:36.442844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:36.670211 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:36.670081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:37.242447 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:37.242413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:40.404322 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:40.404290    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:14:47.429035 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:47.428999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:47.636888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:47.636851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:47.735405 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:47.735316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:47.842011 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:47.841968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:47.923146 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:47.923084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:48.016288 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:48.016193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:48.296084 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:48.296050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:49.822898 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:49.822860    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"]
Sep 11 13:14:49.859771 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:49.859741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:50.919462 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:50.919427    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"]
Sep 11 13:14:50.982499 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:50.982464    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:54.794272 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:54.794227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:54.897838 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:54.897789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:55.082842 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:55.082728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:55.600341 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:55.600305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:58.440447 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:58.440409    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:14:59.913382 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:14:59.913346    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:15:00.237656 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.237576    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz"]
Sep 11 13:15:00.237973 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.237961    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" containerName="maas-api"
Sep 11 13:15:00.238020 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.237975    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" containerName="maas-api"
Sep 11 13:15:00.238074 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.238065    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc0a8a5-3acc-4df0-8b78-30c3a10e1cc2" containerName="maas-api"
Sep 11 13:15:00.241507 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.241482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz"
Sep 11 13:15:00.251603 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.251582    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:15:00.251708 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.251654    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz"
Sep 11 13:15:00.267948 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.267924    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"]
Sep 11 13:15:00.272593 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.272569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"
Sep 11 13:15:00.313881 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.313852    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz"]
Sep 11 13:15:00.317186 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.317146    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"]
Sep 11 13:15:00.321437 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.321165    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"
Sep 11 13:15:00.552848 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.552821    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz"]
Sep 11 13:15:00.555051 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:15:00.555011    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3f81e6_bcb7_4868_aa71_26d001981024.slice/crio-37d15e42ff18c4245b06bcc09d24b8e12d365a650ffebd9026d4bd2bdb184d08 WatchSource:0}: Error finding container 37d15e42ff18c4245b06bcc09d24b8e12d365a650ffebd9026d4bd2bdb184d08: Status 404 returned error can't find the container with id 37d15e42ff18c4245b06bcc09d24b8e12d365a650ffebd9026d4bd2bdb184d08
Sep 11 13:15:00.621599 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:00.621574    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"]
Sep 11 13:15:00.623265 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:15:00.623241    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8bdaae_5260_4bd8_b1f8_fe7b74cb3c31.slice/crio-1cd4844e7991c8c616d3ffb620c71c8410f1a54d8cebc84feeb873750d3ab9cb WatchSource:0}: Error finding container 1cd4844e7991c8c616d3ffb620c71c8410f1a54d8cebc84feeb873750d3ab9cb: Status 404 returned error can't find the container with id 1cd4844e7991c8c616d3ffb620c71c8410f1a54d8cebc84feeb873750d3ab9cb
Sep 11 13:15:01.255850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:01.255752    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp" event={"ID":"de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31","Type":"ContainerStarted","Data":"175b0e3c9cc2e4d218101699448739e2357b4908ab4f1804134fcc008e6fccd6"}
Sep 11 13:15:01.255850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:01.255828    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp" event={"ID":"de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31","Type":"ContainerStarted","Data":"1cd4844e7991c8c616d3ffb620c71c8410f1a54d8cebc84feeb873750d3ab9cb"}
Sep 11 13:15:01.257647 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:01.257621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz" event={"ID":"6a3f81e6-bcb7-4868-aa71-26d001981024","Type":"ContainerStarted","Data":"f3947704cba582328e576169e05108038da318d1227fe1be34eb391423155bfe"}
Sep 11 13:15:01.257769 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:01.257664    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz" event={"ID":"6a3f81e6-bcb7-4868-aa71-26d001981024","Type":"ContainerStarted","Data":"37d15e42ff18c4245b06bcc09d24b8e12d365a650ffebd9026d4bd2bdb184d08"}
Sep 11 13:15:01.272866 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:01.272821    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp" podStartSLOduration=1.272806822 podStartE2EDuration="1.272806822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.27042254 +0000 UTC m=+1679.344885305" watchObservedRunningTime="2026-09-11 13:15:01.272806822 +0000 UTC m=+1679.347269586"
Sep 11 13:15:01.289075 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:01.289021    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz" podStartSLOduration=1.289007591 podStartE2EDuration="1.289007591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.286013432 +0000 UTC m=+1679.360476195" watchObservedRunningTime="2026-09-11 13:15:01.289007591 +0000 UTC m=+1679.363470354"
Sep 11 13:15:02.265741 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:02.265704    2573 generic.go:356] "Generic (PLEG): container finished" podID="de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31" containerID="175b0e3c9cc2e4d218101699448739e2357b4908ab4f1804134fcc008e6fccd6" exitCode=0
Sep 11 13:15:02.266216 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:02.265752    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp" event={"ID":"de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31","Type":"ContainerDied","Data":"175b0e3c9cc2e4d218101699448739e2357b4908ab4f1804134fcc008e6fccd6"}
Sep 11 13:15:02.267572 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:02.267544    2573 generic.go:356] "Generic (PLEG): container finished" podID="6a3f81e6-bcb7-4868-aa71-26d001981024" containerID="f3947704cba582328e576169e05108038da318d1227fe1be34eb391423155bfe" exitCode=0
Sep 11 13:15:02.267690 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:02.267632    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz" event={"ID":"6a3f81e6-bcb7-4868-aa71-26d001981024","Type":"ContainerDied","Data":"f3947704cba582328e576169e05108038da318d1227fe1be34eb391423155bfe"}
Sep 11 13:15:03.429475 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:03.429452    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"
Sep 11 13:15:03.431437 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:03.431421    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz"
Sep 11 13:15:04.280040 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:04.280006    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"
Sep 11 13:15:04.280259 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:04.280008    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp" event={"ID":"de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31","Type":"ContainerDied","Data":"1cd4844e7991c8c616d3ffb620c71c8410f1a54d8cebc84feeb873750d3ab9cb"}
Sep 11 13:15:04.280259 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:04.280149    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cd4844e7991c8c616d3ffb620c71c8410f1a54d8cebc84feeb873750d3ab9cb"
Sep 11 13:15:04.281429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:04.281405    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz"
Sep 11 13:15:04.281532 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:04.281449    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-bvhsz" event={"ID":"6a3f81e6-bcb7-4868-aa71-26d001981024","Type":"ContainerDied","Data":"37d15e42ff18c4245b06bcc09d24b8e12d365a650ffebd9026d4bd2bdb184d08"}
Sep 11 13:15:04.281532 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:04.281508    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37d15e42ff18c4245b06bcc09d24b8e12d365a650ffebd9026d4bd2bdb184d08"
Sep 11 13:15:04.842835 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:04.842797    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9" podUID="614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" containerName="main" containerID="cri-o://479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6" gracePeriod=45
Sep 11 13:15:05.126466 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.126439    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:15:05.169649 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.169619    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-home\") pod \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") "
Sep 11 13:15:05.169829 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.169681    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-model-cache\") pod \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") "
Sep 11 13:15:05.169829 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.169737    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tls-certs\") pod \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") "
Sep 11 13:15:05.169829 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.169763    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npr8b\" (UniqueName: \"kubernetes.io/projected/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-kube-api-access-npr8b\") pod \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") "
Sep 11 13:15:05.170020 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.169979    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" (UID: "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:05.170118 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.170099    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tmp-dir\") pod \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") "
Sep 11 13:15:05.170207 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.170163    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-dshm\") pod \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\" (UID: \"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1\") "
Sep 11 13:15:05.170272 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.170207    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-home" (OuterVolumeSpecName: "home") pod "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" (UID: "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:05.170361 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.170340    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" (UID: "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:05.170850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.170748    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:05.170850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.170775    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:05.170850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.170790    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:05.172396 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.172374    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" (UID: "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:15:05.172485 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.172391    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-kube-api-access-npr8b" (OuterVolumeSpecName: "kube-api-access-npr8b") pod "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" (UID: "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1"). InnerVolumeSpecName "kube-api-access-npr8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:05.172615 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.172595    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-dshm" (OuterVolumeSpecName: "dshm") pod "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" (UID: "614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:05.271859 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.271823    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:05.271859 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.271853    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npr8b\" (UniqueName: \"kubernetes.io/projected/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-kube-api-access-npr8b\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:05.271859 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.271862    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:05.288363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.288323    2573 generic.go:356] "Generic (PLEG): container finished" podID="614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" containerID="479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6" exitCode=0
Sep 11 13:15:05.288553 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.288368    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"
Sep 11 13:15:05.288553 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.288408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9" event={"ID":"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1","Type":"ContainerDied","Data":"479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6"}
Sep 11 13:15:05.288553 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.288449    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9" event={"ID":"614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1","Type":"ContainerDied","Data":"2a02846adf4000045fb2ac07c1495e5a079e16a58682cd58707fc25c5865c996"}
Sep 11 13:15:05.288553 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.288466    2573 scope.go:117] "RemoveContainer" containerID="479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6"
Sep 11 13:15:05.298614 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.298587    2573 scope.go:117] "RemoveContainer" containerID="479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6"
Sep 11 13:15:05.298874 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:15:05.298857    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6\": container with ID starting with 479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6 not found: ID does not exist" containerID="479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6"
Sep 11 13:15:05.298932 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.298884    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6"} err="failed to get container status \"479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6\": rpc error: code = NotFound desc = could not find container \"479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6\": container with ID starting with 479341c3e89fd87238c83666bb409ae476adaa8ce495e731d0242532127f20e6 not found: ID does not exist"
Sep 11 13:15:05.316650 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.316623    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"]
Sep 11 13:15:05.333764 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.333734    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/sub-test-model-d4b0b9-kserve-7fd5b88c89-4f8p9"]
Sep 11 13:15:05.938921 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:05.938876    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq" podUID="2e9a722d-86aa-4915-b5f7-e274d7863ccb" containerName="main" containerID="cri-o://e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc" gracePeriod=45
Sep 11 13:15:06.198018 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.197948    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:15:06.282467 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.282438    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tls-certs\") pod \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") "
Sep 11 13:15:06.282640 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.282498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tmp-dir\") pod \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") "
Sep 11 13:15:06.282640 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.282542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-home\") pod \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") "
Sep 11 13:15:06.282640 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.282594    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvbcq\" (UniqueName: \"kubernetes.io/projected/2e9a722d-86aa-4915-b5f7-e274d7863ccb-kube-api-access-cvbcq\") pod \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") "
Sep 11 13:15:06.282640 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.282637    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-dshm\") pod \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") "
Sep 11 13:15:06.282933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.282697    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-model-cache\") pod \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\" (UID: \"2e9a722d-86aa-4915-b5f7-e274d7863ccb\") "
Sep 11 13:15:06.282933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.282887    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e9a722d-86aa-4915-b5f7-e274d7863ccb" (UID: "2e9a722d-86aa-4915-b5f7-e274d7863ccb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:06.282933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.282896    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-home" (OuterVolumeSpecName: "home") pod "2e9a722d-86aa-4915-b5f7-e274d7863ccb" (UID: "2e9a722d-86aa-4915-b5f7-e274d7863ccb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:06.283116 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.283087    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e9a722d-86aa-4915-b5f7-e274d7863ccb" (UID: "2e9a722d-86aa-4915-b5f7-e274d7863ccb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:06.283198 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.283103    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:06.283198 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.283153    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:06.284820 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.284800    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-dshm" (OuterVolumeSpecName: "dshm") pod "2e9a722d-86aa-4915-b5f7-e274d7863ccb" (UID: "2e9a722d-86aa-4915-b5f7-e274d7863ccb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:06.284913 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.284893    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e9a722d-86aa-4915-b5f7-e274d7863ccb-kube-api-access-cvbcq" (OuterVolumeSpecName: "kube-api-access-cvbcq") pod "2e9a722d-86aa-4915-b5f7-e274d7863ccb" (UID: "2e9a722d-86aa-4915-b5f7-e274d7863ccb"). InnerVolumeSpecName "kube-api-access-cvbcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:06.284913 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.284900    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e9a722d-86aa-4915-b5f7-e274d7863ccb" (UID: "2e9a722d-86aa-4915-b5f7-e274d7863ccb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:15:06.297054 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.297029    2573 generic.go:356] "Generic (PLEG): container finished" podID="2e9a722d-86aa-4915-b5f7-e274d7863ccb" containerID="e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc" exitCode=0
Sep 11 13:15:06.297152 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.297069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq" event={"ID":"2e9a722d-86aa-4915-b5f7-e274d7863ccb","Type":"ContainerDied","Data":"e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc"}
Sep 11 13:15:06.297152 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.297071    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"
Sep 11 13:15:06.297152 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.297104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq" event={"ID":"2e9a722d-86aa-4915-b5f7-e274d7863ccb","Type":"ContainerDied","Data":"5df1c6ca3deb244d5c7476bc519d7d8c3933bc95f11deefbba0ebab6b8973d81"}
Sep 11 13:15:06.297152 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.297121    2573 scope.go:117] "RemoveContainer" containerID="e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc"
Sep 11 13:15:06.306205 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.306163    2573 scope.go:117] "RemoveContainer" containerID="e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc"
Sep 11 13:15:06.306476 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:15:06.306453    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc\": container with ID starting with e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc not found: ID does not exist" containerID="e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc"
Sep 11 13:15:06.306543 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.306484    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc"} err="failed to get container status \"e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc\": rpc error: code = NotFound desc = could not find container \"e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc\": container with ID starting with e22097582ad7a907fa062f6ece9b512fd50447bcbc7f6f1d15edaac77d8d06dc not found: ID does not exist"
Sep 11 13:15:06.340759 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.340732    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"]
Sep 11 13:15:06.359898 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.359870    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/sub-test-model-2e7f38-kserve-6b9bf577c7-rgglq"]
Sep 11 13:15:06.383737 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.383709    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:06.383737 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.383736    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9a722d-86aa-4915-b5f7-e274d7863ccb-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:06.383909 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.383746    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvbcq\" (UniqueName: \"kubernetes.io/projected/2e9a722d-86aa-4915-b5f7-e274d7863ccb-kube-api-access-cvbcq\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:06.383909 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.383754    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9a722d-86aa-4915-b5f7-e274d7863ccb-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:06.517823 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.517749    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9a722d-86aa-4915-b5f7-e274d7863ccb" path="/var/lib/kubelet/pods/2e9a722d-86aa-4915-b5f7-e274d7863ccb/volumes"
Sep 11 13:15:06.518131 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.518117    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" path="/var/lib/kubelet/pods/614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1/volumes"
Sep 11 13:15:06.573873 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.573842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:06.645416 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.645386    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"]
Sep 11 13:15:06.645608 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.645586    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9" podUID="8ec0d41f-6198-44db-b0a9-18b696fbcd51" containerName="payload-processing" containerID="cri-o://1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99" gracePeriod=30
Sep 11 13:15:06.817928 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.817895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:06.876359 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.876332    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:15:06.892349 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.892327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ec0d41f-6198-44db-b0a9-18b696fbcd51-plugins-config-volume\") pod \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\" (UID: \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\") "
Sep 11 13:15:06.892457 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.892407    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khh4h\" (UniqueName: \"kubernetes.io/projected/8ec0d41f-6198-44db-b0a9-18b696fbcd51-kube-api-access-khh4h\") pod \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\" (UID: \"8ec0d41f-6198-44db-b0a9-18b696fbcd51\") "
Sep 11 13:15:06.892666 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.892642    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec0d41f-6198-44db-b0a9-18b696fbcd51-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ec0d41f-6198-44db-b0a9-18b696fbcd51" (UID: "8ec0d41f-6198-44db-b0a9-18b696fbcd51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:15:06.894549 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.894525    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec0d41f-6198-44db-b0a9-18b696fbcd51-kube-api-access-khh4h" (OuterVolumeSpecName: "kube-api-access-khh4h") pod "8ec0d41f-6198-44db-b0a9-18b696fbcd51" (UID: "8ec0d41f-6198-44db-b0a9-18b696fbcd51"). InnerVolumeSpecName "kube-api-access-khh4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:06.970650 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.970612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:06.993720 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.993683    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ec0d41f-6198-44db-b0a9-18b696fbcd51-plugins-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:06.993720 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:06.993712    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khh4h\" (UniqueName: \"kubernetes.io/projected/8ec0d41f-6198-44db-b0a9-18b696fbcd51-kube-api-access-khh4h\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:07.089022 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.088942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:07.199213 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.199151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:07.303828 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.303792    2573 generic.go:356] "Generic (PLEG): container finished" podID="8ec0d41f-6198-44db-b0a9-18b696fbcd51" containerID="1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99" exitCode=0
Sep 11 13:15:07.304005 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.303836    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"
Sep 11 13:15:07.304005 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.303886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9" event={"ID":"8ec0d41f-6198-44db-b0a9-18b696fbcd51","Type":"ContainerDied","Data":"1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99"}
Sep 11 13:15:07.304005 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.303983    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9" event={"ID":"8ec0d41f-6198-44db-b0a9-18b696fbcd51","Type":"ContainerDied","Data":"22d17cb86577e093efc692435b7bf1846b3ddafeadb98b147063ae164ac328a4"}
Sep 11 13:15:07.304242 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.304018    2573 scope.go:117] "RemoveContainer" containerID="1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99"
Sep 11 13:15:07.314122 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.314105    2573 scope.go:117] "RemoveContainer" containerID="1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99"
Sep 11 13:15:07.314420 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:15:07.314403    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99\": container with ID starting with 1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99 not found: ID does not exist" containerID="1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99"
Sep 11 13:15:07.314496 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.314427    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99"} err="failed to get container status \"1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99\": rpc error: code = NotFound desc = could not find container \"1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99\": container with ID starting with 1a5f8a136a0cbff8c0e73443b8d4032b974aade7a940d2a19fe40f51297b1a99 not found: ID does not exist"
Sep 11 13:15:07.331334 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.331304    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"]
Sep 11 13:15:07.338162 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.338141    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7c542a-6ccbc7c755-gkxr9"]
Sep 11 13:15:07.550531 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:07.550490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:08.517826 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:08.517793    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec0d41f-6198-44db-b0a9-18b696fbcd51" path="/var/lib/kubelet/pods/8ec0d41f-6198-44db-b0a9-18b696fbcd51/volumes"
Sep 11 13:15:10.217231 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:10.217194    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:15:13.607958 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:13.607921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:13.689876 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:13.689846    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:13.883266 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:13.883182    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"]
Sep 11 13:15:13.883486 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:13.883447    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy" containerID="cri-o://0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd" gracePeriod=30
Sep 11 13:15:13.910281 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:13.910225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:19.138045 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.138018    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:15:19.213387 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213309    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fe28c4-2026-4092-b62a-59b2424f4f7c-istiod-ca-cert\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213387 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213346    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-data\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213387 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213371    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-socket\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213393    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-envoy\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213425    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-token\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213456    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv6ww\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-kube-api-access-sv6ww\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213501    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-certs\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213569    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-podinfo\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213612    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-credential-socket\") pod \"59fe28c4-2026-4092-b62a-59b2424f4f7c\" (UID: \"59fe28c4-2026-4092-b62a-59b2424f4f7c\") "
Sep 11 13:15:19.213645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213623    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:19.213645 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213637    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-data" (OuterVolumeSpecName: "istio-data") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:19.213973 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.213735    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59fe28c4-2026-4092-b62a-59b2424f4f7c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:15:19.214420 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.214376    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:19.214420 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.214402    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:19.216222 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.214687    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fe28c4-2026-4092-b62a-59b2424f4f7c-istiod-ca-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.216222 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.214722    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-data\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.216222 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.214736    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-socket\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.223046 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.223019    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-token" (OuterVolumeSpecName: "istio-token") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:19.223046 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.223021    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:19.223752 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.223729    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-kube-api-access-sv6ww" (OuterVolumeSpecName: "kube-api-access-sv6ww") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "kube-api-access-sv6ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:19.224489 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.224455    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59fe28c4-2026-4092-b62a-59b2424f4f7c" (UID: "59fe28c4-2026-4092-b62a-59b2424f4f7c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:15:19.317047 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.317017    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-envoy\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.317047 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.317042    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-token\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.317047 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.317053    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv6ww\" (UniqueName: \"kubernetes.io/projected/59fe28c4-2026-4092-b62a-59b2424f4f7c-kube-api-access-sv6ww\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.317289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.317063    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-workload-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.317289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.317073    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fe28c4-2026-4092-b62a-59b2424f4f7c-istio-podinfo\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.317289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.317081    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fe28c4-2026-4092-b62a-59b2424f4f7c-credential-socket\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:15:19.379498 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.379466    2573 generic.go:356] "Generic (PLEG): container finished" podID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerID="0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd" exitCode=0
Sep 11 13:15:19.379641 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.379520    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" event={"ID":"59fe28c4-2026-4092-b62a-59b2424f4f7c","Type":"ContainerDied","Data":"0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd"}
Sep 11 13:15:19.379641 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.379613    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt" event={"ID":"59fe28c4-2026-4092-b62a-59b2424f4f7c","Type":"ContainerDied","Data":"9436c7a06dcf724a60c548986a3d27dec32124a5d1342540bea9c9353cc6d3dd"}
Sep 11 13:15:19.379641 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.379535    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"
Sep 11 13:15:19.379787 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.379646    2573 scope.go:117] "RemoveContainer" containerID="0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd"
Sep 11 13:15:19.389232 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.389216    2573 scope.go:117] "RemoveContainer" containerID="35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f"
Sep 11 13:15:19.397726 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.397707    2573 scope.go:117] "RemoveContainer" containerID="0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd"
Sep 11 13:15:19.397998 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:15:19.397978    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd\": container with ID starting with 0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd not found: ID does not exist" containerID="0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd"
Sep 11 13:15:19.398092 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.398005    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd"} err="failed to get container status \"0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd\": rpc error: code = NotFound desc = could not find container \"0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd\": container with ID starting with 0b7577bc0f212d83087374c57325d987f170e52e6d3d4e0a91b06399087fa3bd not found: ID does not exist"
Sep 11 13:15:19.398092 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.398022    2573 scope.go:117] "RemoveContainer" containerID="35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f"
Sep 11 13:15:19.398319 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:15:19.398300    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f\": container with ID starting with 35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f not found: ID does not exist" containerID="35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f"
Sep 11 13:15:19.398358 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.398328    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f"} err="failed to get container status \"35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f\": rpc error: code = NotFound desc = could not find container \"35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f\": container with ID starting with 35c9890f91c526c5452342075edab9c2c2a39f3edffb76983b30b76f55b9b41f not found: ID does not exist"
Sep 11 13:15:19.403447 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.403424    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"]
Sep 11 13:15:19.410906 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:19.410882    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7c542a-openshift-default-5d676b5cdd-qlttt"]
Sep 11 13:15:20.517281 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:20.517239    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" path="/var/lib/kubelet/pods/59fe28c4-2026-4092-b62a-59b2424f4f7c/volumes"
Sep 11 13:15:24.590940 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:24.590858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:27.923226 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923191    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"]
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923593    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a3f81e6-bcb7-4868-aa71-26d001981024" containerName="cleanup"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923608    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3f81e6-bcb7-4868-aa71-26d001981024" containerName="cleanup"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923617    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31" containerName="cleanup"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923624    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31" containerName="cleanup"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923632    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9a722d-86aa-4915-b5f7-e274d7863ccb" containerName="main"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923638    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9a722d-86aa-4915-b5f7-e274d7863ccb" containerName="main"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923647    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923652    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923662    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec0d41f-6198-44db-b0a9-18b696fbcd51" containerName="payload-processing"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923668    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec0d41f-6198-44db-b0a9-18b696fbcd51" containerName="payload-processing"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923674    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" containerName="main"
Sep 11 13:15:27.923678 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923679    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" containerName="main"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923694    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923704    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923779    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="614c95d9-f6e5-4067-b5f0-5e6bb2ce46b1" containerName="main"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923789    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec0d41f-6198-44db-b0a9-18b696fbcd51" containerName="payload-processing"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923795    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923800    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e9a722d-86aa-4915-b5f7-e274d7863ccb" containerName="main"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923806    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31" containerName="cleanup"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923811    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a3f81e6-bcb7-4868-aa71-26d001981024" containerName="cleanup"
Sep 11 13:15:27.924080 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.923818    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="59fe28c4-2026-4092-b62a-59b2424f4f7c" containerName="istio-proxy"
Sep 11 13:15:27.928525 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.928506    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:27.931462 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.931428    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"openshift-service-ca.crt\""
Sep 11 13:15:27.931462 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.931450    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"default-dockercfg-9sghz\""
Sep 11 13:15:27.931462 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.931457    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"kube-root-ca.crt\""
Sep 11 13:15:27.931732 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.931484    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2e7f38\"/\"rate-test-model-2e7f38-kserve-self-signed-certs\""
Sep 11 13:15:27.938418 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:27.938386    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"]
Sep 11 13:15:28.006038 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.006000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:28.097019 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.096987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-model-cache\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.097019 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.097022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b8b862d-28f6-40ed-b735-57765608e767-tls-certs\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.097260 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.097043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-dshm\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.097260 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.097120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-home\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.097260 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.097136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-tmp-dir\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.097362 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.097273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfdnw\" (UniqueName: \"kubernetes.io/projected/1b8b862d-28f6-40ed-b735-57765608e767-kube-api-access-cfdnw\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.198448 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198360    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-model-cache\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.198448 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198396    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b8b862d-28f6-40ed-b735-57765608e767-tls-certs\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.198448 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198428    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-dshm\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.198707 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-home\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.198707 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-tmp-dir\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.198707 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdnw\" (UniqueName: \"kubernetes.io/projected/1b8b862d-28f6-40ed-b735-57765608e767-kube-api-access-cfdnw\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.198866 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-model-cache\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.198956 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198921    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-home\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.199094 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.198936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-tmp-dir\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.200999 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.200974    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-dshm\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.201158 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.201140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b8b862d-28f6-40ed-b735-57765608e767-tls-certs\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.207308 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.207283    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfdnw\" (UniqueName: \"kubernetes.io/projected/1b8b862d-28f6-40ed-b735-57765608e767-kube-api-access-cfdnw\") pod \"rate-test-model-2e7f38-kserve-594f47748c-pzgrs\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") " pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.239264 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.239241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:28.518416 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:15:28.518387    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b8b862d_28f6_40ed_b735_57765608e767.slice/crio-494f24a74e88d3c7e3666c228537abc4bedc83edae75f3c9409e77a7bab82d1d WatchSource:0}: Error finding container 494f24a74e88d3c7e3666c228537abc4bedc83edae75f3c9409e77a7bab82d1d: Status 404 returned error can't find the container with id 494f24a74e88d3c7e3666c228537abc4bedc83edae75f3c9409e77a7bab82d1d
Sep 11 13:15:28.518547 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:28.518463    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"]
Sep 11 13:15:29.440325 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:29.440291    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs" event={"ID":"1b8b862d-28f6-40ed-b735-57765608e767","Type":"ContainerStarted","Data":"01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e"}
Sep 11 13:15:29.440698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:29.440340    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs" event={"ID":"1b8b862d-28f6-40ed-b735-57765608e767","Type":"ContainerStarted","Data":"494f24a74e88d3c7e3666c228537abc4bedc83edae75f3c9409e77a7bab82d1d"}
Sep 11 13:15:29.459113 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:29.459062    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs" podStartSLOduration=2.45904673 podStartE2EDuration="2.45904673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:29.456642246 +0000 UTC m=+1707.531105010" watchObservedRunningTime="2026-09-11 13:15:29.45904673 +0000 UTC m=+1707.533509493"
Sep 11 13:15:32.123572 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:32.123533    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:15:38.239615 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:38.239558    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:38.239615 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:38.239630    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:38.252260 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:38.252227    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:38.502123 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:38.502039    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:15:48.913581 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:48.913548    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:15:54.875568 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:54.875531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:15:55.075056 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:15:55.075020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:01.352275 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:01.352241    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:16:08.287887 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:08.287844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:09.275900 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:09.275864    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"]
Sep 11 13:16:09.297331 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:09.297305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:09.801780 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:09.801730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:10.353757 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:10.353715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:10.541127 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:10.541085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:11.941158 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:11.941118    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:16:13.876506 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:13.876462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:14.033568 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:14.033535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:15.198379 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:15.198340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:15.341449 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:15.341411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:15.542297 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:15.542257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:16.318078 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:16.318039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:16.519056 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:16.519023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:24.295163 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.295123    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs" podUID="1b8b862d-28f6-40ed-b735-57765608e767" containerName="main" containerID="cri-o://01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e" gracePeriod=45
Sep 11 13:16:24.550665 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.550596    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:16:24.637292 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637258    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-dshm\") pod \"1b8b862d-28f6-40ed-b735-57765608e767\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") "
Sep 11 13:16:24.637456 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637325    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-tmp-dir\") pod \"1b8b862d-28f6-40ed-b735-57765608e767\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") "
Sep 11 13:16:24.637456 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637369    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfdnw\" (UniqueName: \"kubernetes.io/projected/1b8b862d-28f6-40ed-b735-57765608e767-kube-api-access-cfdnw\") pod \"1b8b862d-28f6-40ed-b735-57765608e767\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") "
Sep 11 13:16:24.637456 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637393    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-model-cache\") pod \"1b8b862d-28f6-40ed-b735-57765608e767\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") "
Sep 11 13:16:24.637456 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637428    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b8b862d-28f6-40ed-b735-57765608e767-tls-certs\") pod \"1b8b862d-28f6-40ed-b735-57765608e767\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") "
Sep 11 13:16:24.637680 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637474    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-home\") pod \"1b8b862d-28f6-40ed-b735-57765608e767\" (UID: \"1b8b862d-28f6-40ed-b735-57765608e767\") "
Sep 11 13:16:24.637680 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637647    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b8b862d-28f6-40ed-b735-57765608e767" (UID: "1b8b862d-28f6-40ed-b735-57765608e767"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:16:24.637680 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637642    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b8b862d-28f6-40ed-b735-57765608e767" (UID: "1b8b862d-28f6-40ed-b735-57765608e767"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:16:24.637839 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637783    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:16:24.637839 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637803    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:16:24.637839 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.637808    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-home" (OuterVolumeSpecName: "home") pod "1b8b862d-28f6-40ed-b735-57765608e767" (UID: "1b8b862d-28f6-40ed-b735-57765608e767"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:16:24.639553 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.639522    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-dshm" (OuterVolumeSpecName: "dshm") pod "1b8b862d-28f6-40ed-b735-57765608e767" (UID: "1b8b862d-28f6-40ed-b735-57765608e767"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:16:24.639668 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.639578    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b8b862d-28f6-40ed-b735-57765608e767-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b8b862d-28f6-40ed-b735-57765608e767" (UID: "1b8b862d-28f6-40ed-b735-57765608e767"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:16:24.639668 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.639592    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8b862d-28f6-40ed-b735-57765608e767-kube-api-access-cfdnw" (OuterVolumeSpecName: "kube-api-access-cfdnw") pod "1b8b862d-28f6-40ed-b735-57765608e767" (UID: "1b8b862d-28f6-40ed-b735-57765608e767"). InnerVolumeSpecName "kube-api-access-cfdnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:16:24.738470 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.738430    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:16:24.738470 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.738467    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfdnw\" (UniqueName: \"kubernetes.io/projected/1b8b862d-28f6-40ed-b735-57765608e767-kube-api-access-cfdnw\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:16:24.738470 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.738478    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b8b862d-28f6-40ed-b735-57765608e767-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:16:24.738470 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.738487    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b8b862d-28f6-40ed-b735-57765608e767-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:16:24.753420 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.753388    2573 generic.go:356] "Generic (PLEG): container finished" podID="1b8b862d-28f6-40ed-b735-57765608e767" containerID="01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e" exitCode=0
Sep 11 13:16:24.753558 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.753431    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"
Sep 11 13:16:24.753558 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.753469    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs" event={"ID":"1b8b862d-28f6-40ed-b735-57765608e767","Type":"ContainerDied","Data":"01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e"}
Sep 11 13:16:24.753558 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.753505    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs" event={"ID":"1b8b862d-28f6-40ed-b735-57765608e767","Type":"ContainerDied","Data":"494f24a74e88d3c7e3666c228537abc4bedc83edae75f3c9409e77a7bab82d1d"}
Sep 11 13:16:24.753558 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.753522    2573 scope.go:117] "RemoveContainer" containerID="01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e"
Sep 11 13:16:24.763096 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.763079    2573 scope.go:117] "RemoveContainer" containerID="01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e"
Sep 11 13:16:24.763396 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:16:24.763378    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e\": container with ID starting with 01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e not found: ID does not exist" containerID="01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e"
Sep 11 13:16:24.763458 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.763403    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e"} err="failed to get container status \"01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e\": rpc error: code = NotFound desc = could not find container \"01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e\": container with ID starting with 01ba85b4ae9238be36062af3b89a200460b7c67f4607abbcf1a56c578bedc75e not found: ID does not exist"
Sep 11 13:16:24.776696 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.776674    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"]
Sep 11 13:16:24.786995 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:24.786973    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2e7f38/rate-test-model-2e7f38-kserve-594f47748c-pzgrs"]
Sep 11 13:16:25.917216 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:25.917185    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:16:26.478444 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:26.478408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:26.517348 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:26.517314    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b8b862d-28f6-40ed-b735-57765608e767" path="/var/lib/kubelet/pods/1b8b862d-28f6-40ed-b735-57765608e767/volumes"
Sep 11 13:16:38.680917 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:38.680876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:43.914090 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:43.914053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:44.615228 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.615166    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:44.958797 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.958713    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"]
Sep 11 13:16:44.959134 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.959084    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b8b862d-28f6-40ed-b735-57765608e767" containerName="main"
Sep 11 13:16:44.959134 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.959095    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b8b862d-28f6-40ed-b735-57765608e767" containerName="main"
Sep 11 13:16:44.959272 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.959165    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b8b862d-28f6-40ed-b735-57765608e767" containerName="main"
Sep 11 13:16:44.962350 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.962332    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:44.966183 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.966153    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-06286a-openshift-default-dockercfg-nrkxl\""
Sep 11 13:16:44.978680 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.978656    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"]
Sep 11 13:16:44.998867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:44.998835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:45.017903 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.017877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-podinfo\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.018023 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.017931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-data\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.018023 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.017997    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98fbb862-41ce-4491-b1f6-3bf465f8f534-istiod-ca-cert\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.018102 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.018050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-socket\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.018102 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.018079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-envoy\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.018196 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.018136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-token\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.018255 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.018230    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klm5c\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-kube-api-access-klm5c\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.018363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.018273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-certs\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.018363 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.018331    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-credential-socket\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.119589 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-token\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.119789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klm5c\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-kube-api-access-klm5c\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.119789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-certs\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.119789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-credential-socket\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.119789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-podinfo\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.119789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-data\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.119789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98fbb862-41ce-4491-b1f6-3bf465f8f534-istiod-ca-cert\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.120128 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-socket\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.120128 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.119845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-envoy\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.120282 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.120127    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-certs\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.120282 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.120220    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-data\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.120384 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.120364    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-credential-socket\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.120443 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.120393    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-socket\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.120789 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.120770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98fbb862-41ce-4491-b1f6-3bf465f8f534-istiod-ca-cert\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.122260 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.122241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-envoy\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.122661 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.122640    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-podinfo\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.135663 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.135637    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-token\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.137380 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.137354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klm5c\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-kube-api-access-klm5c\") pod \"e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") " pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.265608 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.265482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:45.275340 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.275315    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:45.565017 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.564985    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"]
Sep 11 13:16:45.566400 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:16:45.566371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98fbb862_41ce_4491_b1f6_3bf465f8f534.slice/crio-5b0c34db6b649bdc4d592b63129e2218a02caf3bd6a259bf8f290516cf87d173 WatchSource:0}: Error finding container 5b0c34db6b649bdc4d592b63129e2218a02caf3bd6a259bf8f290516cf87d173: Status 404 returned error can't find the container with id 5b0c34db6b649bdc4d592b63129e2218a02caf3bd6a259bf8f290516cf87d173
Sep 11 13:16:45.568625 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.568591    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:16:45.568734 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.568673    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:16:45.568734 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.568717    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:16:45.876362 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.876269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" event={"ID":"98fbb862-41ce-4491-b1f6-3bf465f8f534","Type":"ContainerStarted","Data":"23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1"}
Sep 11 13:16:45.876362 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.876329    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" event={"ID":"98fbb862-41ce-4491-b1f6-3bf465f8f534","Type":"ContainerStarted","Data":"5b0c34db6b649bdc4d592b63129e2218a02caf3bd6a259bf8f290516cf87d173"}
Sep 11 13:16:45.902852 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:45.902795    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podStartSLOduration=1.9027808670000002 podStartE2EDuration="1.902780867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:16:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:16:45.899610429 +0000 UTC m=+1783.974073194" watchObservedRunningTime="2026-09-11 13:16:45.902780867 +0000 UTC m=+1783.977243630"
Sep 11 13:16:46.275952 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:46.275854    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:46.277467 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:46.277438    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 13:16:46.277580 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:46.277493    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 13:16:47.280398 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:47.280368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:47.887424 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:47.887392    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:47.888458 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:47.888438    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:16:47.895878 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:47.895834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:48.003884 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:48.003833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:49.152236 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:49.152202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:49.270109 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:49.270078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:49.789513 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:49.789477    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:49.904158 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:49.904124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:16:54.924339 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:16:54.924258    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:17:02.703102 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:02.703071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:17:02.706869 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:02.706843    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:17:02.708054 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:02.708030    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:17:02.712046 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:02.712026    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:17:03.929323 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:03.929281    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:17:03.929734 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:03.929370    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:17:04.991625 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:04.991517    2573 generic.go:356] "Generic (PLEG): container finished" podID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerID="23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1" exitCode=0
Sep 11 13:17:04.991625 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:04.991601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" event={"ID":"98fbb862-41ce-4491-b1f6-3bf465f8f534","Type":"ContainerDied","Data":"23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1"}
Sep 11 13:17:04.992083 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:04.992026    2573 scope.go:117] "RemoveContainer" containerID="23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1"
Sep 11 13:17:04.993254 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:04.993223    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:17:04.993377 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:04.993309    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:17:04.993377 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:04.993357    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 13:17:05.999671 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:05.999637    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" event={"ID":"98fbb862-41ce-4491-b1f6-3bf465f8f534","Type":"ContainerStarted","Data":"890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439"}
Sep 11 13:17:06.276867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:06.276761    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:17:06.276867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:06.276818    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 13:17:06.277116 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:06.276886    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 13:17:07.276534 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:07.276027    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 13:17:07.276534 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:07.276099    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 13:17:08.277445 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:08.277409    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 13:17:08.277854 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:08.277472    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 13:17:09.276434 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:09.276394    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 13:17:09.276786 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:09.276756    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 13:17:10.276685 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:10.276635    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 13:17:10.277221 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:10.276713    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 13:17:11.280417 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:11.280330    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:17:11.280832 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:11.280810    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:17:11.281541 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:11.281519    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:17:12.912653 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:12.912618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:36.438085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.438052    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"]
Sep 11 13:17:36.444078 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.444049    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.447894 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.447862    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-37c1cf\"/\"kube-root-ca.crt\""
Sep 11 13:17:36.448105 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.448088    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-37c1cf\"/\"ipp-route-37c1cf-kserve-self-signed-certs\""
Sep 11 13:17:36.448722 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.448702    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-37c1cf\"/\"openshift-service-ca.crt\""
Sep 11 13:17:36.448818 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.448704    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-37c1cf\"/\"default-dockercfg-b9lls\""
Sep 11 13:17:36.454971 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.454949    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"]
Sep 11 13:17:36.478541 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.478505    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:17:36.635676 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.635639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-dshm\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.635888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.635683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6hcj\" (UniqueName: \"kubernetes.io/projected/1a6b7144-04a6-4a85-86a3-eacaf6f02968-kube-api-access-v6hcj\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.635888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.635717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-model-cache\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.635888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.635820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tmp-dir\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.635888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.635877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-home\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.636082 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.635918    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tls-certs\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.736577 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.736485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-dshm\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.736577 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.736528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6hcj\" (UniqueName: \"kubernetes.io/projected/1a6b7144-04a6-4a85-86a3-eacaf6f02968-kube-api-access-v6hcj\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.736802 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.736577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-model-cache\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.736802 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.736619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tmp-dir\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.736802 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.736664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-home\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.736802 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.736697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tls-certs\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.737024 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.736996    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-model-cache\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.737085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.737032    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tmp-dir\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.737085 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.737059    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-home\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.738899 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.738878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-dshm\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.739245 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.739229    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tls-certs\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.745209 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.745186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6hcj\" (UniqueName: \"kubernetes.io/projected/1a6b7144-04a6-4a85-86a3-eacaf6f02968-kube-api-access-v6hcj\") pod \"ipp-route-37c1cf-kserve-6df75588b7-2ltln\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") " pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:36.755083 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:36.755064    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:37.061249 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:37.061215    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"]
Sep 11 13:17:37.062616 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:17:37.062582    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a6b7144_04a6_4a85_86a3_eacaf6f02968.slice/crio-611c54a095d3aeb66fbba2301433ec30c3d4b684b350467a722b684ad1c67f8a WatchSource:0}: Error finding container 611c54a095d3aeb66fbba2301433ec30c3d4b684b350467a722b684ad1c67f8a: Status 404 returned error can't find the container with id 611c54a095d3aeb66fbba2301433ec30c3d4b684b350467a722b684ad1c67f8a
Sep 11 13:17:37.175846 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:37.175812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln" event={"ID":"1a6b7144-04a6-4a85-86a3-eacaf6f02968","Type":"ContainerStarted","Data":"c28357b244c63038d7b99aee069598204853a5bd6edabf169b62ee02d473b4bd"}
Sep 11 13:17:37.176110 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:37.175860    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln" event={"ID":"1a6b7144-04a6-4a85-86a3-eacaf6f02968","Type":"ContainerStarted","Data":"611c54a095d3aeb66fbba2301433ec30c3d4b684b350467a722b684ad1c67f8a"}
Sep 11 13:17:37.210632 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:37.210577    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln" podStartSLOduration=1.210551303 podStartE2EDuration="1.210551303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:17:37.207935063 +0000 UTC m=+1835.282397829" watchObservedRunningTime="2026-09-11 13:17:37.210551303 +0000 UTC m=+1835.285014092"
Sep 11 13:17:41.115867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:41.115830    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:17:46.755438 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:46.755397    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:46.755438 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:46.755450    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:46.767973 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:46.767949    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:47.243135 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:47.243107    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:17:54.412498 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:17:54.412465    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:18:01.896640 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:01.896600    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:04.172323 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:04.172288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:05.193911 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:05.193869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:05.296303 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:05.296260    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:06.427699 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.427668    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"]
Sep 11 13:18:06.431500 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.431478    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.435355 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.435332    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:18:06.435797 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.435777    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2t5gt\""
Sep 11 13:18:06.435927 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.435905    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:18:06.436065 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.435957    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:18:06.436727 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.436701    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-338b23-serving-cert\""
Sep 11 13:18:06.458679 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.458652    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"]
Sep 11 13:18:06.493188 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.493143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:06.538231 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.538162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be612ec-3b31-4047-b34b-0c95e5e006d2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.538373 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.538302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.538449 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.538432    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzmb5\" (UniqueName: \"kubernetes.io/projected/6be612ec-3b31-4047-b34b-0c95e5e006d2-kube-api-access-wzmb5\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.538498 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.538483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.571190 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.571147    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:06.639291 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.639257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmb5\" (UniqueName: \"kubernetes.io/projected/6be612ec-3b31-4047-b34b-0c95e5e006d2-kube-api-access-wzmb5\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.639451 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.639313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.639451 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.639381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be612ec-3b31-4047-b34b-0c95e5e006d2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.639592 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.639560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.639657 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:18:06.639636    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-serving-cert: secret "maas-api-e2e-ipp-cleanup-338b23-serving-cert" not found
Sep 11 13:18:06.639733 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:18:06.639717    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls podName:6be612ec-3b31-4047-b34b-0c95e5e006d2 nodeName:}" failed. No retries permitted until 2026-09-11 13:18:07.139696024 +0000 UTC m=+1865.214158779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9" (UID: "6be612ec-3b31-4047-b34b-0c95e5e006d2") : secret "maas-api-e2e-ipp-cleanup-338b23-serving-cert" not found
Sep 11 13:18:06.640286 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.640243    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be612ec-3b31-4047-b34b-0c95e5e006d2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.642139 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.642117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.651742 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.651723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzmb5\" (UniqueName: \"kubernetes.io/projected/6be612ec-3b31-4047-b34b-0c95e5e006d2-kube-api-access-wzmb5\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:06.721966 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:06.721889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:07.144006 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:07.143967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:07.146627 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:07.146602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:07.152327 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:07.152291    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:07.249742 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:07.249706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:07.343898 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:07.343862    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:07.626466 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:07.626437    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"]
Sep 11 13:18:07.628198 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:18:07.628149    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be612ec_3b31_4047_b34b_0c95e5e006d2.slice/crio-46cd78806fa7965dca5c0abe5ece6f0ddb7a5855aede2e549de97582ba1af317 WatchSource:0}: Error finding container 46cd78806fa7965dca5c0abe5ece6f0ddb7a5855aede2e549de97582ba1af317: Status 404 returned error can't find the container with id 46cd78806fa7965dca5c0abe5ece6f0ddb7a5855aede2e549de97582ba1af317
Sep 11 13:18:07.629671 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:07.629655    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:18:08.357246 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:08.357209    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9" event={"ID":"6be612ec-3b31-4047-b34b-0c95e5e006d2","Type":"ContainerStarted","Data":"901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43"}
Sep 11 13:18:08.357443 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:08.357277    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9" event={"ID":"6be612ec-3b31-4047-b34b-0c95e5e006d2","Type":"ContainerStarted","Data":"46cd78806fa7965dca5c0abe5ece6f0ddb7a5855aede2e549de97582ba1af317"}
Sep 11 13:18:08.357443 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:08.357327    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:08.387215 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:08.387135    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9" podStartSLOduration=2.009942661 podStartE2EDuration="2.387117059s" totalImagesPullingTime="377.174398ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:18:08.386290865 +0000 UTC m=+1866.460753629" watchObservedRunningTime="2026-09-11 13:18:08.387117059 +0000 UTC m=+1866.461579822"
Sep 11 13:18:14.368449 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:14.368420    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:17.513412 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:17.513374    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:18:17.639746 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:17.639686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:27.632433 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:27.632340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:30.222708 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:30.222670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:37.143934 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.143902    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"]
Sep 11 13:18:37.144393 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.144183    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9" podUID="6be612ec-3b31-4047-b34b-0c95e5e006d2" containerName="maas-api" containerID="cri-o://901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43" gracePeriod=30
Sep 11 13:18:37.247060 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.247022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:37.330952 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.330913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:37.394157 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.394099    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:37.421933 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.421902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:37.498350 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.498307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:37.521030 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.521004    2573 generic.go:356] "Generic (PLEG): container finished" podID="6be612ec-3b31-4047-b34b-0c95e5e006d2" containerID="901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43" exitCode=0
Sep 11 13:18:37.521220 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.521050    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"
Sep 11 13:18:37.521220 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.521091    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9" event={"ID":"6be612ec-3b31-4047-b34b-0c95e5e006d2","Type":"ContainerDied","Data":"901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43"}
Sep 11 13:18:37.521220 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.521149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9" event={"ID":"6be612ec-3b31-4047-b34b-0c95e5e006d2","Type":"ContainerDied","Data":"46cd78806fa7965dca5c0abe5ece6f0ddb7a5855aede2e549de97582ba1af317"}
Sep 11 13:18:37.521220 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.521197    2573 scope.go:117] "RemoveContainer" containerID="901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43"
Sep 11 13:18:37.531279 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.531250    2573 scope.go:117] "RemoveContainer" containerID="901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43"
Sep 11 13:18:37.531857 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:18:37.531831    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43\": container with ID starting with 901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43 not found: ID does not exist" containerID="901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43"
Sep 11 13:18:37.531977 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.531866    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43"} err="failed to get container status \"901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43\": rpc error: code = NotFound desc = could not find container \"901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43\": container with ID starting with 901c6139a8867ce209426bdff9d2bc54de56c65225df2ca26a3aa32c11eb3d43 not found: ID does not exist"
Sep 11 13:18:37.545216 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.545190    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzmb5\" (UniqueName: \"kubernetes.io/projected/6be612ec-3b31-4047-b34b-0c95e5e006d2-kube-api-access-wzmb5\") pod \"6be612ec-3b31-4047-b34b-0c95e5e006d2\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") "
Sep 11 13:18:37.545338 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.545248    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls\") pod \"6be612ec-3b31-4047-b34b-0c95e5e006d2\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") "
Sep 11 13:18:37.545405 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.545373    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-metrics-certs\") pod \"6be612ec-3b31-4047-b34b-0c95e5e006d2\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") "
Sep 11 13:18:37.545461 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.545450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be612ec-3b31-4047-b34b-0c95e5e006d2-openshift-service-ca\") pod \"6be612ec-3b31-4047-b34b-0c95e5e006d2\" (UID: \"6be612ec-3b31-4047-b34b-0c95e5e006d2\") "
Sep 11 13:18:37.545800 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.545769    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6be612ec-3b31-4047-b34b-0c95e5e006d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6be612ec-3b31-4047-b34b-0c95e5e006d2" (UID: "6be612ec-3b31-4047-b34b-0c95e5e006d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:18:37.547601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.547549    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6be612ec-3b31-4047-b34b-0c95e5e006d2" (UID: "6be612ec-3b31-4047-b34b-0c95e5e006d2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:18:37.547702 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.547633    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6be612ec-3b31-4047-b34b-0c95e5e006d2" (UID: "6be612ec-3b31-4047-b34b-0c95e5e006d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:18:37.547702 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.547688    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6be612ec-3b31-4047-b34b-0c95e5e006d2-kube-api-access-wzmb5" (OuterVolumeSpecName: "kube-api-access-wzmb5") pod "6be612ec-3b31-4047-b34b-0c95e5e006d2" (UID: "6be612ec-3b31-4047-b34b-0c95e5e006d2"). InnerVolumeSpecName "kube-api-access-wzmb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:18:37.646963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.646862    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be612ec-3b31-4047-b34b-0c95e5e006d2-openshift-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:18:37.646963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.646896    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzmb5\" (UniqueName: \"kubernetes.io/projected/6be612ec-3b31-4047-b34b-0c95e5e006d2-kube-api-access-wzmb5\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:18:37.646963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.646911    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-maas-api-tls\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:18:37.646963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.646926    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be612ec-3b31-4047-b34b-0c95e5e006d2-metrics-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:18:37.850781 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.850750    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"]
Sep 11 13:18:37.857507 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.857482    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-338b23-5bb6958b8f-wbzr9"]
Sep 11 13:18:37.863788 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:37.863758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:38.518904 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:38.518868    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6be612ec-3b31-4047-b34b-0c95e5e006d2" path="/var/lib/kubelet/pods/6be612ec-3b31-4047-b34b-0c95e5e006d2/volumes"
Sep 11 13:18:41.824024 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:41.823991    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:18:44.135269 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:44.135231    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:44.236809 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:44.236770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:44.449673 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:44.449590    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:48.254190 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.254143    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"]
Sep 11 13:18:48.254604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.254564    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be612ec-3b31-4047-b34b-0c95e5e006d2" containerName="maas-api"
Sep 11 13:18:48.254604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.254585    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be612ec-3b31-4047-b34b-0c95e5e006d2" containerName="maas-api"
Sep 11 13:18:48.254682 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.254662    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be612ec-3b31-4047-b34b-0c95e5e006d2" containerName="maas-api"
Sep 11 13:18:48.259156 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.259139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"
Sep 11 13:18:48.261289 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.261237    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:18:48.262587 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.262558    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:18:48.264272 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.264246    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"]
Sep 11 13:18:48.352854 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.352821    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe314a50-3b8a-42c4-8645-abcc7465810b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn\" (UID: \"fe314a50-3b8a-42c4-8645-abcc7465810b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"
Sep 11 13:18:48.426719 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.426686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:48.454434 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.454402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe314a50-3b8a-42c4-8645-abcc7465810b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn\" (UID: \"fe314a50-3b8a-42c4-8645-abcc7465810b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"
Sep 11 13:18:48.455033 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.455014    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe314a50-3b8a-42c4-8645-abcc7465810b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn\" (UID: \"fe314a50-3b8a-42c4-8645-abcc7465810b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"
Sep 11 13:18:48.571304 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.571272    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"
Sep 11 13:18:48.860706 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:48.860622    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"]
Sep 11 13:18:48.864873 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:18:48.864845    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe314a50_3b8a_42c4_8645_abcc7465810b.slice/crio-cea95029b585fbad70fecbd7ec1265f1c2dcf7228927c32c6f1ccae56f66db98 WatchSource:0}: Error finding container cea95029b585fbad70fecbd7ec1265f1c2dcf7228927c32c6f1ccae56f66db98: Status 404 returned error can't find the container with id cea95029b585fbad70fecbd7ec1265f1c2dcf7228927c32c6f1ccae56f66db98
Sep 11 13:18:49.350827 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:49.350790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:49.595467 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:49.595435    2573 generic.go:356] "Generic (PLEG): container finished" podID="fe314a50-3b8a-42c4-8645-abcc7465810b" containerID="c4517351497886bb31be7708c06f2f7a76df62be7c61917ae657a6877cf7176d" exitCode=0
Sep 11 13:18:49.595604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:49.595526    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn" event={"ID":"fe314a50-3b8a-42c4-8645-abcc7465810b","Type":"ContainerDied","Data":"c4517351497886bb31be7708c06f2f7a76df62be7c61917ae657a6877cf7176d"}
Sep 11 13:18:49.595604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:49.595577    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn" event={"ID":"fe314a50-3b8a-42c4-8645-abcc7465810b","Type":"ContainerStarted","Data":"cea95029b585fbad70fecbd7ec1265f1c2dcf7228927c32c6f1ccae56f66db98"}
Sep 11 13:18:50.101912 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:50.101871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:18:50.731499 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:50.731469    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"
Sep 11 13:18:50.777292 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:50.777262    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe314a50-3b8a-42c4-8645-abcc7465810b-maas-api-service-ca\") pod \"fe314a50-3b8a-42c4-8645-abcc7465810b\" (UID: \"fe314a50-3b8a-42c4-8645-abcc7465810b\") "
Sep 11 13:18:50.777611 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:50.777589    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe314a50-3b8a-42c4-8645-abcc7465810b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe314a50-3b8a-42c4-8645-abcc7465810b" (UID: "fe314a50-3b8a-42c4-8645-abcc7465810b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:18:50.878291 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:50.878212    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe314a50-3b8a-42c4-8645-abcc7465810b-maas-api-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:18:51.610515 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:51.610485    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"
Sep 11 13:18:51.610515 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:51.610501    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn" event={"ID":"fe314a50-3b8a-42c4-8645-abcc7465810b","Type":"ContainerDied","Data":"cea95029b585fbad70fecbd7ec1265f1c2dcf7228927c32c6f1ccae56f66db98"}
Sep 11 13:18:51.610788 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:18:51.610541    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cea95029b585fbad70fecbd7ec1265f1c2dcf7228927c32c6f1ccae56f66db98"
Sep 11 13:19:01.710015 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:01.709979    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:19:03.912997 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:03.912947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:04.031847 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:04.031813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:04.130416 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:04.130385    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:04.190335 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:04.190252    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"]
Sep 11 13:19:04.195716 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:04.195692    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-37c1cf-7dxvn"]
Sep 11 13:19:04.215352 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:04.215324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:04.518215 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:04.518108    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe314a50-3b8a-42c4-8645-abcc7465810b" path="/var/lib/kubelet/pods/fe314a50-3b8a-42c4-8645-abcc7465810b/volumes"
Sep 11 13:19:04.586451 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:04.586409    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:09.556503 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:09.556468    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"]
Sep 11 13:19:09.650659 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:09.650627    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:14.318802 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:14.318765    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:19:24.576440 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.576403    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln" podUID="1a6b7144-04a6-4a85-86a3-eacaf6f02968" containerName="main" containerID="cri-o://c28357b244c63038d7b99aee069598204853a5bd6edabf169b62ee02d473b4bd" gracePeriod=45
Sep 11 13:19:24.814731 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.814699    2573 generic.go:356] "Generic (PLEG): container finished" podID="1a6b7144-04a6-4a85-86a3-eacaf6f02968" containerID="c28357b244c63038d7b99aee069598204853a5bd6edabf169b62ee02d473b4bd" exitCode=0
Sep 11 13:19:24.814855 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.814769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln" event={"ID":"1a6b7144-04a6-4a85-86a3-eacaf6f02968","Type":"ContainerDied","Data":"c28357b244c63038d7b99aee069598204853a5bd6edabf169b62ee02d473b4bd"}
Sep 11 13:19:24.814855 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.814811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln" event={"ID":"1a6b7144-04a6-4a85-86a3-eacaf6f02968","Type":"ContainerDied","Data":"611c54a095d3aeb66fbba2301433ec30c3d4b684b350467a722b684ad1c67f8a"}
Sep 11 13:19:24.814855 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.814822    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="611c54a095d3aeb66fbba2301433ec30c3d4b684b350467a722b684ad1c67f8a"
Sep 11 13:19:24.822730 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.822711    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:19:24.910027 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.909944    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-dshm\") pod \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") "
Sep 11 13:19:24.910027 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910004    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tls-certs\") pod \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") "
Sep 11 13:19:24.910277 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910062    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tmp-dir\") pod \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") "
Sep 11 13:19:24.910277 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-model-cache\") pod \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") "
Sep 11 13:19:24.910277 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910143    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-home\") pod \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") "
Sep 11 13:19:24.910459 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910430    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a6b7144-04a6-4a85-86a3-eacaf6f02968" (UID: "1a6b7144-04a6-4a85-86a3-eacaf6f02968"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:24.910459 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910444    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a6b7144-04a6-4a85-86a3-eacaf6f02968" (UID: "1a6b7144-04a6-4a85-86a3-eacaf6f02968"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:24.910547 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910467    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-home" (OuterVolumeSpecName: "home") pod "1a6b7144-04a6-4a85-86a3-eacaf6f02968" (UID: "1a6b7144-04a6-4a85-86a3-eacaf6f02968"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:24.910603 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910554    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-home\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:19:24.910603 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910577    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tmp-dir\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:19:24.910603 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.910588    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-model-cache\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:19:24.912313 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.912292    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-dshm" (OuterVolumeSpecName: "dshm") pod "1a6b7144-04a6-4a85-86a3-eacaf6f02968" (UID: "1a6b7144-04a6-4a85-86a3-eacaf6f02968"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:24.912722 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:24.912703    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a6b7144-04a6-4a85-86a3-eacaf6f02968" (UID: "1a6b7144-04a6-4a85-86a3-eacaf6f02968"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:19:25.011244 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:25.011212    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6hcj\" (UniqueName: \"kubernetes.io/projected/1a6b7144-04a6-4a85-86a3-eacaf6f02968-kube-api-access-v6hcj\") pod \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\" (UID: \"1a6b7144-04a6-4a85-86a3-eacaf6f02968\") "
Sep 11 13:19:25.011498 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:25.011486    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a6b7144-04a6-4a85-86a3-eacaf6f02968-dshm\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:19:25.011546 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:25.011505    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a6b7144-04a6-4a85-86a3-eacaf6f02968-tls-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:19:25.013311 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:25.013287    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a6b7144-04a6-4a85-86a3-eacaf6f02968-kube-api-access-v6hcj" (OuterVolumeSpecName: "kube-api-access-v6hcj") pod "1a6b7144-04a6-4a85-86a3-eacaf6f02968" (UID: "1a6b7144-04a6-4a85-86a3-eacaf6f02968"). InnerVolumeSpecName "kube-api-access-v6hcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:19:25.111998 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:25.111971    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6hcj\" (UniqueName: \"kubernetes.io/projected/1a6b7144-04a6-4a85-86a3-eacaf6f02968-kube-api-access-v6hcj\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:19:25.820450 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:25.820418    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"
Sep 11 13:19:25.841485 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:25.841416    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"]
Sep 11 13:19:25.850253 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:25.850228    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-37c1cf/ipp-route-37c1cf-kserve-6df75588b7-2ltln"]
Sep 11 13:19:26.518236 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:26.518203    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a6b7144-04a6-4a85-86a3-eacaf6f02968" path="/var/lib/kubelet/pods/1a6b7144-04a6-4a85-86a3-eacaf6f02968/volumes"
Sep 11 13:19:32.173078 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:32.173036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:46.097939 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:46.097900    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:47.439695 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:47.439653    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:53.204716 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.204680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:53.285338 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.285298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:53.514076 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.513986    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:53.893756 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.893718    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"]
Sep 11 13:19:53.894131 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.894119    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6b7144-04a6-4a85-86a3-eacaf6f02968" containerName="main"
Sep 11 13:19:53.894195 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.894133    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6b7144-04a6-4a85-86a3-eacaf6f02968" containerName="main"
Sep 11 13:19:53.894195 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.894151    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe314a50-3b8a-42c4-8645-abcc7465810b" containerName="revoke-keys"
Sep 11 13:19:53.894195 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.894157    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe314a50-3b8a-42c4-8645-abcc7465810b" containerName="revoke-keys"
Sep 11 13:19:53.894294 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.894240    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a6b7144-04a6-4a85-86a3-eacaf6f02968" containerName="main"
Sep 11 13:19:53.894294 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.894250    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe314a50-3b8a-42c4-8645-abcc7465810b" containerName="revoke-keys"
Sep 11 13:19:53.897439 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.897423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"
Sep 11 13:19:53.900232 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.900213    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:19:53.900300 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.900259    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:19:53.906773 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.906749    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"]
Sep 11 13:19:53.986311 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:53.986274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed564106-cf0a-4d94-a0df-2b00b0dcb66a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-06286a-msp75\" (UID: \"ed564106-cf0a-4d94-a0df-2b00b0dcb66a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"
Sep 11 13:19:54.087245 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:54.087195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed564106-cf0a-4d94-a0df-2b00b0dcb66a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-06286a-msp75\" (UID: \"ed564106-cf0a-4d94-a0df-2b00b0dcb66a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"
Sep 11 13:19:54.087850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:54.087828    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed564106-cf0a-4d94-a0df-2b00b0dcb66a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-06286a-msp75\" (UID: \"ed564106-cf0a-4d94-a0df-2b00b0dcb66a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"
Sep 11 13:19:54.164516 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:54.164429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:19:54.209408 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:54.209379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"
Sep 11 13:19:54.504207 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:54.504162    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"]
Sep 11 13:19:54.504572 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:19:54.504550    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded564106_cf0a_4d94_a0df_2b00b0dcb66a.slice/crio-4c5dd72d7b879295bffc32fe65825fac1d6e42fddc876e651ecd3db529aa0b01 WatchSource:0}: Error finding container 4c5dd72d7b879295bffc32fe65825fac1d6e42fddc876e651ecd3db529aa0b01: Status 404 returned error can't find the container with id 4c5dd72d7b879295bffc32fe65825fac1d6e42fddc876e651ecd3db529aa0b01
Sep 11 13:19:54.994863 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:54.994826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75" event={"ID":"ed564106-cf0a-4d94-a0df-2b00b0dcb66a","Type":"ContainerStarted","Data":"9920b15d0fbde1151cc564d260b64ec94c1c502161c301edf211e7a304d784d1"}
Sep 11 13:19:54.995039 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:54.994881    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75" event={"ID":"ed564106-cf0a-4d94-a0df-2b00b0dcb66a","Type":"ContainerStarted","Data":"4c5dd72d7b879295bffc32fe65825fac1d6e42fddc876e651ecd3db529aa0b01"}
Sep 11 13:19:56.001984 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:56.001947    2573 generic.go:356] "Generic (PLEG): container finished" podID="ed564106-cf0a-4d94-a0df-2b00b0dcb66a" containerID="9920b15d0fbde1151cc564d260b64ec94c1c502161c301edf211e7a304d784d1" exitCode=0
Sep 11 13:19:56.002387 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:56.002030    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75" event={"ID":"ed564106-cf0a-4d94-a0df-2b00b0dcb66a","Type":"ContainerDied","Data":"9920b15d0fbde1151cc564d260b64ec94c1c502161c301edf211e7a304d784d1"}
Sep 11 13:19:57.146927 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:57.146900    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"
Sep 11 13:19:57.322581 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:57.322547    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed564106-cf0a-4d94-a0df-2b00b0dcb66a-maas-api-service-ca\") pod \"ed564106-cf0a-4d94-a0df-2b00b0dcb66a\" (UID: \"ed564106-cf0a-4d94-a0df-2b00b0dcb66a\") "
Sep 11 13:19:57.322926 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:57.322901    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed564106-cf0a-4d94-a0df-2b00b0dcb66a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed564106-cf0a-4d94-a0df-2b00b0dcb66a" (UID: "ed564106-cf0a-4d94-a0df-2b00b0dcb66a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:19:57.423951 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:57.423913    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed564106-cf0a-4d94-a0df-2b00b0dcb66a-maas-api-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.015213 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:58.015162    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"
Sep 11 13:19:58.015404 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:58.015212    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75" event={"ID":"ed564106-cf0a-4d94-a0df-2b00b0dcb66a","Type":"ContainerDied","Data":"4c5dd72d7b879295bffc32fe65825fac1d6e42fddc876e651ecd3db529aa0b01"}
Sep 11 13:19:58.015404 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:19:58.015267    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c5dd72d7b879295bffc32fe65825fac1d6e42fddc876e651ecd3db529aa0b01"
Sep 11 13:20:04.456049 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:04.456018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:04.561229 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:04.561193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:04.660508 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:04.660460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:04.759821 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:04.759730    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"]
Sep 11 13:20:04.762017 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:04.761997    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-06286a-msp75"]
Sep 11 13:20:04.764304 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:04.764266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:04.865195 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:04.865126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:05.242001 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:05.241962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:06.518121 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:06.518084    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed564106-cf0a-4d94-a0df-2b00b0dcb66a" path="/var/lib/kubelet/pods/ed564106-cf0a-4d94-a0df-2b00b0dcb66a/volumes"
Sep 11 13:20:07.811146 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:07.811112    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:20:11.294354 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:11.294314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:11.397142 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:11.397104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:11.545709 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:11.545622    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"]
Sep 11 13:20:11.545867 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:11.545847    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy" containerID="cri-o://890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439" gracePeriod=30
Sep 11 13:20:11.573044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:11.573005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:12.056461 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:12.056428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:16.802995 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.802969    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:20:16.905404 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905318    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-data\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905404 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905367    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-podinfo\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905404 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905387    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-credential-socket\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905689 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905414    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98fbb862-41ce-4491-b1f6-3bf465f8f534-istiod-ca-cert\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905689 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905461    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-token\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905689 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905529    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klm5c\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-kube-api-access-klm5c\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905689 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905583    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-socket\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905689 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905625    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-certs\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905954 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905664    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-envoy\") pod \"98fbb862-41ce-4491-b1f6-3bf465f8f534\" (UID: \"98fbb862-41ce-4491-b1f6-3bf465f8f534\") "
Sep 11 13:20:16.905954 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905712    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:16.905954 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905709    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-data" (OuterVolumeSpecName: "istio-data") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:16.905954 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905913    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:16.905954 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905933    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:16.906166 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.905954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98fbb862-41ce-4491-b1f6-3bf465f8f534-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:16.906166 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.906021    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-data\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:16.906166 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.906054    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-credential-socket\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:16.906166 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.906070    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:16.907781 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.907752    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-token" (OuterVolumeSpecName: "istio-token") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:16.907938 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.907920    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:16.908199 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.908153    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-kube-api-access-klm5c" (OuterVolumeSpecName: "kube-api-access-klm5c") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "kube-api-access-klm5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:16.908273 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:16.908248    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98fbb862-41ce-4491-b1f6-3bf465f8f534" (UID: "98fbb862-41ce-4491-b1f6-3bf465f8f534"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:20:17.007035 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.007006    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-podinfo\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:17.007035 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.007030    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98fbb862-41ce-4491-b1f6-3bf465f8f534-istiod-ca-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:17.007035 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.007040    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-token\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:17.007280 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.007049    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klm5c\" (UniqueName: \"kubernetes.io/projected/98fbb862-41ce-4491-b1f6-3bf465f8f534-kube-api-access-klm5c\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:17.007280 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.007058    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-workload-socket\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:17.007280 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.007066    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98fbb862-41ce-4491-b1f6-3bf465f8f534-istio-envoy\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:17.123674 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.123636    2573 generic.go:356] "Generic (PLEG): container finished" podID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerID="890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439" exitCode=0
Sep 11 13:20:17.123850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.123682    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"
Sep 11 13:20:17.123850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.123719    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" event={"ID":"98fbb862-41ce-4491-b1f6-3bf465f8f534","Type":"ContainerDied","Data":"890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439"}
Sep 11 13:20:17.123850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.123768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57" event={"ID":"98fbb862-41ce-4491-b1f6-3bf465f8f534","Type":"ContainerDied","Data":"5b0c34db6b649bdc4d592b63129e2218a02caf3bd6a259bf8f290516cf87d173"}
Sep 11 13:20:17.123850 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.123793    2573 scope.go:117] "RemoveContainer" containerID="890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439"
Sep 11 13:20:17.134594 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.134576    2573 scope.go:117] "RemoveContainer" containerID="23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1"
Sep 11 13:20:17.143104 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.143086    2573 scope.go:117] "RemoveContainer" containerID="890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439"
Sep 11 13:20:17.143384 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:20:17.143363    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439\": container with ID starting with 890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439 not found: ID does not exist" containerID="890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439"
Sep 11 13:20:17.143447 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.143394    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439"} err="failed to get container status \"890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439\": rpc error: code = NotFound desc = could not find container \"890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439\": container with ID starting with 890e5b212c0cc88d4c71b6dab7c945becdfbd0f0676203b1cefeb30f28641439 not found: ID does not exist"
Sep 11 13:20:17.143447 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.143411    2573 scope.go:117] "RemoveContainer" containerID="23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1"
Sep 11 13:20:17.143690 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:20:17.143675    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1\": container with ID starting with 23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1 not found: ID does not exist" containerID="23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1"
Sep 11 13:20:17.143736 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.143693    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1"} err="failed to get container status \"23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1\": rpc error: code = NotFound desc = could not find container \"23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1\": container with ID starting with 23bce2d19a619d51d22adb4da951297165d2a79f3f9297f3dd19b269fdc605d1 not found: ID does not exist"
Sep 11 13:20:17.148109 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.148087    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"]
Sep 11 13:20:17.154421 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:17.154399    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-06286a-openshift-default-864cc66b98-j6s57"]
Sep 11 13:20:18.518482 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:18.518446    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" path="/var/lib/kubelet/pods/98fbb862-41ce-4491-b1f6-3bf465f8f534/volumes"
Sep 11 13:20:22.470370 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.470338    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"]
Sep 11 13:20:22.475786 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.475748    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d4b0b9-29818875-pjsjp"]
Sep 11 13:20:22.500379 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.500349    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"]
Sep 11 13:20:22.500613 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.500574    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67" podUID="00748354-757b-4d42-a9ce-30ce3340259f" containerName="payload-processing" containerID="cri-o://ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0" gracePeriod=30
Sep 11 13:20:22.520526 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.520462    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31" path="/var/lib/kubelet/pods/de8bdaae-5260-4bd8-b1f8-fe7b74cb3c31/volumes"
Sep 11 13:20:22.565239 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.565189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:22.663538 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.663499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:22.733292 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.733249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:22.747640 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.747619    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:20:22.864973 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.864944    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00748354-757b-4d42-a9ce-30ce3340259f-plugins-config-volume\") pod \"00748354-757b-4d42-a9ce-30ce3340259f\" (UID: \"00748354-757b-4d42-a9ce-30ce3340259f\") "
Sep 11 13:20:22.865148 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.865048    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pkmw\" (UniqueName: \"kubernetes.io/projected/00748354-757b-4d42-a9ce-30ce3340259f-kube-api-access-8pkmw\") pod \"00748354-757b-4d42-a9ce-30ce3340259f\" (UID: \"00748354-757b-4d42-a9ce-30ce3340259f\") "
Sep 11 13:20:22.865361 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.865337    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00748354-757b-4d42-a9ce-30ce3340259f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00748354-757b-4d42-a9ce-30ce3340259f" (UID: "00748354-757b-4d42-a9ce-30ce3340259f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:22.867239 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.867218    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00748354-757b-4d42-a9ce-30ce3340259f-kube-api-access-8pkmw" (OuterVolumeSpecName: "kube-api-access-8pkmw") pod "00748354-757b-4d42-a9ce-30ce3340259f" (UID: "00748354-757b-4d42-a9ce-30ce3340259f"). InnerVolumeSpecName "kube-api-access-8pkmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:22.966326 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.966293    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pkmw\" (UniqueName: \"kubernetes.io/projected/00748354-757b-4d42-a9ce-30ce3340259f-kube-api-access-8pkmw\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:22.966326 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:22.966320    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00748354-757b-4d42-a9ce-30ce3340259f-plugins-config-volume\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:23.141029 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.140997    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:23.161907 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.161877    2573 generic.go:356] "Generic (PLEG): container finished" podID="00748354-757b-4d42-a9ce-30ce3340259f" containerID="ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0" exitCode=0
Sep 11 13:20:23.162058 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.161924    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"
Sep 11 13:20:23.162058 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.161966    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67" event={"ID":"00748354-757b-4d42-a9ce-30ce3340259f","Type":"ContainerDied","Data":"ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0"}
Sep 11 13:20:23.162058 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.162024    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67" event={"ID":"00748354-757b-4d42-a9ce-30ce3340259f","Type":"ContainerDied","Data":"10ebc415277d8b659a008b60976f752998ded4b25f9ddd2b56c0b117935cb71c"}
Sep 11 13:20:23.162058 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.162053    2573 scope.go:117] "RemoveContainer" containerID="ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0"
Sep 11 13:20:23.172138 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.172120    2573 scope.go:117] "RemoveContainer" containerID="ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0"
Sep 11 13:20:23.172459 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:20:23.172441    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0\": container with ID starting with ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0 not found: ID does not exist" containerID="ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0"
Sep 11 13:20:23.172529 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.172467    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0"} err="failed to get container status \"ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0\": rpc error: code = NotFound desc = could not find container \"ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0\": container with ID starting with ea50155e7fcdd5df5c41297146da9145e988023fb269c06d187377e82545a5c0 not found: ID does not exist"
Sep 11 13:20:23.185151 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.185125    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"]
Sep 11 13:20:23.189812 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:23.189791    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d4b0b9-d7848bbd5-g4x67"]
Sep 11 13:20:24.523216 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:24.523161    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00748354-757b-4d42-a9ce-30ce3340259f" path="/var/lib/kubelet/pods/00748354-757b-4d42-a9ce-30ce3340259f/volumes"
Sep 11 13:20:25.639956 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:25.639910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:25.718502 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:25.718464    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:20:29.582921 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:29.582890    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:29.667512 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:29.667469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:29.837602 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:29.837502    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"]
Sep 11 13:20:29.837780 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:29.837707    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy" containerID="cri-o://04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc" gracePeriod=30
Sep 11 13:20:29.867294 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:29.867247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:30.351528 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:30.351495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:30.447157 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:30.447124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:35.105886 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.105825    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:20:35.181919 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.181886    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-data\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182082 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.181935    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istiod-ca-cert\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182082 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.181970    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-socket\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182082 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182011    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-envoy\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182082 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182057    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p26qj\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-kube-api-access-p26qj\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182275 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182149    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-certs\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182275 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182230    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-podinfo\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182275 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182244    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:35.182275 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182261    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-credential-socket\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182484 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182286    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-token\") pod \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\" (UID: \"1ad3375a-b0d8-495f-9bbc-6a678f10482a\") "
Sep 11 13:20:35.182484 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182281    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:35.182604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182492    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:35.182604 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182586    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:35.182698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182597    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:35.182698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182632    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:35.182698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182659    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-data\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:35.182698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.182675    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-workload-socket\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:35.184633 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.184603    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:35.184633 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.184608    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:35.184796 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.184674    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:20:35.184796 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.184686    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-kube-api-access-p26qj" (OuterVolumeSpecName: "kube-api-access-p26qj") pod "1ad3375a-b0d8-495f-9bbc-6a678f10482a" (UID: "1ad3375a-b0d8-495f-9bbc-6a678f10482a"). InnerVolumeSpecName "kube-api-access-p26qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:35.231601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.231563    2573 generic.go:356] "Generic (PLEG): container finished" podID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerID="04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc" exitCode=0
Sep 11 13:20:35.231729 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.231619    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"
Sep 11 13:20:35.231729 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.231646    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" event={"ID":"1ad3375a-b0d8-495f-9bbc-6a678f10482a","Type":"ContainerDied","Data":"04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc"}
Sep 11 13:20:35.231729 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.231706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5" event={"ID":"1ad3375a-b0d8-495f-9bbc-6a678f10482a","Type":"ContainerDied","Data":"4f4600aa008fe4a134e81ecf64d5a8cc35986818121d567640b002660fae3d57"}
Sep 11 13:20:35.231729 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.231728    2573 scope.go:117] "RemoveContainer" containerID="04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc"
Sep 11 13:20:35.241754 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.241736    2573 scope.go:117] "RemoveContainer" containerID="e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8"
Sep 11 13:20:35.250733 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.250717    2573 scope.go:117] "RemoveContainer" containerID="04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc"
Sep 11 13:20:35.251005 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:20:35.250985    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc\": container with ID starting with 04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc not found: ID does not exist" containerID="04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc"
Sep 11 13:20:35.251054 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.251012    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc"} err="failed to get container status \"04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc\": rpc error: code = NotFound desc = could not find container \"04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc\": container with ID starting with 04e41f725e0c7071a82760286584ceefc8c12b387211647fd4453038d32e36fc not found: ID does not exist"
Sep 11 13:20:35.251054 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.251029    2573 scope.go:117] "RemoveContainer" containerID="e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8"
Sep 11 13:20:35.251311 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:20:35.251292    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8\": container with ID starting with e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8 not found: ID does not exist" containerID="e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8"
Sep 11 13:20:35.251368 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.251318    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8"} err="failed to get container status \"e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8\": rpc error: code = NotFound desc = could not find container \"e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8\": container with ID starting with e57353f70db3ffbd9de2b4d69e3d1f15572753fb6b9cddcb1f5f396438bab6c8 not found: ID does not exist"
Sep 11 13:20:35.255614 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.255579    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"]
Sep 11 13:20:35.261515 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.261495    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d4b0b9-openshift-default-7f5f46b5d-xlrd5"]
Sep 11 13:20:35.283866 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.283843    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-podinfo\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:35.283866 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.283864    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-credential-socket\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:35.283963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.283875    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-token\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:35.283963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.283883    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istiod-ca-cert\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:35.283963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.283892    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad3375a-b0d8-495f-9bbc-6a678f10482a-istio-envoy\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:35.283963 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:35.283900    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p26qj\" (UniqueName: \"kubernetes.io/projected/1ad3375a-b0d8-495f-9bbc-6a678f10482a-kube-api-access-p26qj\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:20:36.517587 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:36.517545    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" path="/var/lib/kubelet/pods/1ad3375a-b0d8-495f-9bbc-6a678f10482a/volumes"
Sep 11 13:20:40.876539 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:40.876503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:41.045090 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:41.045053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:41.131306 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:41.131220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:41.218670 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:41.218621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:41.313352 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:41.313311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:41.598698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:41.598660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:43.523039 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:43.523001    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:20:48.588367 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:48.588326    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:48.730729 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:48.730688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:48.976439 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:48.976344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:53.811431 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:20:53.811399    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:21:02.921086 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:21:02.921047    2573 scope.go:117] "RemoveContainer" containerID="175b0e3c9cc2e4d218101699448739e2357b4908ab4f1804134fcc008e6fccd6"
Sep 11 13:21:10.770133 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:21:10.770090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:44.913938 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:21:44.913901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:02.751439 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:02.751120    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:22:02.756217 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:02.756193    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:22:02.756217 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:02.756214    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:22:02.759792 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:02.759775    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:22:15.069070 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:15.069022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:15.725827 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:15.725789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:16.352670 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:16.352636    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:22:17.622285 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:17.622245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:38.032425 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:38.032387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:42.636265 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:42.636226    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:22:51.052490 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:51.052454    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:22:59.114864 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:22:59.114779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:23:12.431474 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:23:12.431436    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:23:18.843662 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:23:18.843629    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:23:28.364614 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:23:28.364577    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:24:02.971108 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:24:02.971076    2573 scope.go:117] "RemoveContainer" containerID="c28357b244c63038d7b99aee069598204853a5bd6edabf169b62ee02d473b4bd"
Sep 11 13:24:53.433629 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:24:53.433593    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:25:01.544404 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:01.544367    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:25:02.995122 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:02.995088    2573 scope.go:117] "RemoveContainer" containerID="c4517351497886bb31be7708c06f2f7a76df62be7c61917ae657a6877cf7176d"
Sep 11 13:25:07.915351 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:07.915318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:25:10.884275 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:10.884238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:14.620086 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:14.620052    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:25:24.540223 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:24.540190    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:27.947913 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:27.947871    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:25:58.974482 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:58.974406    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:59.620597 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:25:59.620561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:02.114467 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:02.114431    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:26:03.016236 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:03.016200    2573 scope.go:117] "RemoveContainer" containerID="9920b15d0fbde1151cc564d260b64ec94c1c502161c301edf211e7a304d784d1"
Sep 11 13:26:10.898152 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:10.898109    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:26:12.863611 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:12.863576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:17.900547 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900505    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"]
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900899    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900915    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900926    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900932    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900942    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900947    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900968    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00748354-757b-4d42-a9ce-30ce3340259f" containerName="payload-processing"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900974    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="00748354-757b-4d42-a9ce-30ce3340259f" containerName="payload-processing"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900979    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed564106-cf0a-4d94-a0df-2b00b0dcb66a" containerName="revoke-keys"
Sep 11 13:26:17.901044 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.900986    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed564106-cf0a-4d94-a0df-2b00b0dcb66a" containerName="revoke-keys"
Sep 11 13:26:17.901393 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.901050    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="00748354-757b-4d42-a9ce-30ce3340259f" containerName="payload-processing"
Sep 11 13:26:17.901393 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.901059    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy"
Sep 11 13:26:17.901393 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.901065    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy"
Sep 11 13:26:17.901393 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.901078    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed564106-cf0a-4d94-a0df-2b00b0dcb66a" containerName="revoke-keys"
Sep 11 13:26:17.904205 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.904165    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:17.912756 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.912728    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:26:17.913149 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.912739    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:26:17.913490 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.913429    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 13:26:17.913490 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.913477    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2t5gt\""
Sep 11 13:26:17.913739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.913718    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:26:17.917772 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.917747    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"]
Sep 11 13:26:17.962571 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.962538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-maas-api-tls\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:17.962705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.962580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpvcd\" (UniqueName: \"kubernetes.io/projected/58c55c5b-7785-4004-bb64-61112aef3d57-kube-api-access-kpvcd\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:17.962705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.962604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-metrics-certs\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:17.962781 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:17.962725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c55c5b-7785-4004-bb64-61112aef3d57-openshift-service-ca\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.063200 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.063135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c55c5b-7785-4004-bb64-61112aef3d57-openshift-service-ca\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.063385 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.063234    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-maas-api-tls\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.063385 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.063278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpvcd\" (UniqueName: \"kubernetes.io/projected/58c55c5b-7785-4004-bb64-61112aef3d57-kube-api-access-kpvcd\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.063385 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.063307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-metrics-certs\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.063896 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.063878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c55c5b-7785-4004-bb64-61112aef3d57-openshift-service-ca\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.066087 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.066063    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-maas-api-tls\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.066210 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.066123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-metrics-certs\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.070429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.070408    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpvcd\" (UniqueName: \"kubernetes.io/projected/58c55c5b-7785-4004-bb64-61112aef3d57-kube-api-access-kpvcd\") pod \"maas-api-7ff8fbcd4f-kskmj\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") " pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.223547 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.223457    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:18.300883 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.300852    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:26:18.497047 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.497020    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"]
Sep 11 13:26:18.498963 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:26:18.498934    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c55c5b_7785_4004_bb64_61112aef3d57.slice/crio-3ad112059474e66d77d186c3a83a17fdef459a78629d8d8156a6958104535fc1 WatchSource:0}: Error finding container 3ad112059474e66d77d186c3a83a17fdef459a78629d8d8156a6958104535fc1: Status 404 returned error can't find the container with id 3ad112059474e66d77d186c3a83a17fdef459a78629d8d8156a6958104535fc1
Sep 11 13:26:18.500752 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:18.500736    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:26:19.125032 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:19.125002    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj" event={"ID":"58c55c5b-7785-4004-bb64-61112aef3d57","Type":"ContainerStarted","Data":"2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5"}
Sep 11 13:26:19.125436 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:19.125049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj" event={"ID":"58c55c5b-7785-4004-bb64-61112aef3d57","Type":"ContainerStarted","Data":"3ad112059474e66d77d186c3a83a17fdef459a78629d8d8156a6958104535fc1"}
Sep 11 13:26:19.125436 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:19.125080    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:19.143503 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:19.143458    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj" podStartSLOduration=1.7088865850000001 podStartE2EDuration="2.143440528s" totalImagesPullingTime="434.553943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:26:19.14190003 +0000 UTC m=+2357.216362794" watchObservedRunningTime="2026-09-11 13:26:19.143440528 +0000 UTC m=+2357.217903288"
Sep 11 13:26:25.136682 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.136646    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:25.825528 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.825489    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:26:25.936247 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.936211    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"]
Sep 11 13:26:25.936639 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.936622    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy"
Sep 11 13:26:25.936687 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.936642    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy"
Sep 11 13:26:25.936723 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.936718    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="98fbb862-41ce-4491-b1f6-3bf465f8f534" containerName="istio-proxy"
Sep 11 13:26:25.936763 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.936728    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad3375a-b0d8-495f-9bbc-6a678f10482a" containerName="istio-proxy"
Sep 11 13:26:25.939961 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.939945    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:25.953907 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:25.953881    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"]
Sep 11 13:26:26.037698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.037657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52d07d78-ef9d-487f-8b82-8b3efdfea669-maas-api-tls\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.037698 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.037699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d07d78-ef9d-487f-8b82-8b3efdfea669-openshift-service-ca\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.037950 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.037728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd4sw\" (UniqueName: \"kubernetes.io/projected/52d07d78-ef9d-487f-8b82-8b3efdfea669-kube-api-access-qd4sw\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.037950 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.037843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52d07d78-ef9d-487f-8b82-8b3efdfea669-metrics-certs\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.139402 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.139310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52d07d78-ef9d-487f-8b82-8b3efdfea669-metrics-certs\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.139402 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.139380    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52d07d78-ef9d-487f-8b82-8b3efdfea669-maas-api-tls\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.139402 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.139399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d07d78-ef9d-487f-8b82-8b3efdfea669-openshift-service-ca\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.139956 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.139418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd4sw\" (UniqueName: \"kubernetes.io/projected/52d07d78-ef9d-487f-8b82-8b3efdfea669-kube-api-access-qd4sw\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.140125 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.140106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d07d78-ef9d-487f-8b82-8b3efdfea669-openshift-service-ca\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.141901 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.141876    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52d07d78-ef9d-487f-8b82-8b3efdfea669-metrics-certs\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.142026 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.141904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52d07d78-ef9d-487f-8b82-8b3efdfea669-maas-api-tls\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.147470 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.147449    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd4sw\" (UniqueName: \"kubernetes.io/projected/52d07d78-ef9d-487f-8b82-8b3efdfea669-kube-api-access-qd4sw\") pod \"maas-api-7f866d8d77-2v9c4\" (UID: \"52d07d78-ef9d-487f-8b82-8b3efdfea669\") " pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.250188 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.250149    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:26.530232 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:26.528191    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"]
Sep 11 13:26:27.171969 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:27.171889    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4" event={"ID":"52d07d78-ef9d-487f-8b82-8b3efdfea669","Type":"ContainerStarted","Data":"30a531f4705fb9246a4d5bab488507fe576f7cc4324b13395f4fc0873f8f6870"}
Sep 11 13:26:27.171969 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:27.171945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4" event={"ID":"52d07d78-ef9d-487f-8b82-8b3efdfea669","Type":"ContainerStarted","Data":"f3637d5f2e135141c53112d49a81ffed2f6c92e37be91af34e868a4e2b06dbd0"}
Sep 11 13:26:27.172470 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:27.172090    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:27.189465 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:27.189401    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4" podStartSLOduration=1.849966045 podStartE2EDuration="2.189386161s" totalImagesPullingTime="339.420116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:26:27.188296658 +0000 UTC m=+2365.262759423" watchObservedRunningTime="2026-09-11 13:26:27.189386161 +0000 UTC m=+2365.263848980"
Sep 11 13:26:32.571056 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:32.571016    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:32.907689 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:32.907602    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:26:33.182693 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:33.182601    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f866d8d77-2v9c4"
Sep 11 13:26:33.241414 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:33.241375    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"]
Sep 11 13:26:33.241731 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:33.241693    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj" podUID="58c55c5b-7785-4004-bb64-61112aef3d57" containerName="maas-api" containerID="cri-o://2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5" gracePeriod=30
Sep 11 13:26:34.489738 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.489712    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:34.613014 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.612930    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c55c5b-7785-4004-bb64-61112aef3d57-openshift-service-ca\") pod \"58c55c5b-7785-4004-bb64-61112aef3d57\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") "
Sep 11 13:26:34.613014 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.612982    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-metrics-certs\") pod \"58c55c5b-7785-4004-bb64-61112aef3d57\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") "
Sep 11 13:26:34.613259 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.613032    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpvcd\" (UniqueName: \"kubernetes.io/projected/58c55c5b-7785-4004-bb64-61112aef3d57-kube-api-access-kpvcd\") pod \"58c55c5b-7785-4004-bb64-61112aef3d57\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") "
Sep 11 13:26:34.613259 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.613051    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-maas-api-tls\") pod \"58c55c5b-7785-4004-bb64-61112aef3d57\" (UID: \"58c55c5b-7785-4004-bb64-61112aef3d57\") "
Sep 11 13:26:34.613366 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.613264    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58c55c5b-7785-4004-bb64-61112aef3d57-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58c55c5b-7785-4004-bb64-61112aef3d57" (UID: "58c55c5b-7785-4004-bb64-61112aef3d57"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:26:34.613439 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.613419    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c55c5b-7785-4004-bb64-61112aef3d57-openshift-service-ca\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:26:34.615343 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.615320    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "58c55c5b-7785-4004-bb64-61112aef3d57" (UID: "58c55c5b-7785-4004-bb64-61112aef3d57"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:26:34.615872 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.615856    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58c55c5b-7785-4004-bb64-61112aef3d57" (UID: "58c55c5b-7785-4004-bb64-61112aef3d57"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:26:34.615956 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.615878    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58c55c5b-7785-4004-bb64-61112aef3d57-kube-api-access-kpvcd" (OuterVolumeSpecName: "kube-api-access-kpvcd") pod "58c55c5b-7785-4004-bb64-61112aef3d57" (UID: "58c55c5b-7785-4004-bb64-61112aef3d57"). InnerVolumeSpecName "kube-api-access-kpvcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:26:34.714053 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.714008    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-maas-api-tls\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:26:34.714053 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.714046    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c55c5b-7785-4004-bb64-61112aef3d57-metrics-certs\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:26:34.714053 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:34.714055    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpvcd\" (UniqueName: \"kubernetes.io/projected/58c55c5b-7785-4004-bb64-61112aef3d57-kube-api-access-kpvcd\") on node \"ip-10-0-128-225.ec2.internal\" DevicePath \"\""
Sep 11 13:26:35.214469 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.214431    2573 generic.go:356] "Generic (PLEG): container finished" podID="58c55c5b-7785-4004-bb64-61112aef3d57" containerID="2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5" exitCode=0
Sep 11 13:26:35.214685 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.214481    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"
Sep 11 13:26:35.214685 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.214518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj" event={"ID":"58c55c5b-7785-4004-bb64-61112aef3d57","Type":"ContainerDied","Data":"2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5"}
Sep 11 13:26:35.214685 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.214573    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj" event={"ID":"58c55c5b-7785-4004-bb64-61112aef3d57","Type":"ContainerDied","Data":"3ad112059474e66d77d186c3a83a17fdef459a78629d8d8156a6958104535fc1"}
Sep 11 13:26:35.214685 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.214589    2573 scope.go:117] "RemoveContainer" containerID="2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5"
Sep 11 13:26:35.224532 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.224511    2573 scope.go:117] "RemoveContainer" containerID="2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5"
Sep 11 13:26:35.224830 ip-10-0-128-225 kubenswrapper[2573]: E0911 13:26:35.224810    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5\": container with ID starting with 2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5 not found: ID does not exist" containerID="2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5"
Sep 11 13:26:35.224911 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.224840    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5"} err="failed to get container status \"2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5\": rpc error: code = NotFound desc = could not find container \"2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5\": container with ID starting with 2f7500716b1ecc9ea9d67ca849bf3e3c5a949e43bcefd07b3af3a68b0fb226a5 not found: ID does not exist"
Sep 11 13:26:35.240906 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.240879    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"]
Sep 11 13:26:35.245317 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:35.245292    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff8fbcd4f-kskmj"]
Sep 11 13:26:36.517900 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:36.517862    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58c55c5b-7785-4004-bb64-61112aef3d57" path="/var/lib/kubelet/pods/58c55c5b-7785-4004-bb64-61112aef3d57/volumes"
Sep 11 13:26:41.413109 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:41.413073    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:26:48.912083 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:48.912000    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nfcf"]
Sep 11 13:26:52.228669 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:52.228635    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ff6846bfb-4zrg6_7c7e7632-9df1-4688-9e19-5f05e440975f/authorino/0.log"
Sep 11 13:26:58.532540 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:58.532507    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbb4999dc-xmtgw_b70ae903-38b0-41fb-9126-c13061578806/copy-manifests/0.log"
Sep 11 13:26:58.539188 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:58.539152    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbb4999dc-xmtgw_b70ae903-38b0-41fb-9126-c13061578806/manager/0.log"
Sep 11 13:26:59.032868 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:59.032838    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f866d8d77-2v9c4_52d07d78-ef9d-487f-8b82-8b3efdfea669/maas-api/0.log"
Sep 11 13:26:59.289004 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:26:59.288976    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818875-bvhsz_6a3f81e6-bcb7-4868-aa71-26d001981024/cleanup/0.log"
Sep 11 13:27:00.254541 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:00.254499    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ff6846bfb-4zrg6_7c7e7632-9df1-4688-9e19-5f05e440975f/authorino/0.log"
Sep 11 13:27:00.620813 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:00.620770    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-7tw9g_ced116a1-5055-4296-a8c3-4a24c8f894f3/kuadrant-console-plugin/0.log"
Sep 11 13:27:00.884737 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:00.884651    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5nfcf_e53dd8e0-2ce0-43b8-8da4-4e68d0859173/limitador/0.log"
Sep 11 13:27:01.766571 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:01.766537    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75775448dd-dd7w4_f465c9a8-4b49-4789-be17-49524afcbc8c/kube-auth-proxy/0.log"
Sep 11 13:27:02.265324 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:02.265293    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587cc5f64b-ntxkx_1d3447b5-569c-4668-8694-213ff5c1d709/router/0.log"
Sep 11 13:27:02.751422 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:02.751385    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fpqlt_d3cde241-dca6-49f2-b511-fc82cdcb391d/main/0.log"
Sep 11 13:27:02.792318 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:02.792293    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:27:02.795948 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:02.795926    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:27:02.797982 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:02.797962    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:27:02.801778 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:02.801763    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn6l6_5e8a0fa2-9918-4049-a1ba-d0aa7f1dc476/ovn-acl-logging/0.log"
Sep 11 13:27:03.229750 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:03.229705    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-b5lmn_e311f23c-ff95-4629-bae6-baaac36af370/main/0.log"
Sep 11 13:27:03.348807 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:03.348699    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-z6l5m_32f0c672-8fc5-40e8-a1a3-8b144fbffef6/main/0.log"
Sep 11 13:27:09.050722 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:09.050680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:09.138979 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:09.138941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:12.119429 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:12.119392    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mtkkj_00207c1c-888a-415e-8ed8-ed3758102a85/global-pull-secret-syncer/0.log"
Sep 11 13:27:12.211518 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:12.211476    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7hnc6_e8d9c1b8-bbbe-4d59-9dca-740badddfb6f/konnectivity-agent/0.log"
Sep 11 13:27:12.303703 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:12.303676    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-225.ec2.internal_a9ec5a36a4072dcc75611810c0d28d1c/haproxy/0.log"
Sep 11 13:27:16.888656 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:16.888611    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ff6846bfb-4zrg6_7c7e7632-9df1-4688-9e19-5f05e440975f/authorino/0.log"
Sep 11 13:27:17.018557 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:17.018528    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-7tw9g_ced116a1-5055-4296-a8c3-4a24c8f894f3/kuadrant-console-plugin/0.log"
Sep 11 13:27:17.158918 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:17.158806    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5nfcf_e53dd8e0-2ce0-43b8-8da4-4e68d0859173/limitador/0.log"
Sep 11 13:27:18.749419 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.749386    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff/alertmanager/0.log"
Sep 11 13:27:18.779808 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.779780    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff/config-reloader/0.log"
Sep 11 13:27:18.803285 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.803263    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff/kube-rbac-proxy-web/0.log"
Sep 11 13:27:18.841986 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.841951    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff/kube-rbac-proxy/0.log"
Sep 11 13:27:18.866872 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.866805    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff/kube-rbac-proxy-metric/0.log"
Sep 11 13:27:18.890762 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.890738    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff/prom-label-proxy/0.log"
Sep 11 13:27:18.913724 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.913703    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f9ed8e-601b-4abe-a0a2-b7f119eeb0ff/init-config-reloader/0.log"
Sep 11 13:27:18.955313 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.955287    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-qv4lt_c515922d-1ac8-45d8-8528-7d96eb381c55/cluster-monitoring-operator/0.log"
Sep 11 13:27:18.984601 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:18.984574    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-tqpsw_4e13922b-e315-44d5-8484-d4ce3dd77558/kube-state-metrics/0.log"
Sep 11 13:27:19.006970 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.006898    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-tqpsw_4e13922b-e315-44d5-8484-d4ce3dd77558/kube-rbac-proxy-main/0.log"
Sep 11 13:27:19.034945 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.034916    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-tqpsw_4e13922b-e315-44d5-8484-d4ce3dd77558/kube-rbac-proxy-self/0.log"
Sep 11 13:27:19.334186 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.334147    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wx8vc_05b934e5-870f-49ce-a8e2-ad18e7be4201/node-exporter/0.log"
Sep 11 13:27:19.359287 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.359250    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wx8vc_05b934e5-870f-49ce-a8e2-ad18e7be4201/kube-rbac-proxy/0.log"
Sep 11 13:27:19.386619 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.386597    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wx8vc_05b934e5-870f-49ce-a8e2-ad18e7be4201/init-textfile/0.log"
Sep 11 13:27:19.773154 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.773078    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-vskkp_f662d25b-ee6d-4848-b324-a0235ae400d0/prometheus-operator/0.log"
Sep 11 13:27:19.794653 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.794631    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-vskkp_f662d25b-ee6d-4848-b324-a0235ae400d0/kube-rbac-proxy/0.log"
Sep 11 13:27:19.861303 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.861277    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78f86d4c96-4fwcn_686fb87c-8f36-4406-952b-e15842b38c09/telemeter-client/0.log"
Sep 11 13:27:19.889897 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.889874    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78f86d4c96-4fwcn_686fb87c-8f36-4406-952b-e15842b38c09/reload/0.log"
Sep 11 13:27:19.914938 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:19.914914    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78f86d4c96-4fwcn_686fb87c-8f36-4406-952b-e15842b38c09/kube-rbac-proxy/0.log"
Sep 11 13:27:21.489745 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:21.489719    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-pr4pc_78459e83-a7f9-49d2-8c93-6c8a4fdf4737/networking-console-plugin/0.log"
Sep 11 13:27:22.063373 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.063266    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"]
Sep 11 13:27:22.063717 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.063701    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58c55c5b-7785-4004-bb64-61112aef3d57" containerName="maas-api"
Sep 11 13:27:22.063778 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.063720    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="58c55c5b-7785-4004-bb64-61112aef3d57" containerName="maas-api"
Sep 11 13:27:22.063815 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.063798    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="58c55c5b-7785-4004-bb64-61112aef3d57" containerName="maas-api"
Sep 11 13:27:22.066766 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.066748    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.068927 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.068907    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vrzcr\"/\"kube-root-ca.crt\""
Sep 11 13:27:22.069005 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.068970    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vrzcr\"/\"openshift-service-ca.crt\""
Sep 11 13:27:22.069005 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.068916    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vrzcr\"/\"default-dockercfg-fwnzv\""
Sep 11 13:27:22.078247 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.078222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"]
Sep 11 13:27:22.150620 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.150594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-lib-modules\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.150769 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.150630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-podres\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.150817 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.150762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-proc\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.150817 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.150802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvl6g\" (UniqueName: \"kubernetes.io/projected/1611bffe-91de-42f7-8f75-3c48ec0aae9c-kube-api-access-pvl6g\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.150888 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.150866    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-sys\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.155379 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.155359    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/2.log"
Sep 11 13:27:22.159594 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.159578    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ljjvs_55ada48c-34c3-47d4-b837-ed9d3823c489/console-operator/3.log"
Sep 11 13:27:22.252021 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.251993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-proc\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.252164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.252031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvl6g\" (UniqueName: \"kubernetes.io/projected/1611bffe-91de-42f7-8f75-3c48ec0aae9c-kube-api-access-pvl6g\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.252164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.252054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-sys\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.252164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.252119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-sys\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.252164 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.252120    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-proc\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.252344 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.252190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-lib-modules\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.252344 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.252218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-podres\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.252420 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.252363    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-lib-modules\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.252420 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.252370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1611bffe-91de-42f7-8f75-3c48ec0aae9c-podres\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.260455 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.260424    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvl6g\" (UniqueName: \"kubernetes.io/projected/1611bffe-91de-42f7-8f75-3c48ec0aae9c-kube-api-access-pvl6g\") pod \"perf-node-gather-daemonset-m2xqk\" (UID: \"1611bffe-91de-42f7-8f75-3c48ec0aae9c\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.377395 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.377313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:22.652275 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.652249    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"]
Sep 11 13:27:22.654314 ip-10-0-128-225 kubenswrapper[2573]: W0911 13:27:22.654285    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1611bffe_91de_42f7_8f75_3c48ec0aae9c.slice/crio-affb4e17f9ae47a6d5da450b7c37cfdb98252e32eca85512cd59c5c3a542e99f WatchSource:0}: Error finding container affb4e17f9ae47a6d5da450b7c37cfdb98252e32eca85512cd59c5c3a542e99f: Status 404 returned error can't find the container with id affb4e17f9ae47a6d5da450b7c37cfdb98252e32eca85512cd59c5c3a542e99f
Sep 11 13:27:22.731697 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:22.731675    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-779cb767d8-dmlbr_f501c60a-c9ba-42e2-8e9a-82a3b1d17ebc/console/0.log"
Sep 11 13:27:23.490705 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:23.490666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk" event={"ID":"1611bffe-91de-42f7-8f75-3c48ec0aae9c","Type":"ContainerStarted","Data":"005b738b16f64f3fbb0c8ac9b70c6d90c23801a460f5239edcde69e68eebf0fd"}
Sep 11 13:27:23.490897 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:23.490765    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk" event={"ID":"1611bffe-91de-42f7-8f75-3c48ec0aae9c","Type":"ContainerStarted","Data":"affb4e17f9ae47a6d5da450b7c37cfdb98252e32eca85512cd59c5c3a542e99f"}
Sep 11 13:27:23.490897 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:23.490792    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:23.510663 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:23.510635    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-ptvlq_97fb5f2f-400c-4d0b-ba77-572577ce7daa/volume-data-source-validator/0.log"
Sep 11 13:27:23.516788 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:23.516739    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk" podStartSLOduration=1.516720956 podStartE2EDuration="1.516720956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:23.513533136 +0000 UTC m=+2421.587995900" watchObservedRunningTime="2026-09-11 13:27:23.516720956 +0000 UTC m=+2421.591183719"
Sep 11 13:27:24.666879 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:24.666808    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d65zw_5fa467b7-52a9-468c-9be9-916acfc8541d/dns/0.log"
Sep 11 13:27:24.707677 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:24.707645    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d65zw_5fa467b7-52a9-468c-9be9-916acfc8541d/kube-rbac-proxy/0.log"
Sep 11 13:27:24.892463 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:24.892438    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wztjz_13e22d30-dab1-41df-a83d-2530f9f9cfba/dns-node-resolver/0.log"
Sep 11 13:27:25.496307 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:25.496272    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-btzwl_a3ab1a90-bc67-4d9d-9c80-0559e467e1d1/node-ca/0.log"
Sep 11 13:27:26.917823 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:26.917793    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75775448dd-dd7w4_f465c9a8-4b49-4789-be17-49524afcbc8c/kube-auth-proxy/0.log"
Sep 11 13:27:27.057640 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:27.057616    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587cc5f64b-ntxkx_1d3447b5-569c-4668-8694-213ff5c1d709/router/0.log"
Sep 11 13:27:27.937818 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:27.937788    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9qsb6_2c2e050e-3b78-4c92-a219-9ca503b9d674/serve-healthcheck-canary/0.log"
Sep 11 13:27:28.701796 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:28.701766    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79xvb_a390ebca-bf3b-48c2-a476-74680b3e4c51/kube-rbac-proxy/0.log"
Sep 11 13:27:28.723059 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:28.723036    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79xvb_a390ebca-bf3b-48c2-a476-74680b3e4c51/exporter/0.log"
Sep 11 13:27:28.746406 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:28.746385    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79xvb_a390ebca-bf3b-48c2-a476-74680b3e4c51/extractor/0.log"
Sep 11 13:27:29.507605 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:29.507577    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-m2xqk"
Sep 11 13:27:31.772739 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:31.772713    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbb4999dc-xmtgw_b70ae903-38b0-41fb-9126-c13061578806/manager/0.log"
Sep 11 13:27:31.798796 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:31.798772    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbb4999dc-xmtgw_b70ae903-38b0-41fb-9126-c13061578806/copy-manifests/0.log"
Sep 11 13:27:33.366791 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:33.366765    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5655dcc49-drdwh_c362234e-ce14-4ef9-9358-e3d995f46f47/manager/0.log"
Sep 11 13:27:33.387685 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:33.387621    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75775448dd-dd7w4_f465c9a8-4b49-4789-be17-49524afcbc8c/kube-auth-proxy/0.log"
Sep 11 13:27:33.397667 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:33.397640    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-sb6dn_becbe09f-34a1-4ed9-9abe-fd68eb17922d/openshift-lws-operator/0.log"
Sep 11 13:27:33.498583 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:33.498553    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587cc5f64b-ntxkx_1d3447b5-569c-4668-8694-213ff5c1d709/router/0.log"
Sep 11 13:27:35.255250 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:35.255219    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75775448dd-dd7w4_f465c9a8-4b49-4789-be17-49524afcbc8c/kube-auth-proxy/0.log"
Sep 11 13:27:35.381680 ip-10-0-128-225 kubenswrapper[2573]: I0911 13:27:35.381655    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587cc5f64b-ntxkx_1d3447b5-569c-4668-8694-213ff5c1d709/router/0.log"