Sep 08 13:56:40.185234 ip-10-0-142-105 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 13:56:40.185407 ip-10-0-142-105 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 13:56:40.185507 ip-10-0-142-105 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 13:56:40.185971 ip-10-0-142-105 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 13:56:50.245673 ip-10-0-142-105 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Sep 08 13:56:50.245686 ip-10-0-142-105 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 73d4dc109c694af9b3f12a2f79d466d6 --
Sep 08 13:58:23.955929 ip-10-0-142-105 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 13:58:24.404874 ip-10-0-142-105 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:58:24.404874 ip-10-0-142-105 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 13:58:24.404874 ip-10-0-142-105 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:58:24.404874 ip-10-0-142-105 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 13:58:24.404874 ip-10-0-142-105 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:58:24.405795 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.405710    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 13:58:24.413120 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413100    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:24.413120 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413121    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413125    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413128    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413131    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413134    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413137    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413141    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413144    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413147    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413150    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413153    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413156    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413164    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413167    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413170    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413173    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413175    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413178    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413181    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:24.413192 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413183    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413186    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413188    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413191    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413194    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413197    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413201    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413203    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413206    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413209    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413211    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413214    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413216    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413219    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413221    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413224    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413226    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413229    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413231    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413234    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:24.413650 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413237    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413239    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413242    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413244    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413247    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413250    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413253    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413255    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413258    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413261    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413263    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413266    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413268    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413271    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413273    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413277    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413279    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413283    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413285    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413288    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:24.414138 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413290    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413293    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413296    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413298    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413301    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413303    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413305    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413308    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413311    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413315    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413320    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413325    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413328    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413331    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413334    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413336    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413339    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413344    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413347    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:24.414630 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413350    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413353    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413356    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413359    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413361    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413364    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413367    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413369    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413372    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413375    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413378    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413381    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413383    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413386    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413389    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413393    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413396    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413399    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413401    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:24.415085 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.413404    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414160    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414168    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414171    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414174    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414177    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414181    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414185    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414189    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414192    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414195    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414198    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414201    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414204    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414206    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414209    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414211    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414214    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414217    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414219    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:24.415578 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414222    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414226    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414228    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414231    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414233    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414236    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414239    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414243    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414246    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414249    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414252    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414255    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414258    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414260    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414263    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414265    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414268    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414270    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414274    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:24.416094 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414277    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414280    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414283    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414285    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414288    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414291    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414293    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414296    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414299    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414302    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414304    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414307    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414309    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414311    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414315    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414319    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414322    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414324    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414327    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414329    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:24.416553 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414332    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414334    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414336    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414339    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414341    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414344    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414346    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414348    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414351    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414353    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414356    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414359    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414362    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414366    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414369    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414372    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414374    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414377    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414379    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414382    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:24.417065 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414384    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414387    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414389    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414392    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414394    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414396    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414399    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414401    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414405    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414407    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414412    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414415    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414418    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414421    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414423    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414426    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414428    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414431    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414433    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:24.417555 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414436    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414439    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414870    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414876    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414880    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414883    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414886    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414890    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414894    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414897    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414900    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414903    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414906    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414909    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414911    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414914    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414917    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414919    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414922    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414925    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:24.418042 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414928    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414930    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414933    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414935    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414938    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414940    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414943    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414945    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414948    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414950    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414953    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414956    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414958    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414961    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414964    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414966    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414970    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414972    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414976    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:24.418527 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414985    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414988    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414990    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414993    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414995    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.414998    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415000    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415003    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415006    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415010    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415014    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415017    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415020    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415023    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415026    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415029    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415031    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415034    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415037    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:24.418998 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415039    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415042    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415044    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415047    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415049    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415052    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415054    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415057    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415059    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415062    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415069    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415071    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415074    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415076    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415080    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415083    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415085    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415088    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415090    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415093    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:24.419448 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415096    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415100    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415102    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415105    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415107    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415110    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415112    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415114    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415117    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415119    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415122    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415125    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415127    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415130    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415132    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415135    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415137    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415140    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415142    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415145    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:24.420052 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415148    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415150    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415155    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415229    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415265    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415272    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415277    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415282    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415285    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415289    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415294    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415297    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415300    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415304    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415307    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415310    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415313    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415317    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415319    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415322    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415326    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415332    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415335    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415338    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 13:58:24.420574 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415341    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415344    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415348    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415351    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415354    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415358    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415361    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415364    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415367    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415370    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415374    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415378    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415381    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415384    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415386    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415389    2559 flags.go:64] FLAG: --enable-server="true"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415393    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415401    2559 flags.go:64] FLAG: --event-burst="100"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415404    2559 flags.go:64] FLAG: --event-qps="50"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415407    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415410    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415413    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415416    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415419    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415422    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 13:58:24.421157 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415425    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415428    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415430    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415433    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415438    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415440    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415443    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415446    2559 flags.go:64] FLAG: --feature-gates=""
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415450    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415453    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415456    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415459    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415462    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415465    2559 flags.go:64] FLAG: --help="false"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415467    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415470    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415473    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415478    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415481    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415484    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415487    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415490    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415493    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 13:58:24.421775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415496    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415504    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415508    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415510    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415513    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415516    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415519    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415521    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415524    2559 flags.go:64] FLAG: --lock-file=""
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415527    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415530    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415533    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415538    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415542    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415545    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415548    2559 flags.go:64] FLAG: --logging-format="text"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415551    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415554    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415556    2559 flags.go:64] FLAG: --manifest-url=""
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415559    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415563    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415566    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415570    2559 flags.go:64] FLAG: --max-pods="110"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415573    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415576    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 13:58:24.422361 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415579    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415583    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415586    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415589    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415592    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415600    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415603    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415620    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415623    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415632    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415638    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415642    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415645    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415647    2559 flags.go:64] FLAG: --port="10250"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415650    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415653    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0674b5bb90b4974a6"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415656    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415659    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415662    2559 flags.go:64] FLAG: --register-node="true"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415665    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415670    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415673    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415675    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415678    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415682    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 13:58:24.422983 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415685    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415688    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415690    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415693    2559 flags.go:64] FLAG: --runonce="false"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415696    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415699    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415702    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415705    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415708    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415711    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415714    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415717    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415720    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415722    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415725    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415727    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415730    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415738    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415741    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415746    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415749    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415752    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415758    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415761    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415763    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 13:58:24.423641 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415766    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415769    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415773    2559 flags.go:64] FLAG: --v="2"
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415777    2559 flags.go:64] FLAG: --version="false"
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415781    2559 flags.go:64] FLAG: --vmodule=""
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415786    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.415789    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415911    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415915    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415918    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415921    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415924    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415928    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415930    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415933    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415936    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415938    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415941    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415943    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415945    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415948    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:24.424254 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415950    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415953    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415956    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415958    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415962    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415966    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415969    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415972    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415975    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415977    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415980    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415982    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415985    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415989    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415992    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415994    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415997    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.415999    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416002    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416005    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:24.424765 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416007    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416010    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416012    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416015    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416017    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416020    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416023    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416025    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416028    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416030    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416033    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416037    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416040    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416043    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416046    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416048    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416051    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416055    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416057    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:24.425256 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416060    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416063    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416065    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416067    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416070    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416072    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416076    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416079    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416082    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416084    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416087    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416089    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416092    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416094    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416097    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416100    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416103    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416107    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416110    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416113    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:24.425757 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416116    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416119    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416121    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416124    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416126    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416129    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416132    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416134    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416137    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416139    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416141    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416144    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416147    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416149    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416152    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416154    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416156    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416159    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416162    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:24.426245 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416166    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416168    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416171    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416173    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416176    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416178    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.416181    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.416186    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.425137    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.425156    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.425174    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.425179    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425257    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425263    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425267    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:24.426716 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425271    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425275    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425278    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425281    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425284    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425287    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425290    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425292    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425295    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425298    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425300    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425303    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425306    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425308    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425311    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425313    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425316    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425320    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425324    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425327    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:24.427137 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425330    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425332    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425335    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425337    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425340    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425342    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425346    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425349    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425352    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425354    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425357    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425359    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425362    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425365    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425367    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425370    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425372    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425375    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425377    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:24.427629 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425380    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425382    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425385    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425388    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425390    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425393    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425396    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425398    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425401    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425403    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425406    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425408    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425411    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425413    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425416    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425419    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425421    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425423    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425426    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425429    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:24.428092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425432    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425435    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425437    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425440    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425443    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425445    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425448    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425450    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425455    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425458    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425461    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425464    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425467    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425470    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425472    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425475    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425478    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425481    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425483    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:24.428569 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425486    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425488    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425491    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425493    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425496    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425498    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425501    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425503    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425506    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425508    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425511    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425514    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425517    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425520    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425524    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425528    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425531    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:24.429047 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425534    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.425539    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425678    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425684    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425687    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425690    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425693    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425696    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425699    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425701    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425704    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425707    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425710    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425712    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425715    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:58:24.429460 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425718    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425720    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425723    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425725    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425728    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425731    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425733    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425736    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425738    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425741    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425743    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425746    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425750    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425754    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425757    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425760    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425764    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425767    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425770    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425773    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:58:24.429864 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425775    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425778    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425780    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425783    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425785    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425788    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425790    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425793    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425796    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425798    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425801    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425803    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425806    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425808    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425811    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425813    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425816    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425818    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425821    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425823    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:58:24.430351 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425826    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425828    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425831    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425833    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425837    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425840    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425842    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425845    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425848    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425851    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425854    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425856    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425859    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425862    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425864    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425867    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425869    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425872    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425874    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425877    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:58:24.431000 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425879    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425882    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425884    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425887    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425889    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425892    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425894    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425897    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425900    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425903    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425905    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425909    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425912    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425915    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425918    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425920    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425923    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425926    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425928    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:58:24.431472 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425932    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425936    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425940    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425943    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425945    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425948    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:24.425950    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.425955    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.426099    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.428551    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.429678    2559 server.go:1019] "Starting client certificate rotation"
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.429783    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 13:58:24.431939 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.430709    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 13:58:24.432650 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.432629    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 13:58:24.437891 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.437845    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 13:58:24.448285 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.448266    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 08 13:58:24.451715 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.451696    2559 log.go:25] "Validated CRI v1 image API"
Sep 08 13:58:24.456158 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.456131    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 13:58:24.458955 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.458920    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e365485f-7474-439f-b2e7-f32d9581f529:/dev/nvme0n1p4 fd2edf9b-5f53-4b91-9a7d-e4d9872916c1:/dev/nvme0n1p3]
Sep 08 13:58:24.459054 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.458951    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 13:58:24.463496 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.463368    2559 manager.go:216] Machine: {Timestamp:2026-09-08 13:58:24.462850425 +0000 UTC m=+0.376755331 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099176 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c4be8575fd4a0c4dd774a040b831d SystemUUID:ec2c4be8-575f-d4a0-c4dd-774a040b831d BootID:73d4dc10-9c69-4af9-b3f1-2a2f79d466d6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:e1:00:69:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:e1:00:69:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:f7:f1:ba:95:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 13:58:24.463496 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.463478    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 13:58:24.463735 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.463663    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 13:58:24.466566 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.466535    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 13:58:24.466748 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.466569    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 13:58:24.467476 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.467465    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 13:58:24.467512 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.467479    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 13:58:24.467512 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.467488    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 13:58:24.467512 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.467503    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 13:58:24.468786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.468774    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 13:58:24.473440 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.473427    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 13:58:24.473565 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.473555    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 13:58:24.473600 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.473588    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 13:58:24.473600 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.473599    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 13:58:24.473699 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.473629    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 13:58:24.473699 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.473639    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 08 13:58:24.473699 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.473655    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 13:58:24.474071 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.474056    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 13:58:24.474139 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.474082    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 13:58:24.474768 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.474744    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 13:58:24.476667 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.476640    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 13:58:24.479617 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.479593    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 13:58:24.479681 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.479641    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 13:58:24.481713 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481698    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 13:58:24.481778 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481725    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 13:58:24.481778 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481735    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 13:58:24.481778 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481743    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 13:58:24.481778 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481758    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 13:58:24.481778 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481766    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 13:58:24.481933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481785    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 13:58:24.481933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481794    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 13:58:24.481933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481804    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 13:58:24.481933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481813    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 13:58:24.481933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481826    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 13:58:24.481933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.481834    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 13:58:24.483599 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.483585    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 13:58:24.483657 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.483600    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 13:58:24.487949 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.487935    2559 server.go:1268] "Started kubelet"
Sep 08 13:58:24.488071 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.488018    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 13:58:24.488127 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.488027    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 13:58:24.488127 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.488113    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 13:58:24.488782 ip-10-0-142-105 systemd[1]: Started Kubernetes Kubelet.
Sep 08 13:58:24.493711 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.493687    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 13:58:24.493790 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.493751    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 13:58:24.494123 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.494098    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 13:58:24.494123 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.494167    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 13:58:24.495017 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.494938    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 13:58:24.495381 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.495357    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 13:58:24.499575 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.499558    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 13:58:24.499575 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.499569    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 13:58:24.499743 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.499652    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:24.500354 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.500325    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 13:58:24.500438 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.500408    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 13:58:24.500438 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.500426    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 13:58:24.500517 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.500504    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 13:58:24.500517 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.500511    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 13:58:24.500830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.500809    2559 factory.go:55] Registering systemd factory
Sep 08 13:58:24.500830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.500833    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 08 13:58:24.501015 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.501003    2559 factory.go:153] Registering CRI-O factory
Sep 08 13:58:24.501015 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.501014    2559 factory.go:223] Registration of the crio container factory successfully
Sep 08 13:58:24.501117 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.501096    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 13:58:24.501117 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.501114    2559 factory.go:103] Registering Raw factory
Sep 08 13:58:24.501205 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.501128    2559 manager.go:1196] Started watching for new ooms in manager
Sep 08 13:58:24.501449 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.501437    2559 manager.go:349] Starting recovery of all containers
Sep 08 13:58:24.503733 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.503707    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 13:58:24.503816 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.503794    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 13:58:24.504639 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.503462    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-105.ec2.internal.18d35d284241dad8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-105.ec2.internal,UID:ip-10-0-142-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-105.ec2.internal,},FirstTimestamp:2026-09-08 13:58:24.487906008 +0000 UTC m=+0.401810914,LastTimestamp:2026-09-08 13:58:24.487906008 +0000 UTC m=+0.401810914,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-105.ec2.internal,}"
Sep 08 13:58:24.511679 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.511660    2559 manager.go:354] Recovery completed
Sep 08 13:58:24.513416 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.513389    2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 08 13:58:24.516805 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.516707    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:24.518602 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.518573    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:24.518713 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.518639    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:24.518713 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.518656    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:24.519343 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.519327    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 13:58:24.519343 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.519342    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 13:58:24.519447 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.519349    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:24.519447 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.519361    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 13:58:24.520334 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.520316    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:24.520408 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.520346    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:24.520408 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.520356    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:24.521746 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.521734    2559 policy_none.go:49] "None policy: Start"
Sep 08 13:58:24.521801 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.521751    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 13:58:24.521801 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.521762    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 13:58:24.523738 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.523727    2559 policy_none.go:47] "Start"
Sep 08 13:58:24.532913 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.532834    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-105.ec2.internal.18d35d2844163df2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-105.ec2.internal,UID:ip-10-0-142-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-105.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-105.ec2.internal,},FirstTimestamp:2026-09-08 13:58:24.518602226 +0000 UTC m=+0.432507139,LastTimestamp:2026-09-08 13:58:24.518602226 +0000 UTC m=+0.432507139,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-105.ec2.internal,}"
Sep 08 13:58:24.545097 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.544999    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-105.ec2.internal.18d35d284416eca7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-105.ec2.internal,UID:ip-10-0-142-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-105.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-105.ec2.internal,},FirstTimestamp:2026-09-08 13:58:24.518646951 +0000 UTC m=+0.432551871,LastTimestamp:2026-09-08 13:58:24.518646951 +0000 UTC m=+0.432551871,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-105.ec2.internal,}"
Sep 08 13:58:24.554121 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.554091    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fhwp7"
Sep 08 13:58:24.558807 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.556909    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-105.ec2.internal.18d35d2844172511  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-105.ec2.internal,UID:ip-10-0-142-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-105.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-105.ec2.internal,},FirstTimestamp:2026-09-08 13:58:24.518661393 +0000 UTC m=+0.432566303,LastTimestamp:2026-09-08 13:58:24.518661393 +0000 UTC m=+0.432566303,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-105.ec2.internal,}"
Sep 08 13:58:24.568315 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.568297    2559 manager.go:337] "Starting Device Plugin manager"
Sep 08 13:58:24.568457 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.568339    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 13:58:24.568457 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.568350    2559 server.go:87] "Starting device plugin registration server"
Sep 08 13:58:24.568676 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.568653    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 13:58:24.568768 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.568670    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 13:58:24.569039 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.568869    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 13:58:24.569039 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.568866    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-105.ec2.internal.18d35d2844163df2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-105.ec2.internal.18d35d2844163df2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-105.ec2.internal,UID:ip-10-0-142-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-105.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-105.ec2.internal,},FirstTimestamp:2026-09-08 13:58:24.518602226 +0000 UTC m=+0.432507139,LastTimestamp:2026-09-08 13:58:24.520333198 +0000 UTC m=+0.434238105,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-105.ec2.internal,}"
Sep 08 13:58:24.569039 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.568947    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 13:58:24.569039 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.568955    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 13:58:24.569600 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.569582    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 13:58:24.569686 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.569656    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:24.570143 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.570129    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fhwp7"
Sep 08 13:58:24.573719 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.573694    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 13:58:24.575093 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.575076    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 13:58:24.575152 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.575139    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 13:58:24.575191 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.575165    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 13:58:24.575233 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.575211    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 13:58:24.589030 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.589004    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:24.669105 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.668986    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:24.669990 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.669976    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:24.670113 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.670006    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:24.670113 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.670016    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:24.670113 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.670039    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.676113 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.676083    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal"]
Sep 08 13:58:24.676187 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.676161    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:24.677855 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.677836    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:24.677933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.677869    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:24.677933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.677879    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:24.680113 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680100    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:24.680257 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.680301 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680275    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:24.680912 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680882    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:24.681009 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680928    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:24.681009 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680931    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:24.681009 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680943    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:24.681009 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680950    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:24.681009 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.680965    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:24.683282 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.683256    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.683408 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.683299    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:58:24.683408 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.683355    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.683408 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.683378    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-105.ec2.internal\": node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:24.684020 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.684003    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:58:24.684087 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.684030    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:58:24.684087 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.684043    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:58:24.701809 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.701780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f270c6c3850f7c0822b29062a2b39783-config\") pod \"kube-apiserver-proxy-ip-10-0-142-105.ec2.internal\" (UID: \"f270c6c3850f7c0822b29062a2b39783\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.701933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.701814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a733d6fc62ca0f2286c43732a49ccea2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal\" (UID: \"a733d6fc62ca0f2286c43732a49ccea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.701933 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.701839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a733d6fc62ca0f2286c43732a49ccea2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal\" (UID: \"a733d6fc62ca0f2286c43732a49ccea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.706422 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.706403    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-105.ec2.internal\" not found" node="ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.711077 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.711057    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-105.ec2.internal\" not found" node="ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.787494 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.787461    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:24.802844 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.802816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a733d6fc62ca0f2286c43732a49ccea2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal\" (UID: \"a733d6fc62ca0f2286c43732a49ccea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.802942 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.802852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a733d6fc62ca0f2286c43732a49ccea2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal\" (UID: \"a733d6fc62ca0f2286c43732a49ccea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.802942 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.802867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f270c6c3850f7c0822b29062a2b39783-config\") pod \"kube-apiserver-proxy-ip-10-0-142-105.ec2.internal\" (UID: \"f270c6c3850f7c0822b29062a2b39783\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.802942 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.802928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f270c6c3850f7c0822b29062a2b39783-config\") pod \"kube-apiserver-proxy-ip-10-0-142-105.ec2.internal\" (UID: \"f270c6c3850f7c0822b29062a2b39783\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.802942 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.802928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a733d6fc62ca0f2286c43732a49ccea2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal\" (UID: \"a733d6fc62ca0f2286c43732a49ccea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.803058 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:24.802928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a733d6fc62ca0f2286c43732a49ccea2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal\" (UID: \"a733d6fc62ca0f2286c43732a49ccea2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:24.888325 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.888290    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:24.989396 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:24.989313    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:25.009819 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.009789    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:25.016241 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.016203    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:25.089734 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.089687    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:25.190375 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.190331    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:25.290955 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.290867    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:25.391521 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.391488    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-105.ec2.internal\" not found"
Sep 08 13:58:25.402536 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.402508    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:25.429365 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.429325    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 13:58:25.429894 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.429494    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 13:58:25.429894 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.429549    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 13:58:25.474717 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.474689    2559 apiserver.go:52] "Watching apiserver"
Sep 08 13:58:25.500228 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.500194    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:25.500228 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.500221    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 13:58:25.513211 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.513179    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 13:58:25.515088 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.515064    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-76nth","openshift-multus/network-metrics-daemon-lf79g","openshift-ovn-kubernetes/ovnkube-node-zcxxd","kube-system/global-pull-secret-syncer-2snxg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42","openshift-cluster-node-tuning-operator/tuned-k4gxq","openshift-multus/multus-nsdhm","openshift-network-diagnostics/network-check-target-4ch2v","openshift-network-operator/iptables-alerter-mclmn","kube-system/konnectivity-agent-8jbvv","openshift-dns/node-resolver-xb8x4","openshift-image-registry/node-ca-scgr5"]
Sep 08 13:58:25.517733 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.517716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.519939 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.519912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.522660 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.522641    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggthf\""
Sep 08 13:58:25.522898 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.522884    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.524416 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.524397    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 13:58:25.524416 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.524405    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 13:58:25.524596 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.524451    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:58:25.524928 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.524908    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 13:58:25.524999 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.524986    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 13:58:25.525156 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.525142    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:25.525262 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.525217    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:25.525336 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.525323    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 13:58:25.525379 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.525361    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mjvrl\""
Sep 08 13:58:25.525421 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.525406    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 13:58:25.525520 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.525428    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 13:58:25.525721 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.525707    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 13:58:25.525816 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.525802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 13:58:25.525899 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.525885    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rjtfm\""
Sep 08 13:58:25.526079 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.526068    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 13:58:25.527303 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.527282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.529416 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.529402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.531519 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.531503    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.533866 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.533846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.534272 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534254    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 13:58:25.534347 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534255    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:58:25.534507 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534489    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 13:58:25.534623 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534516    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 13:58:25.534623 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534538    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 13:58:25.534735 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k2ww8\""
Sep 08 13:58:25.534817 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534755    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 13:58:25.534864 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534830    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s44md\""
Sep 08 13:58:25.534929 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.534904    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 13:58:25.535248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.535233    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 13:58:25.536304 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.535774    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 13:58:25.536304 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.536076    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zcl99\""
Sep 08 13:58:25.536304 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.536167    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 13:58:25.536304 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.536079    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:25.536500 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.536316    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:25.536500 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.536329    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 13:58:25.538119 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.538092    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 13:58:25.538475 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.538462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.538524 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.538508    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:25.539038 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.539023    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z68pw\""
Sep 08 13:58:25.540936 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.540920    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.543341 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.543284    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:25.555048 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.555022    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 13:58:25.555048 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.555022    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 13:58:25.555235 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.555061    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 13:58:25.555235 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.555067    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p42l8\""
Sep 08 13:58:25.555235 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.555106    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qhlqm\""
Sep 08 13:58:25.555235 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.555042    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 13:58:25.555394 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.555358    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 13:58:25.556820 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.556807    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 13:58:25.556891 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.556881    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal"
Sep 08 13:58:25.557870 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.557854    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal"]
Sep 08 13:58:25.576756 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.576705    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 13:53:25 +0000 UTC" deadline="2028-02-04 19:22:56.121377998 +0000 UTC"
Sep 08 13:58:25.576825 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.576758    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12341h24m30.544624667s"
Sep 08 13:58:25.576947 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.576924    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal"]
Sep 08 13:58:25.577763 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.577749    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 13:58:25.602184 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.602158    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 13:58:25.607494 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7932a003-5873-4e8e-add2-4dc69b39702d-etc-tuned\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.607600 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brwbj\" (UniqueName: \"kubernetes.io/projected/7932a003-5873-4e8e-add2-4dc69b39702d-kube-api-access-brwbj\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.607600 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.607600 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607560    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-daemon-config\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.607600 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607589    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-run-netns\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.607786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607622    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-kubelet\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.607786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-system-cni-dir\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.607786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.607786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.607786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3b317c-8b92-4736-b169-694d75599ef1-host\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.607786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607735    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-device-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.607786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-etc-selinux\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.607786 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48d6c68d-5696-488b-8c0d-851fe59be022-hosts-file\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/53951034-ca2a-4a8a-ab31-d0482394d753-kubelet-config\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbb5e87d-8673-467a-a0ac-fa90af58301d-konnectivity-ca\") pod \"konnectivity-agent-8jbvv\" (UID: \"cbb5e87d-8673-467a-a0ac-fa90af58301d\") " pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-systemd\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-node-log\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-socket-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607934    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-cni-bin\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607957    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-hostroot\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.607972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d6c68d-5696-488b-8c0d-851fe59be022-tmp-dir\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-etc-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-var-lib-kubelet\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-host\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsbwx\" (UniqueName: \"kubernetes.io/projected/e3603e41-2516-4a8f-ba67-862fd59e9dc5-kube-api-access-qsbwx\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-lib-modules\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0aa705a-ff6c-4584-9def-2abe8a75fe23-iptables-alerter-script\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-k8s-cni-cncf-io\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-ovn\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21d218e5-b574-4c50-903a-2102c395babe-ovn-node-metrics-cert\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysconfig\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608306    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-kubernetes\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608331    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vldvl\" (UniqueName: \"kubernetes.io/projected/17091e92-5c7f-4372-9602-b85eeded497d-kube-api-access-vldvl\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-conf-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.608372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-kubelet\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-cni-bin\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-registration-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-sys-fs\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-cni-binary-copy\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608498    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-cni-multus\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-system-cni-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608531    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-netns\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-ovnkube-config\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-cnibin\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zs24\" (UniqueName: \"kubernetes.io/projected/0905014a-a92b-43e0-9092-01dd91124be2-kube-api-access-7zs24\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/53951034-ca2a-4a8a-ab31-d0482394d753-dbus\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-systemd-units\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-env-overrides\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.608885 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-ovnkube-script-lib\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysctl-d\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-systemd\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-log-socket\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-cni-netd\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608874    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-modprobe-d\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7932a003-5873-4e8e-add2-4dc69b39702d-tmp\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqh9\" (UniqueName: \"kubernetes.io/projected/0b3b317c-8b92-4736-b169-694d75599ef1-kube-api-access-szqh9\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608953    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw5g2\" (UniqueName: \"kubernetes.io/projected/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-kube-api-access-lw5g2\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.608979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbb5e87d-8673-467a-a0ac-fa90af58301d-agent-certs\") pod \"konnectivity-agent-8jbvv\" (UID: \"cbb5e87d-8673-467a-a0ac-fa90af58301d\") " pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-slash\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-var-lib-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvw7d\" (UniqueName: \"kubernetes.io/projected/21d218e5-b574-4c50-903a-2102c395babe-kube-api-access-zvw7d\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-sys\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6qp2\" (UniqueName: \"kubernetes.io/projected/d0aa705a-ff6c-4584-9def-2abe8a75fe23-kube-api-access-r6qp2\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.609674 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-socket-dir-parent\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhdnk\" (UniqueName: \"kubernetes.io/projected/48d6c68d-5696-488b-8c0d-851fe59be022-kube-api-access-hhdnk\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysctl-conf\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-run\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b3b317c-8b92-4736-b169-694d75599ef1-serviceca\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-cni-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-cnibin\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-multus-certs\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-etc-kubernetes\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0aa705a-ff6c-4584-9def-2abe8a75fe23-host-slash\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-cni-binary-copy\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.610356 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.609387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.614998 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.614979    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2r9xm"
Sep 08 13:58:25.628161 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.628142    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2r9xm"
Sep 08 13:58:25.710043 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.710043 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710042    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3b317c-8b92-4736-b169-694d75599ef1-host\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-device-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710100    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-etc-selinux\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710124    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48d6c68d-5696-488b-8c0d-851fe59be022-hosts-file\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710155    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3b317c-8b92-4736-b169-694d75599ef1-host\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-device-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/53951034-ca2a-4a8a-ab31-d0482394d753-kubelet-config\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710172    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48d6c68d-5696-488b-8c0d-851fe59be022-hosts-file\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbb5e87d-8673-467a-a0ac-fa90af58301d-konnectivity-ca\") pod \"konnectivity-agent-8jbvv\" (UID: \"cbb5e87d-8673-467a-a0ac-fa90af58301d\") " pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710226    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-etc-selinux\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-systemd\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/53951034-ca2a-4a8a-ab31-d0482394d753-kubelet-config\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710259    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-systemd\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-node-log\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.710280 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-socket-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-node-log\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-cni-bin\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-hostroot\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-cni-bin\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d6c68d-5696-488b-8c0d-851fe59be022-tmp-dir\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-etc-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-socket-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-var-lib-kubelet\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710461    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-etc-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710467    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-hostroot\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710478    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-host\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsbwx\" (UniqueName: \"kubernetes.io/projected/e3603e41-2516-4a8f-ba67-862fd59e9dc5-kube-api-access-qsbwx\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710491    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710516    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-var-lib-kubelet\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-lib-modules\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-host\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711006 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0aa705a-ff6c-4584-9def-2abe8a75fe23-iptables-alerter-script\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-lib-modules\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710657    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-k8s-cni-cncf-io\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710745    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-k8s-cni-cncf-io\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710733    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-ovn\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710779    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d6c68d-5696-488b-8c0d-851fe59be022-tmp-dir\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21d218e5-b574-4c50-903a-2102c395babe-ovn-node-metrics-cert\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysconfig\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-run-ovn\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-kubernetes\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vldvl\" (UniqueName: \"kubernetes.io/projected/17091e92-5c7f-4372-9602-b85eeded497d-kube-api-access-vldvl\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710870    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysconfig\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-conf-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-kubelet\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.711845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-cni-bin\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-registration-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.710990    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-kubernetes\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-kubelet\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711052    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-cni-bin\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711056    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-sys-fs\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711016    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-conf-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-cni-binary-copy\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.711105    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-registration-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-cni-multus\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711139    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-sys-fs\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-cni-multus\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.711209    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret podName:53951034-ca2a-4a8a-ab31-d0482394d753 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:26.211159493 +0000 UTC m=+2.125064403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret") pod "global-pull-secret-syncer-2snxg" (UID: "53951034-ca2a-4a8a-ab31-d0482394d753") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711209    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0aa705a-ff6c-4584-9def-2abe8a75fe23-iptables-alerter-script\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711214    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-system-cni-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-netns\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.712383 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711267    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-system-cni-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-ovnkube-config\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711320    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-netns\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-cnibin\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zs24\" (UniqueName: \"kubernetes.io/projected/0905014a-a92b-43e0-9092-01dd91124be2-kube-api-access-7zs24\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711400    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711416    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/53951034-ca2a-4a8a-ab31-d0482394d753-dbus\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-cnibin\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.711434    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-systemd-units\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/53951034-ca2a-4a8a-ab31-d0482394d753-dbus\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.711488    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs podName:e3603e41-2516-4a8f-ba67-862fd59e9dc5 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:26.211472745 +0000 UTC m=+2.125377660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs") pod "network-metrics-daemon-lf79g" (UID: "e3603e41-2516-4a8f-ba67-862fd59e9dc5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-systemd-units\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-env-overrides\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-ovnkube-script-lib\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysctl-d\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.713215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-systemd\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-log-socket\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-log-socket\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711683    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-cni-binary-copy\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-cni-netd\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-cni-netd\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711742    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysctl-d\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-modprobe-d\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711758    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-systemd\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7932a003-5873-4e8e-add2-4dc69b39702d-tmp\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711857    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szqh9\" (UniqueName: \"kubernetes.io/projected/0b3b317c-8b92-4736-b169-694d75599ef1-kube-api-access-szqh9\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw5g2\" (UniqueName: \"kubernetes.io/projected/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-kube-api-access-lw5g2\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711921    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-ovnkube-config\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711932    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbb5e87d-8673-467a-a0ac-fa90af58301d-agent-certs\") pod \"konnectivity-agent-8jbvv\" (UID: \"cbb5e87d-8673-467a-a0ac-fa90af58301d\") " pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-slash\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-var-lib-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvw7d\" (UniqueName: \"kubernetes.io/projected/21d218e5-b574-4c50-903a-2102c395babe-kube-api-access-zvw7d\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.713830 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-sys\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6qp2\" (UniqueName: \"kubernetes.io/projected/d0aa705a-ff6c-4584-9def-2abe8a75fe23-kube-api-access-r6qp2\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.711830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-modprobe-d\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-socket-dir-parent\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhdnk\" (UniqueName: \"kubernetes.io/projected/48d6c68d-5696-488b-8c0d-851fe59be022-kube-api-access-hhdnk\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysctl-conf\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-slash\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-run\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b3b317c-8b92-4736-b169-694d75599ef1-serviceca\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712250    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbb5e87d-8673-467a-a0ac-fa90af58301d-konnectivity-ca\") pod \"konnectivity-agent-8jbvv\" (UID: \"cbb5e87d-8673-467a-a0ac-fa90af58301d\") " pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-cni-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-cnibin\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-multus-certs\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-etc-kubernetes\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0aa705a-ff6c-4584-9def-2abe8a75fe23-host-slash\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-cni-binary-copy\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7932a003-5873-4e8e-add2-4dc69b39702d-etc-tuned\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714310 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brwbj\" (UniqueName: \"kubernetes.io/projected/7932a003-5873-4e8e-add2-4dc69b39702d-kube-api-access-brwbj\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712476    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-etc-sysctl-conf\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-daemon-config\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712479    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-run\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-var-lib-openvswitch\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712543    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-ovnkube-script-lib\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7932a003-5873-4e8e-add2-4dc69b39702d-sys\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21d218e5-b574-4c50-903a-2102c395babe-env-overrides\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-run-multus-certs\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-run-netns\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-kubelet\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712778    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-cni-dir\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-system-cni-dir\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712882    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-socket-dir-parent\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-system-cni-dir\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.712961    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21d218e5-b574-4c50-903a-2102c395babe-host-run-netns\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.714789 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-cnibin\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.715248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0905014a-a92b-43e0-9092-01dd91124be2-cni-binary-copy\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.715248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713295    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0905014a-a92b-43e0-9092-01dd91124be2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.715248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713352    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17091e92-5c7f-4372-9602-b85eeded497d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.715248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-etc-kubernetes\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.715248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713404    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0aa705a-ff6c-4584-9def-2abe8a75fe23-host-slash\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.715248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b3b317c-8b92-4736-b169-694d75599ef1-serviceca\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.715248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713554    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-host-var-lib-kubelet\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.715248 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.713624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-multus-daemon-config\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.715966 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.715753    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7932a003-5873-4e8e-add2-4dc69b39702d-etc-tuned\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.716062 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.715804    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7932a003-5873-4e8e-add2-4dc69b39702d-tmp\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.716062 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.715863    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21d218e5-b574-4c50-903a-2102c395babe-ovn-node-metrics-cert\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.716062 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.715943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbb5e87d-8673-467a-a0ac-fa90af58301d-agent-certs\") pod \"konnectivity-agent-8jbvv\" (UID: \"cbb5e87d-8673-467a-a0ac-fa90af58301d\") " pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:25.740468 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.740431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vldvl\" (UniqueName: \"kubernetes.io/projected/17091e92-5c7f-4372-9602-b85eeded497d-kube-api-access-vldvl\") pod \"aws-ebs-csi-driver-node-44j42\" (UID: \"17091e92-5c7f-4372-9602-b85eeded497d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.741761 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.741736    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:25.741761 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.741764    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:25.742517 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.741778    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qg6gr for pod openshift-network-diagnostics/network-check-target-4ch2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:25.742517 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:25.741871    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr podName:82698349-e4c6-49f4-92e7-77cf5f5d120d nodeName:}" failed. No retries permitted until 2026-09-08 13:58:26.241853955 +0000 UTC m=+2.155758866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qg6gr" (UniqueName: "kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr") pod "network-check-target-4ch2v" (UID: "82698349-e4c6-49f4-92e7-77cf5f5d120d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:25.742517 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.742061    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zs24\" (UniqueName: \"kubernetes.io/projected/0905014a-a92b-43e0-9092-01dd91124be2-kube-api-access-7zs24\") pod \"multus-additional-cni-plugins-76nth\" (UID: \"0905014a-a92b-43e0-9092-01dd91124be2\") " pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.742517 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.742315    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsbwx\" (UniqueName: \"kubernetes.io/projected/e3603e41-2516-4a8f-ba67-862fd59e9dc5-kube-api-access-qsbwx\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:25.742741 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.742521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvw7d\" (UniqueName: \"kubernetes.io/projected/21d218e5-b574-4c50-903a-2102c395babe-kube-api-access-zvw7d\") pod \"ovnkube-node-zcxxd\" (UID: \"21d218e5-b574-4c50-903a-2102c395babe\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.744902 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.744878    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6qp2\" (UniqueName: \"kubernetes.io/projected/d0aa705a-ff6c-4584-9def-2abe8a75fe23-kube-api-access-r6qp2\") pod \"iptables-alerter-mclmn\" (UID: \"d0aa705a-ff6c-4584-9def-2abe8a75fe23\") " pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.745200 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.745182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw5g2\" (UniqueName: \"kubernetes.io/projected/f6ff4132-d7f3-45e5-bfe5-710eccf87dcb-kube-api-access-lw5g2\") pod \"multus-nsdhm\" (UID: \"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb\") " pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.747828 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.747806    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqh9\" (UniqueName: \"kubernetes.io/projected/0b3b317c-8b92-4736-b169-694d75599ef1-kube-api-access-szqh9\") pod \"node-ca-scgr5\" (UID: \"0b3b317c-8b92-4736-b169-694d75599ef1\") " pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.748519 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.748500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwbj\" (UniqueName: \"kubernetes.io/projected/7932a003-5873-4e8e-add2-4dc69b39702d-kube-api-access-brwbj\") pod \"tuned-k4gxq\" (UID: \"7932a003-5873-4e8e-add2-4dc69b39702d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.754501 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.754479    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhdnk\" (UniqueName: \"kubernetes.io/projected/48d6c68d-5696-488b-8c0d-851fe59be022-kube-api-access-hhdnk\") pod \"node-resolver-xb8x4\" (UID: \"48d6c68d-5696-488b-8c0d-851fe59be022\") " pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.833949 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.833858    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:25.838833 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.838809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:25.866488 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.866457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4gxq"
Sep 08 13:58:25.876303 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.876279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nsdhm"
Sep 08 13:58:25.891926 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.891895    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mclmn"
Sep 08 13:58:25.907408 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.907381    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xb8x4"
Sep 08 13:58:25.912767 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.912745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-scgr5"
Sep 08 13:58:25.936698 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.936670    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-76nth"
Sep 08 13:58:25.946410 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:25.946369    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf270c6c3850f7c0822b29062a2b39783.slice/crio-069aeacce7cda2beed54cebaaf1c81aad34b8d874aa538dd56484af49fb985db WatchSource:0}: Error finding container 069aeacce7cda2beed54cebaaf1c81aad34b8d874aa538dd56484af49fb985db: Status 404 returned error can't find the container with id 069aeacce7cda2beed54cebaaf1c81aad34b8d874aa538dd56484af49fb985db
Sep 08 13:58:25.946844 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:25.946804    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda733d6fc62ca0f2286c43732a49ccea2.slice/crio-6de0cab8c9ed51bb3a9931059f9320d17c01f9eb6dc2e05e143e8d003ce25b51 WatchSource:0}: Error finding container 6de0cab8c9ed51bb3a9931059f9320d17c01f9eb6dc2e05e143e8d003ce25b51: Status 404 returned error can't find the container with id 6de0cab8c9ed51bb3a9931059f9320d17c01f9eb6dc2e05e143e8d003ce25b51
Sep 08 13:58:25.947992 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:25.947970    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3b317c_8b92_4736_b169_694d75599ef1.slice/crio-5a9b3a9720dc98810744466c6aaa622d644cc358d6eacc5bc155b02ec0027572 WatchSource:0}: Error finding container 5a9b3a9720dc98810744466c6aaa622d644cc358d6eacc5bc155b02ec0027572: Status 404 returned error can't find the container with id 5a9b3a9720dc98810744466c6aaa622d644cc358d6eacc5bc155b02ec0027572
Sep 08 13:58:25.948287 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:25.948268    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0905014a_a92b_43e0_9092_01dd91124be2.slice/crio-fcf2ba6c3a0790ce25973b9a3e47bbb333ca324354c4de8b500e6b5d663b99fe WatchSource:0}: Error finding container fcf2ba6c3a0790ce25973b9a3e47bbb333ca324354c4de8b500e6b5d663b99fe: Status 404 returned error can't find the container with id fcf2ba6c3a0790ce25973b9a3e47bbb333ca324354c4de8b500e6b5d663b99fe
Sep 08 13:58:25.951874 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.951858    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 13:58:25.961767 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.961725    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42"
Sep 08 13:58:25.967994 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.967973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:25.972559 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:25.972534    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17091e92_5c7f_4372_9602_b85eeded497d.slice/crio-41ef923112cacc686e092a3a99fd5e40d02f41f9135e357c299e1d04548f1541 WatchSource:0}: Error finding container 41ef923112cacc686e092a3a99fd5e40d02f41f9135e357c299e1d04548f1541: Status 404 returned error can't find the container with id 41ef923112cacc686e092a3a99fd5e40d02f41f9135e357c299e1d04548f1541
Sep 08 13:58:25.975328 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:25.975294    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:25.977682 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:25.977659    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb5e87d_8673_467a_a0ac_fa90af58301d.slice/crio-d77da4655b1c7d691a8c6820b60e35ef47351456386bb9cc7f4667448c0c19e8 WatchSource:0}: Error finding container d77da4655b1c7d691a8c6820b60e35ef47351456386bb9cc7f4667448c0c19e8: Status 404 returned error can't find the container with id d77da4655b1c7d691a8c6820b60e35ef47351456386bb9cc7f4667448c0c19e8
Sep 08 13:58:26.186592 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:26.186566    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d218e5_b574_4c50_903a_2102c395babe.slice/crio-0619901f5af930530adbaec6afb4d575f75bf215b8826de674edd471bc04eff3 WatchSource:0}: Error finding container 0619901f5af930530adbaec6afb4d575f75bf215b8826de674edd471bc04eff3: Status 404 returned error can't find the container with id 0619901f5af930530adbaec6afb4d575f75bf215b8826de674edd471bc04eff3
Sep 08 13:58:26.217476 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.217439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:26.217624 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:26.217544    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ff4132_d7f3_45e5_bfe5_710eccf87dcb.slice/crio-a3c295eb7f094bb3b9abbfc4e757fc80df7f25747e5cecfed18065f09ae70106 WatchSource:0}: Error finding container a3c295eb7f094bb3b9abbfc4e757fc80df7f25747e5cecfed18065f09ae70106: Status 404 returned error can't find the container with id a3c295eb7f094bb3b9abbfc4e757fc80df7f25747e5cecfed18065f09ae70106
Sep 08 13:58:26.217624 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.217548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:26.217624 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:26.217612    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:26.217826 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:26.217641    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:26.217826 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:26.217733    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret podName:53951034-ca2a-4a8a-ab31-d0482394d753 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:27.217713085 +0000 UTC m=+3.131618001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret") pod "global-pull-secret-syncer-2snxg" (UID: "53951034-ca2a-4a8a-ab31-d0482394d753") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:26.217826 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:26.217755    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs podName:e3603e41-2516-4a8f-ba67-862fd59e9dc5 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:27.217745096 +0000 UTC m=+3.131649996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs") pod "network-metrics-daemon-lf79g" (UID: "e3603e41-2516-4a8f-ba67-862fd59e9dc5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:26.238991 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:26.238964    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d6c68d_5696_488b_8c0d_851fe59be022.slice/crio-83172f2188250f9c1851c4b01414e9ee1cb2aa80950526f7745683ca1cc5d28c WatchSource:0}: Error finding container 83172f2188250f9c1851c4b01414e9ee1cb2aa80950526f7745683ca1cc5d28c: Status 404 returned error can't find the container with id 83172f2188250f9c1851c4b01414e9ee1cb2aa80950526f7745683ca1cc5d28c
Sep 08 13:58:26.283679 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:26.283648    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7932a003_5873_4e8e_add2_4dc69b39702d.slice/crio-c7ea94055288055407a1ab8cfb48841a411440a8467bed01642e15fa1ded0652 WatchSource:0}: Error finding container c7ea94055288055407a1ab8cfb48841a411440a8467bed01642e15fa1ded0652: Status 404 returned error can't find the container with id c7ea94055288055407a1ab8cfb48841a411440a8467bed01642e15fa1ded0652
Sep 08 13:58:26.318104 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.318058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:26.318270 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:26.318252    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:26.318364 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:26.318281    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:26.318364 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:26.318296    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qg6gr for pod openshift-network-diagnostics/network-check-target-4ch2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:26.318364 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:26.318358    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr podName:82698349-e4c6-49f4-92e7-77cf5f5d120d nodeName:}" failed. No retries permitted until 2026-09-08 13:58:27.318339569 +0000 UTC m=+3.232244465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg6gr" (UniqueName: "kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr") pod "network-check-target-4ch2v" (UID: "82698349-e4c6-49f4-92e7-77cf5f5d120d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:26.417247 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:58:26.417216    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0aa705a_ff6c_4584_9def_2abe8a75fe23.slice/crio-e5b444a864fc28e049a63c267e93ce02adf90bdb43c8cb2cfc6c4a80ab648d52 WatchSource:0}: Error finding container e5b444a864fc28e049a63c267e93ce02adf90bdb43c8cb2cfc6c4a80ab648d52: Status 404 returned error can't find the container with id e5b444a864fc28e049a63c267e93ce02adf90bdb43c8cb2cfc6c4a80ab648d52
Sep 08 13:58:26.581269 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.581140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"0619901f5af930530adbaec6afb4d575f75bf215b8826de674edd471bc04eff3"}
Sep 08 13:58:26.582952 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.582913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8jbvv" event={"ID":"cbb5e87d-8673-467a-a0ac-fa90af58301d","Type":"ContainerStarted","Data":"d77da4655b1c7d691a8c6820b60e35ef47351456386bb9cc7f4667448c0c19e8"}
Sep 08 13:58:26.584950 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.584918    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42" event={"ID":"17091e92-5c7f-4372-9602-b85eeded497d","Type":"ContainerStarted","Data":"41ef923112cacc686e092a3a99fd5e40d02f41f9135e357c299e1d04548f1541"}
Sep 08 13:58:26.586625 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.586585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerStarted","Data":"fcf2ba6c3a0790ce25973b9a3e47bbb333ca324354c4de8b500e6b5d663b99fe"}
Sep 08 13:58:26.587945 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.587920    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal" event={"ID":"f270c6c3850f7c0822b29062a2b39783","Type":"ContainerStarted","Data":"069aeacce7cda2beed54cebaaf1c81aad34b8d874aa538dd56484af49fb985db"}
Sep 08 13:58:26.589695 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.589669    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mclmn" event={"ID":"d0aa705a-ff6c-4584-9def-2abe8a75fe23","Type":"ContainerStarted","Data":"e5b444a864fc28e049a63c267e93ce02adf90bdb43c8cb2cfc6c4a80ab648d52"}
Sep 08 13:58:26.591393 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.591365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal" event={"ID":"a733d6fc62ca0f2286c43732a49ccea2","Type":"ContainerStarted","Data":"6de0cab8c9ed51bb3a9931059f9320d17c01f9eb6dc2e05e143e8d003ce25b51"}
Sep 08 13:58:26.592729 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.592701    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-scgr5" event={"ID":"0b3b317c-8b92-4736-b169-694d75599ef1","Type":"ContainerStarted","Data":"5a9b3a9720dc98810744466c6aaa622d644cc358d6eacc5bc155b02ec0027572"}
Sep 08 13:58:26.594220 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.594172    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4gxq" event={"ID":"7932a003-5873-4e8e-add2-4dc69b39702d","Type":"ContainerStarted","Data":"c7ea94055288055407a1ab8cfb48841a411440a8467bed01642e15fa1ded0652"}
Sep 08 13:58:26.602212 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.602172    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xb8x4" event={"ID":"48d6c68d-5696-488b-8c0d-851fe59be022","Type":"ContainerStarted","Data":"83172f2188250f9c1851c4b01414e9ee1cb2aa80950526f7745683ca1cc5d28c"}
Sep 08 13:58:26.603893 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.603865    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nsdhm" event={"ID":"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb","Type":"ContainerStarted","Data":"a3c295eb7f094bb3b9abbfc4e757fc80df7f25747e5cecfed18065f09ae70106"}
Sep 08 13:58:26.631771 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.631688    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:53:26 +0000 UTC" deadline="2028-03-04 01:34:57.417803315 +0000 UTC"
Sep 08 13:58:26.631771 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.631770    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13019h36m30.786038804s"
Sep 08 13:58:26.758587 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:26.758552    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:27.228062 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.228013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:27.228271 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.228081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:27.228271 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.228263    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:27.228404 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.228332    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs podName:e3603e41-2516-4a8f-ba67-862fd59e9dc5 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:29.228312252 +0000 UTC m=+5.142217151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs") pod "network-metrics-daemon-lf79g" (UID: "e3603e41-2516-4a8f-ba67-862fd59e9dc5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:27.228839 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.228815    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:27.228960 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.228883    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret podName:53951034-ca2a-4a8a-ab31-d0482394d753 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:29.22886374 +0000 UTC m=+5.142768638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret") pod "global-pull-secret-syncer-2snxg" (UID: "53951034-ca2a-4a8a-ab31-d0482394d753") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:27.328931 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.328888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:27.329154 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.329121    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:27.329154 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.329144    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:27.329282 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.329158    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qg6gr for pod openshift-network-diagnostics/network-check-target-4ch2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:27.329282 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.329224    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr podName:82698349-e4c6-49f4-92e7-77cf5f5d120d nodeName:}" failed. No retries permitted until 2026-09-08 13:58:29.329203881 +0000 UTC m=+5.243108780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg6gr" (UniqueName: "kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr") pod "network-check-target-4ch2v" (UID: "82698349-e4c6-49f4-92e7-77cf5f5d120d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:27.575801 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.575705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:27.575966 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.575856    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:27.576311 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.576291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:27.576416 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.576401    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:27.576483 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.576475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:27.576590 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:27.576546    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:27.632327 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.632278    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:53:26 +0000 UTC" deadline="2028-04-28 01:56:56.357158514 +0000 UTC"
Sep 08 13:58:27.632327 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.632325    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14339h58m28.724838852s"
Sep 08 13:58:27.962877 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:27.962838    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:58:29.245070 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:29.245029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:29.245775 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:29.245090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:29.245775 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.245255    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:29.245775 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.245328    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs podName:e3603e41-2516-4a8f-ba67-862fd59e9dc5 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:33.245307117 +0000 UTC m=+9.159212016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs") pod "network-metrics-daemon-lf79g" (UID: "e3603e41-2516-4a8f-ba67-862fd59e9dc5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:29.246137 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.246107    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:29.246211 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.246173    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret podName:53951034-ca2a-4a8a-ab31-d0482394d753 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:33.246155852 +0000 UTC m=+9.160060766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret") pod "global-pull-secret-syncer-2snxg" (UID: "53951034-ca2a-4a8a-ab31-d0482394d753") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:29.345917 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:29.345872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:29.346172 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.346147    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:29.346172 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.346172    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:29.346335 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.346185    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qg6gr for pod openshift-network-diagnostics/network-check-target-4ch2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:29.346335 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.346249    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr podName:82698349-e4c6-49f4-92e7-77cf5f5d120d nodeName:}" failed. No retries permitted until 2026-09-08 13:58:33.346228344 +0000 UTC m=+9.260133264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg6gr" (UniqueName: "kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr") pod "network-check-target-4ch2v" (UID: "82698349-e4c6-49f4-92e7-77cf5f5d120d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:29.576468 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:29.576383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:29.576627 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.576554    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:29.576963 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:29.576943    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:29.577054 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.577023    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:29.577112 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:29.577059    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:29.577166 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:29.577111    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:31.579311 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:31.579274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:31.580811 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:31.580769    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:31.580959 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:31.579886    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:31.580959 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:31.580951    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:31.581076 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:31.579837    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:31.581134 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:31.581069    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:33.277316 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:33.277267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:33.277817 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:33.277330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:33.277817 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.277430    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:33.277817 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.277436    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:33.277817 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.277496    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret podName:53951034-ca2a-4a8a-ab31-d0482394d753 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:41.277480321 +0000 UTC m=+17.191385221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret") pod "global-pull-secret-syncer-2snxg" (UID: "53951034-ca2a-4a8a-ab31-d0482394d753") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:33.277817 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.277514    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs podName:e3603e41-2516-4a8f-ba67-862fd59e9dc5 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:41.277506552 +0000 UTC m=+17.191411449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs") pod "network-metrics-daemon-lf79g" (UID: "e3603e41-2516-4a8f-ba67-862fd59e9dc5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:33.378213 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:33.378031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:33.378407 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.378222    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:33.378407 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.378251    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:33.378407 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.378267    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qg6gr for pod openshift-network-diagnostics/network-check-target-4ch2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:33.378407 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.378344    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr podName:82698349-e4c6-49f4-92e7-77cf5f5d120d nodeName:}" failed. No retries permitted until 2026-09-08 13:58:41.378320994 +0000 UTC m=+17.292225906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg6gr" (UniqueName: "kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr") pod "network-check-target-4ch2v" (UID: "82698349-e4c6-49f4-92e7-77cf5f5d120d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:33.576249 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:33.576213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:33.576458 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:33.576263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:33.576458 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.576378    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:33.576981 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:33.576760    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:33.576981 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.576874    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:33.576981 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:33.576947    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:35.575892 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:35.575847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:35.575892 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:35.575892    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:35.576571 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:35.575847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:35.576571 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:35.575990    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:35.576571 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:35.576074    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:35.576571 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:35.576148    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:37.576357 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:37.576317    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:37.576357 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:37.576348    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:37.576921 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:37.576457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:37.576921 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:37.576470    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:37.576921 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:37.576578    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:37.576921 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:37.576668    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:39.576080 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:39.575996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:39.576538 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:39.576010    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:39.576538 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:39.576138    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:39.576538 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:39.576182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:39.576538 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:39.576258    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:39.576538 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:39.576336    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:41.347060 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:41.347013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:41.347506 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:41.347074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:41.347506 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.347238    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:41.347506 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.347243    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:41.347506 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.347309    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret podName:53951034-ca2a-4a8a-ab31-d0482394d753 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:57.347290505 +0000 UTC m=+33.261195413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret") pod "global-pull-secret-syncer-2snxg" (UID: "53951034-ca2a-4a8a-ab31-d0482394d753") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:41.347506 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.347330    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs podName:e3603e41-2516-4a8f-ba67-862fd59e9dc5 nodeName:}" failed. No retries permitted until 2026-09-08 13:58:57.34731951 +0000 UTC m=+33.261224405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs") pod "network-metrics-daemon-lf79g" (UID: "e3603e41-2516-4a8f-ba67-862fd59e9dc5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:41.448019 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:41.447975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:41.448212 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.448176    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:41.448212 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.448203    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:41.448323 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.448219    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qg6gr for pod openshift-network-diagnostics/network-check-target-4ch2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:41.448323 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.448287    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr podName:82698349-e4c6-49f4-92e7-77cf5f5d120d nodeName:}" failed. No retries permitted until 2026-09-08 13:58:57.448266888 +0000 UTC m=+33.362171797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg6gr" (UniqueName: "kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr") pod "network-check-target-4ch2v" (UID: "82698349-e4c6-49f4-92e7-77cf5f5d120d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:41.575751 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:41.575660    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:41.575751 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:41.575686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:41.575751 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:41.575695    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:41.576015 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.575809    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:41.576015 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.575889    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:41.576015 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:41.575993    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:43.576018 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:43.575981    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:43.576447 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:43.575981    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:43.576447 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:43.576118    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:43.576447 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:43.576229    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:43.576447 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:43.575981    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:43.576447 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:43.576325    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:45.575508 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:45.575467    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:45.575945 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:45.575468    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:45.575945 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:45.575594    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:45.575945 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:45.575631    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:45.575945 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:45.575722    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:45.575945 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:45.575810    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:47.576144 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.575811    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:47.576848 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.575847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:47.576848 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:47.576226    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:47.576848 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.575847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:47.576848 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:47.576299    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:47.576848 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:47.576388    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:47.665521 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.665442    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-scgr5" event={"ID":"0b3b317c-8b92-4736-b169-694d75599ef1","Type":"ContainerStarted","Data":"e06c28e72b19961bb521d1ae87baee8fbea058e392a635453afc16c4ff0be1b7"}
Sep 08 13:58:47.667182 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.667141    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4gxq" event={"ID":"7932a003-5873-4e8e-add2-4dc69b39702d","Type":"ContainerStarted","Data":"35f9bc9de85553893bd11c363ac29fb17406bb82bdd45d6e37e7d663291ed7ae"}
Sep 08 13:58:47.668995 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.668966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xb8x4" event={"ID":"48d6c68d-5696-488b-8c0d-851fe59be022","Type":"ContainerStarted","Data":"8f872e742b9331fb2cadf9919a85784dd9c22600d29b282f783536c413b318f7"}
Sep 08 13:58:47.670670 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.670643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nsdhm" event={"ID":"f6ff4132-d7f3-45e5-bfe5-710eccf87dcb","Type":"ContainerStarted","Data":"c0b8f549dae7fd8e3c3391f6022c1ae700b0b1c3ecb479923fe9847fe99e4dfa"}
Sep 08 13:58:47.674341 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.674313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"b5d4ae987e8293d8c882fdd2b10e9b5717f54ad9203a2dc3c28b14a2d11dac79"}
Sep 08 13:58:47.674490 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.674384    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"fd0109d99ab76ee774acd01a26059870f68a6af138da107444be1d01d2ad2f64"}
Sep 08 13:58:47.674490 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.674432    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"1d584b8d68ef56516ece10b19177d4d1add3e28ce21a2f12cfcbddfedd662f2a"}
Sep 08 13:58:47.674490 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.674463    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"ce82bf3d3353341c9122f736f0d5e13e39846dc376b386c42f463b3ff12e330f"}
Sep 08 13:58:47.674684 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.674502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"f48b3cb46540433ff65cabc611a4930423d78c477d3147ecf78fb2658217e848"}
Sep 08 13:58:47.674684 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.674532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"cc2eaab646e14bd5e79afb17664c523d3909c7457cc939b1c9092cfbe53c32be"}
Sep 08 13:58:47.676022 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.675996    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8jbvv" event={"ID":"cbb5e87d-8673-467a-a0ac-fa90af58301d","Type":"ContainerStarted","Data":"e7dd447094147fe1a65b9b11b9740551a5c539f67ad0571721c4d3721ea46663"}
Sep 08 13:58:47.677794 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.677770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42" event={"ID":"17091e92-5c7f-4372-9602-b85eeded497d","Type":"ContainerStarted","Data":"854cf290d716af9cdd649c3d725df738a1f8bfbf3c74f444f119c7d1f58cc639"}
Sep 08 13:58:47.679461 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.679434    2559 generic.go:356] "Generic (PLEG): container finished" podID="0905014a-a92b-43e0-9092-01dd91124be2" containerID="bed240a2d917705421800caa18aab4bb0dd507b6a42d1168201fde16ea42dea2" exitCode=0
Sep 08 13:58:47.679585 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.679516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerDied","Data":"bed240a2d917705421800caa18aab4bb0dd507b6a42d1168201fde16ea42dea2"}
Sep 08 13:58:47.681863 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.681840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal" event={"ID":"f270c6c3850f7c0822b29062a2b39783","Type":"ContainerStarted","Data":"b436a0e89114d6a4789f7ca24e18cea733fe72c210be65e55040f71ebf8b4cbd"}
Sep 08 13:58:47.683804 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.683779    2559 generic.go:356] "Generic (PLEG): container finished" podID="a733d6fc62ca0f2286c43732a49ccea2" containerID="7f489f3b2445a6aef81687f0419592f4d83a6adfa19c9cd7ec2bfc8b78023e50" exitCode=0
Sep 08 13:58:47.683930 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.683813    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal" event={"ID":"a733d6fc62ca0f2286c43732a49ccea2","Type":"ContainerDied","Data":"7f489f3b2445a6aef81687f0419592f4d83a6adfa19c9cd7ec2bfc8b78023e50"}
Sep 08 13:58:47.700633 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.700264    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nsdhm" podStartSLOduration=2.246707099 podStartE2EDuration="22.70024903s" totalImagesPullingTime="20.453541931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:47.700031419 +0000 UTC m=+23.613936338" watchObservedRunningTime="2026-09-08 13:58:47.70024903 +0000 UTC m=+23.614153946"
Sep 08 13:58:47.700633 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.700593    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-scgr5" podStartSLOduration=2.045740484 podStartE2EDuration="22.700581444s" totalImagesPullingTime="20.65484096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:47.682894869 +0000 UTC m=+23.596799798" watchObservedRunningTime="2026-09-08 13:58:47.700581444 +0000 UTC m=+23.614486360"
Sep 08 13:58:47.717684 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.717640    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xb8x4" podStartSLOduration=2.337850737 podStartE2EDuration="22.717603622s" totalImagesPullingTime="20.379752885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:47.717278882 +0000 UTC m=+23.631183799" watchObservedRunningTime="2026-09-08 13:58:47.717603622 +0000 UTC m=+23.631508538"
Sep 08 13:58:47.761406 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.761338    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8jbvv" podStartSLOduration=1.12008862 podStartE2EDuration="21.761307553s" totalImagesPullingTime="20.641218933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:47.76070242 +0000 UTC m=+23.674607337" watchObservedRunningTime="2026-09-08 13:58:47.761307553 +0000 UTC m=+23.675212521"
Sep 08 13:58:47.778512 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.778450    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-105.ec2.internal" podStartSLOduration=21.778429907 podStartE2EDuration="21.778429907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:47.778355873 +0000 UTC m=+23.692260788" watchObservedRunningTime="2026-09-08 13:58:47.778429907 +0000 UTC m=+23.692334823"
Sep 08 13:58:47.799156 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:47.799109    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k4gxq" podStartSLOduration=2.465309876 podStartE2EDuration="22.799093339s" totalImagesPullingTime="20.333783463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:47.798546575 +0000 UTC m=+23.712451492" watchObservedRunningTime="2026-09-08 13:58:47.799093339 +0000 UTC m=+23.712998255"
Sep 08 13:58:48.464690 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.464465    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 13:58:48.589455 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.589350    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T13:58:48.464683145Z","UUID":"d88cf420-f091-4249-b897-7c7c3426c6c5","Handler":null,"Name":"","Endpoint":""}
Sep 08 13:58:48.591018 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.590993    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 13:58:48.591018 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.591031    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 13:58:48.688578 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.688500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42" event={"ID":"17091e92-5c7f-4372-9602-b85eeded497d","Type":"ContainerStarted","Data":"8b03d557993532d1f003f230c6e10328ef3ea5670b895794a9324c2300fbd26a"}
Sep 08 13:58:48.690214 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.690163    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mclmn" event={"ID":"d0aa705a-ff6c-4584-9def-2abe8a75fe23","Type":"ContainerStarted","Data":"94b68c7d0ed50ff2f02ab4356cab27020c991b2771f24099abae15790c593af9"}
Sep 08 13:58:48.692189 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.692160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal" event={"ID":"a733d6fc62ca0f2286c43732a49ccea2","Type":"ContainerStarted","Data":"7078d9da95014d5a50171eb7d616ec3786c9cabce5da360282d23e6ce628308a"}
Sep 08 13:58:48.713718 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.713667    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mclmn" podStartSLOduration=3.5730653610000003 podStartE2EDuration="23.713648664s" totalImagesPullingTime="20.140583303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:48.713232561 +0000 UTC m=+24.627137479" watchObservedRunningTime="2026-09-08 13:58:48.713648664 +0000 UTC m=+24.627553578"
Sep 08 13:58:48.728965 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.728897    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-105.ec2.internal" podStartSLOduration=22.728875329 podStartE2EDuration="22.728875329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:48.728258561 +0000 UTC m=+24.642163476" watchObservedRunningTime="2026-09-08 13:58:48.728875329 +0000 UTC m=+24.642780244"
Sep 08 13:58:48.932898 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.932815    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:48.933500 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:48.933471    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:49.575968 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:49.575934    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:49.576144 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:49.575944    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:49.576144 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:49.576068    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:49.576144 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:49.576083    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:49.576274 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:49.576149    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:49.576315 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:49.576270    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:49.699143 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:49.699055    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"16f3033f301b5b9aff4a65a7566245aa917a2c1405ff9c8093439c67d37d274c"}
Sep 08 13:58:49.702882 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:49.702841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42" event={"ID":"17091e92-5c7f-4372-9602-b85eeded497d","Type":"ContainerStarted","Data":"c3f394765c91919a517d824e46e60a8136f466db6cc2220b4d06f500b5723a2f"}
Sep 08 13:58:49.703519 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:49.703470    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:49.703894 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:49.703877    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8jbvv"
Sep 08 13:58:49.722865 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:49.722802    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44j42" podStartSLOduration=0.939091585 podStartE2EDuration="23.722780168s" totalImagesPullingTime="22.783688583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:49.722411243 +0000 UTC m=+25.636316159" watchObservedRunningTime="2026-09-08 13:58:49.722780168 +0000 UTC m=+25.636685092"
Sep 08 13:58:51.575823 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:51.575786    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:51.576263 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:51.575833    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:51.576263 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:51.575911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:51.576263 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:51.575930    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:51.576263 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:51.576004    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:51.576263 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:51.576060    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:53.576063 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.575822    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:53.576658 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.575823    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:53.576658 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:53.576081    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:53.576658 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.575823    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:53.576658 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:53.576201    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:53.576658 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:53.576244    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:53.723531 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.723486    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" event={"ID":"21d218e5-b574-4c50-903a-2102c395babe","Type":"ContainerStarted","Data":"a61929adc6a4e78b170d878c92747bf0590c03362600aa00fc57a558bfccddd2"}
Sep 08 13:58:53.723758 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.723736    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:53.725770 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.725744    2559 generic.go:356] "Generic (PLEG): container finished" podID="0905014a-a92b-43e0-9092-01dd91124be2" containerID="ef69b5cc67b23c8334a83e4bb469906ad20430eae1bf0372e19e74496baca16a" exitCode=0
Sep 08 13:58:53.725897 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.725797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerDied","Data":"ef69b5cc67b23c8334a83e4bb469906ad20430eae1bf0372e19e74496baca16a"}
Sep 08 13:58:53.740421 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.740392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:53.759752 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:53.759706    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd" podStartSLOduration=8.269398016 podStartE2EDuration="28.759690904s" totalImagesPullingTime="20.490292888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:58:53.758451877 +0000 UTC m=+29.672356793" watchObservedRunningTime="2026-09-08 13:58:53.759690904 +0000 UTC m=+29.673595819"
Sep 08 13:58:54.730731 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.730691    2559 generic.go:356] "Generic (PLEG): container finished" podID="0905014a-a92b-43e0-9092-01dd91124be2" containerID="ebaa21b7326891b77d0326af4f7615d15bcf2d04c71fe3fb0ff1fb9e1c9bde40" exitCode=0
Sep 08 13:58:54.731404 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.730787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerDied","Data":"ebaa21b7326891b77d0326af4f7615d15bcf2d04c71fe3fb0ff1fb9e1c9bde40"}
Sep 08 13:58:54.731404 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.731342    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:54.731656 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.731431    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:54.747905 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.747879    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:58:54.951472 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.951399    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4ch2v"]
Sep 08 13:58:54.951605 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.951511    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:54.951667 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:54.951595    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:54.955134 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.955100    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2snxg"]
Sep 08 13:58:54.955282 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.955223    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:54.955359 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:54.955340    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:54.955782 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.955758    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lf79g"]
Sep 08 13:58:54.955889 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:54.955876    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:54.955998 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:54.955975    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:56.576563 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:56.576374    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:56.577048 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:56.576374    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:56.577048 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:56.576679    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:56.577048 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:56.576380    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:56.577048 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:56.576714    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:56.577048 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:56.576813    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:56.738411 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:56.738379    2559 generic.go:356] "Generic (PLEG): container finished" podID="0905014a-a92b-43e0-9092-01dd91124be2" containerID="28dbb1babcda285dc1714966b477a8d2a5582412f0992db442943b8d37d976db" exitCode=0
Sep 08 13:58:56.738588 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:56.738460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerDied","Data":"28dbb1babcda285dc1714966b477a8d2a5582412f0992db442943b8d37d976db"}
Sep 08 13:58:57.363910 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:57.363814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:57.363910 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:57.363879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:57.364106 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:57.364002    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:57.364106 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:57.364022    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:57.364106 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:57.364083    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs podName:e3603e41-2516-4a8f-ba67-862fd59e9dc5 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:29.36406471 +0000 UTC m=+65.277969613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs") pod "network-metrics-daemon-lf79g" (UID: "e3603e41-2516-4a8f-ba67-862fd59e9dc5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:58:57.364106 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:57.364105    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret podName:53951034-ca2a-4a8a-ab31-d0482394d753 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:29.36409428 +0000 UTC m=+65.277999176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret") pod "global-pull-secret-syncer-2snxg" (UID: "53951034-ca2a-4a8a-ab31-d0482394d753") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:58:57.464648 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:57.464588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:57.464859 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:57.464781    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:58:57.464859 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:57.464805    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:58:57.464859 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:57.464818    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qg6gr for pod openshift-network-diagnostics/network-check-target-4ch2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:57.465010 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:57.464883    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr podName:82698349-e4c6-49f4-92e7-77cf5f5d120d nodeName:}" failed. No retries permitted until 2026-09-08 13:59:29.464864755 +0000 UTC m=+65.378769664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg6gr" (UniqueName: "kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr") pod "network-check-target-4ch2v" (UID: "82698349-e4c6-49f4-92e7-77cf5f5d120d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:58:58.575996 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:58.575964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:58:58.575996 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:58.575988    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:58:58.576428 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:58.575965    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:58:58.576428 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:58.576101    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2snxg" podUID="53951034-ca2a-4a8a-ab31-d0482394d753"
Sep 08 13:58:58.576428 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:58.576150    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ch2v" podUID="82698349-e4c6-49f4-92e7-77cf5f5d120d"
Sep 08 13:58:58.576428 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:58.576213    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf79g" podUID="e3603e41-2516-4a8f-ba67-862fd59e9dc5"
Sep 08 13:58:59.384656 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.384231    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-105.ec2.internal" event="NodeReady"
Sep 08 13:58:59.384656 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.384375    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 13:58:59.442980 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.442897    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64784dcfb4-gxkct"]
Sep 08 13:58:59.452078 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.452048    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.454805 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.454781    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 13:58:59.455086 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.455069    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j2pct\""
Sep 08 13:58:59.455271 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.455247    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 13:58:59.455573 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.455553    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 13:58:59.462205 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.462180    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 13:58:59.471519 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.471492    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64784dcfb4-gxkct"]
Sep 08 13:58:59.485043 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.485011    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lnq9g"]
Sep 08 13:58:59.487913 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.487886    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.490441 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.490413    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 13:58:59.490763 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.490698    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b4mdc\""
Sep 08 13:58:59.491025 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.491007    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 13:58:59.504766 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.504737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lnq9g"]
Sep 08 13:58:59.562524 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.562489    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tzjbr"]
Sep 08 13:58:59.578152 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.578152 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b9c0f03-800a-418b-8588-72068e616bda-tmp-dir\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-trusted-ca\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b9c0f03-800a-418b-8588-72068e616bda-config-volume\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/911db171-cc19-417a-9d12-02e7971a9816-ca-trust-extracted\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5w6m\" (UniqueName: \"kubernetes.io/projected/9b9c0f03-800a-418b-8588-72068e616bda-kube-api-access-c5w6m\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-image-registry-private-configuration\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-registry-certificates\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbf25\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-kube-api-access-mbf25\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-installation-pull-secrets\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.578555 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.578440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-bound-sa-token\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.583044 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.583021    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tzjbr"
Sep 08 13:58:59.585223 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.585168    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tzjbr"]
Sep 08 13:58:59.585463 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.585443    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 13:58:59.585937 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.585920    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 13:58:59.586053 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.585991    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 13:58:59.589386 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.589366    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7mkjh\""
Sep 08 13:58:59.678864 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.678829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-image-registry-private-configuration\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679071 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.678876    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-registry-certificates\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679071 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.678903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbf25\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-kube-api-access-mbf25\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679071 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.678938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-installation-pull-secrets\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679309 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-bound-sa-token\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679453 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.679453 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b9c0f03-800a-418b-8588-72068e616bda-tmp-dir\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.679453 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-trusted-ca\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679453 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b9c0f03-800a-418b-8588-72068e616bda-config-volume\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.679453 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2138ffc-17e7-4b73-9337-8b844458af2e-cert\") pod \"ingress-canary-tzjbr\" (UID: \"d2138ffc-17e7-4b73-9337-8b844458af2e\") " pod="openshift-ingress-canary/ingress-canary-tzjbr"
Sep 08 13:58:59.679737 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679737 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/911db171-cc19-417a-9d12-02e7971a9816-ca-trust-extracted\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679737 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5w6m\" (UniqueName: \"kubernetes.io/projected/9b9c0f03-800a-418b-8588-72068e616bda-kube-api-access-c5w6m\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.679737 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679506    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-registry-certificates\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.679737 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9bcv\" (UniqueName: \"kubernetes.io/projected/d2138ffc-17e7-4b73-9337-8b844458af2e-kube-api-access-m9bcv\") pod \"ingress-canary-tzjbr\" (UID: \"d2138ffc-17e7-4b73-9337-8b844458af2e\") " pod="openshift-ingress-canary/ingress-canary-tzjbr"
Sep 08 13:58:59.679737 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:59.679644    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:58:59.679737 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:59.679707    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls podName:9b9c0f03-800a-418b-8588-72068e616bda nodeName:}" failed. No retries permitted until 2026-09-08 13:59:00.179686741 +0000 UTC m=+36.093591652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls") pod "dns-default-lnq9g" (UID: "9b9c0f03-800a-418b-8588-72068e616bda") : secret "dns-default-metrics-tls" not found
Sep 08 13:58:59.679737 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.679731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b9c0f03-800a-418b-8588-72068e616bda-tmp-dir\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.680132 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:59.679743    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 13:58:59.680132 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:59.679764    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64784dcfb4-gxkct: secret "image-registry-tls" not found
Sep 08 13:58:59.680132 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:58:59.679833    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls podName:911db171-cc19-417a-9d12-02e7971a9816 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:00.179817502 +0000 UTC m=+36.093722419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls") pod "image-registry-64784dcfb4-gxkct" (UID: "911db171-cc19-417a-9d12-02e7971a9816") : secret "image-registry-tls" not found
Sep 08 13:58:59.680132 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.680058    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/911db171-cc19-417a-9d12-02e7971a9816-ca-trust-extracted\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.680302 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.680278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b9c0f03-800a-418b-8588-72068e616bda-config-volume\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.680625 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.680591    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-trusted-ca\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.683508 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.683486    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-image-registry-private-configuration\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.683623 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.683486    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-installation-pull-secrets\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.694290 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.694222    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbf25\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-kube-api-access-mbf25\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.699321 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.699289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5w6m\" (UniqueName: \"kubernetes.io/projected/9b9c0f03-800a-418b-8588-72068e616bda-kube-api-access-c5w6m\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:58:59.704740 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.704715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-bound-sa-token\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:58:59.780263 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.780221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2138ffc-17e7-4b73-9337-8b844458af2e-cert\") pod \"ingress-canary-tzjbr\" (UID: \"d2138ffc-17e7-4b73-9337-8b844458af2e\") " pod="openshift-ingress-canary/ingress-canary-tzjbr"
Sep 08 13:58:59.780457 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.780326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9bcv\" (UniqueName: \"kubernetes.io/projected/d2138ffc-17e7-4b73-9337-8b844458af2e-kube-api-access-m9bcv\") pod \"ingress-canary-tzjbr\" (UID: \"d2138ffc-17e7-4b73-9337-8b844458af2e\") " pod="openshift-ingress-canary/ingress-canary-tzjbr"
Sep 08 13:58:59.783127 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.783096    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2138ffc-17e7-4b73-9337-8b844458af2e-cert\") pod \"ingress-canary-tzjbr\" (UID: \"d2138ffc-17e7-4b73-9337-8b844458af2e\") " pod="openshift-ingress-canary/ingress-canary-tzjbr"
Sep 08 13:58:59.791963 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.791938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9bcv\" (UniqueName: \"kubernetes.io/projected/d2138ffc-17e7-4b73-9337-8b844458af2e-kube-api-access-m9bcv\") pod \"ingress-canary-tzjbr\" (UID: \"d2138ffc-17e7-4b73-9337-8b844458af2e\") " pod="openshift-ingress-canary/ingress-canary-tzjbr"
Sep 08 13:58:59.892819 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:58:59.892787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tzjbr"
Sep 08 13:59:00.183747 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.183713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:59:00.183958 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.183785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:59:00.183958 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:00.183892    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 13:59:00.183958 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:00.183894    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:00.183958 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:00.183908    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64784dcfb4-gxkct: secret "image-registry-tls" not found
Sep 08 13:59:00.184148 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:00.183979    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls podName:911db171-cc19-417a-9d12-02e7971a9816 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:01.183960218 +0000 UTC m=+37.097865115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls") pod "image-registry-64784dcfb4-gxkct" (UID: "911db171-cc19-417a-9d12-02e7971a9816") : secret "image-registry-tls" not found
Sep 08 13:59:00.184148 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:00.184000    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls podName:9b9c0f03-800a-418b-8588-72068e616bda nodeName:}" failed. No retries permitted until 2026-09-08 13:59:01.183989565 +0000 UTC m=+37.097894479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls") pod "dns-default-lnq9g" (UID: "9b9c0f03-800a-418b-8588-72068e616bda") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:00.576456 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.576421    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:59:00.576653 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.576431    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:59:00.576931 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.576430    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:59:00.582601 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.582561    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 13:59:00.582601 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.582574    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 13:59:00.582601 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.582562    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 13:59:00.583151 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.582917    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r4t74\""
Sep 08 13:59:00.583366 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.583349    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 13:59:00.583569 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:00.583554    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cmv8\""
Sep 08 13:59:01.189839 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:01.189799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:59:01.190040 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:01.189870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:59:01.190040 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:01.189962    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:01.190040 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:01.190009    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 13:59:01.190040 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:01.190025    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64784dcfb4-gxkct: secret "image-registry-tls" not found
Sep 08 13:59:01.190040 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:01.190040    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls podName:9b9c0f03-800a-418b-8588-72068e616bda nodeName:}" failed. No retries permitted until 2026-09-08 13:59:03.190021995 +0000 UTC m=+39.103926903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls") pod "dns-default-lnq9g" (UID: "9b9c0f03-800a-418b-8588-72068e616bda") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:01.190213 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:01.190075    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls podName:911db171-cc19-417a-9d12-02e7971a9816 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:03.190062815 +0000 UTC m=+39.103967709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls") pod "image-registry-64784dcfb4-gxkct" (UID: "911db171-cc19-417a-9d12-02e7971a9816") : secret "image-registry-tls" not found
Sep 08 13:59:01.541687 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:01.541659    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tzjbr"]
Sep 08 13:59:01.546092 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:59:01.546067    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2138ffc_17e7_4b73_9337_8b844458af2e.slice/crio-738921b24f73ff974a364185a501a413ad8f1c4490af30473d56675724b702e0 WatchSource:0}: Error finding container 738921b24f73ff974a364185a501a413ad8f1c4490af30473d56675724b702e0: Status 404 returned error can't find the container with id 738921b24f73ff974a364185a501a413ad8f1c4490af30473d56675724b702e0
Sep 08 13:59:01.753769 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:01.753733    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerStarted","Data":"4791a486ea16853f0bc176bba30279921ebaff9d918b292afe08d26bbe114c54"}
Sep 08 13:59:01.755194 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:01.755165    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tzjbr" event={"ID":"d2138ffc-17e7-4b73-9337-8b844458af2e","Type":"ContainerStarted","Data":"738921b24f73ff974a364185a501a413ad8f1c4490af30473d56675724b702e0"}
Sep 08 13:59:02.761493 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:02.761458    2559 generic.go:356] "Generic (PLEG): container finished" podID="0905014a-a92b-43e0-9092-01dd91124be2" containerID="4791a486ea16853f0bc176bba30279921ebaff9d918b292afe08d26bbe114c54" exitCode=0
Sep 08 13:59:02.762065 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:02.761513    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerDied","Data":"4791a486ea16853f0bc176bba30279921ebaff9d918b292afe08d26bbe114c54"}
Sep 08 13:59:03.054340 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:03.054271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:03.206783 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:03.206741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:59:03.206987 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:03.206817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:59:03.206987 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:03.206917    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:03.206987 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:03.206956    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 13:59:03.206987 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:03.206972    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64784dcfb4-gxkct: secret "image-registry-tls" not found
Sep 08 13:59:03.207181 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:03.206999    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls podName:9b9c0f03-800a-418b-8588-72068e616bda nodeName:}" failed. No retries permitted until 2026-09-08 13:59:07.206977247 +0000 UTC m=+43.120882163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls") pod "dns-default-lnq9g" (UID: "9b9c0f03-800a-418b-8588-72068e616bda") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:03.207181 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:03.207022    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls podName:911db171-cc19-417a-9d12-02e7971a9816 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:07.207009337 +0000 UTC m=+43.120914244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls") pod "image-registry-64784dcfb4-gxkct" (UID: "911db171-cc19-417a-9d12-02e7971a9816") : secret "image-registry-tls" not found
Sep 08 13:59:03.212920 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:03.212885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:03.478523 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:03.478442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:03.622042 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:03.622004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:03.768592 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:03.768514    2559 generic.go:356] "Generic (PLEG): container finished" podID="0905014a-a92b-43e0-9092-01dd91124be2" containerID="75b16f2e9325cbf0a322dc1ab48d4f0a98fec0701fab7cfd2492e61e214b1f82" exitCode=0
Sep 08 13:59:03.769145 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:03.768604    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerDied","Data":"75b16f2e9325cbf0a322dc1ab48d4f0a98fec0701fab7cfd2492e61e214b1f82"}
Sep 08 13:59:04.137942 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:04.137903    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:04.248424 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:04.248386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:04.777215 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:04.776864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76nth" event={"ID":"0905014a-a92b-43e0-9092-01dd91124be2","Type":"ContainerStarted","Data":"780f16fa92c9ec114cc202e148fe0c67851d38b39a0ca6f3974218ba6a999f13"}
Sep 08 13:59:04.778539 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:04.778509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tzjbr" event={"ID":"d2138ffc-17e7-4b73-9337-8b844458af2e","Type":"ContainerStarted","Data":"526cb410588d51ca8b78a9eebfbebe06fa42694eeda8a5528774f12bfd50fc32"}
Sep 08 13:59:04.820250 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:04.820196    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-76nth" podStartSLOduration=6.182119528 podStartE2EDuration="38.820178982s" totalImagesPullingTime="32.638059454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:04.818937318 +0000 UTC m=+40.732842234" watchObservedRunningTime="2026-09-08 13:59:04.820178982 +0000 UTC m=+40.734083938"
Sep 08 13:59:04.981254 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:04.981209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:05.227675 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:05.227636    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:05.340165 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:05.340128    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:06.382382 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:06.382340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:06.491443 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:06.491396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:06.596903 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:06.596871    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:07.239376 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:07.239333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:59:07.239595 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:07.239393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:59:07.239595 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:07.239495    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 13:59:07.239595 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:07.239506    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64784dcfb4-gxkct: secret "image-registry-tls" not found
Sep 08 13:59:07.239595 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:07.239504    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:07.239595 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:07.239558    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls podName:911db171-cc19-417a-9d12-02e7971a9816 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:15.239543976 +0000 UTC m=+51.153448873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls") pod "image-registry-64784dcfb4-gxkct" (UID: "911db171-cc19-417a-9d12-02e7971a9816") : secret "image-registry-tls" not found
Sep 08 13:59:07.239595 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:07.239571    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls podName:9b9c0f03-800a-418b-8588-72068e616bda nodeName:}" failed. No retries permitted until 2026-09-08 13:59:15.23956397 +0000 UTC m=+51.153468864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls") pod "dns-default-lnq9g" (UID: "9b9c0f03-800a-418b-8588-72068e616bda") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:07.362815 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:07.362773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:07.482257 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:07.482219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:07.576211 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:07.576174    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:07.766972 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:07.766942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:07.855878 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:07.855786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:09.234501 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:09.234454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:09.311238 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:09.311188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:15.299001 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:15.298956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:59:15.299446 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:15.299025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:59:15.299446 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:15.299112    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:15.299446 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:15.299154    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 13:59:15.299446 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:15.299170    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64784dcfb4-gxkct: secret "image-registry-tls" not found
Sep 08 13:59:15.299446 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:15.299189    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls podName:9b9c0f03-800a-418b-8588-72068e616bda nodeName:}" failed. No retries permitted until 2026-09-08 13:59:31.299172954 +0000 UTC m=+67.213077868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls") pod "dns-default-lnq9g" (UID: "9b9c0f03-800a-418b-8588-72068e616bda") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:15.299446 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:15.299223    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls podName:911db171-cc19-417a-9d12-02e7971a9816 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:31.299205931 +0000 UTC m=+67.213110825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls") pod "image-registry-64784dcfb4-gxkct" (UID: "911db171-cc19-417a-9d12-02e7971a9816") : secret "image-registry-tls" not found
Sep 08 13:59:16.213165 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:16.213125    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:18.083295 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:18.083251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:18.185266 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:18.185210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:21.352333 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:21.352277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:21.461990 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:21.461947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:23.137761 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:23.137719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:26.749495 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:26.749467    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcxxd"
Sep 08 13:59:26.790941 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:26.790883    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tzjbr" podStartSLOduration=24.812879932 podStartE2EDuration="27.790866293s" totalImagesPullingTime="2.977986361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:04.865427686 +0000 UTC m=+40.779332601" watchObservedRunningTime="2026-09-08 13:59:26.790866293 +0000 UTC m=+62.704771210"
Sep 08 13:59:26.920525 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:26.920483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:27.020760 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:27.020676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:29.360916 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.360880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:29.407392 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.407347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:59:29.407501 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.407405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 13:59:29.410677 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.410657    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 13:59:29.410722 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.410661    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 13:59:29.418429 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:29.418405    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 13:59:29.418504 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:29.418492    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs podName:e3603e41-2516-4a8f-ba67-862fd59e9dc5 nodeName:}" failed. No retries permitted until 2026-09-08 14:00:33.418475977 +0000 UTC m=+129.332380872 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs") pod "network-metrics-daemon-lf79g" (UID: "e3603e41-2516-4a8f-ba67-862fd59e9dc5") : secret "metrics-daemon-secret" not found
Sep 08 13:59:29.421802 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.421774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/53951034-ca2a-4a8a-ab31-d0482394d753-original-pull-secret\") pod \"global-pull-secret-syncer-2snxg\" (UID: \"53951034-ca2a-4a8a-ab31-d0482394d753\") " pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:59:29.483345 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.483311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:29.508530 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.508483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:59:29.512193 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.512169    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 13:59:29.523468 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.523444    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 13:59:29.533081 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.533051    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg6gr\" (UniqueName: \"kubernetes.io/projected/82698349-e4c6-49f4-92e7-77cf5f5d120d-kube-api-access-qg6gr\") pod \"network-check-target-4ch2v\" (UID: \"82698349-e4c6-49f4-92e7-77cf5f5d120d\") " pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:59:29.695386 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.695278    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cmv8\""
Sep 08 13:59:29.700808 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.700757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:59:29.703129 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.703095    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2snxg"
Sep 08 13:59:29.985867 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.985762    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2snxg"]
Sep 08 13:59:29.989254 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:29.989226    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4ch2v"]
Sep 08 13:59:29.989360 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:59:29.989296    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53951034_ca2a_4a8a_ab31_d0482394d753.slice/crio-5c032975c05264d274db39da490a41aee9763cca1a2a5545a0850019a5727b98 WatchSource:0}: Error finding container 5c032975c05264d274db39da490a41aee9763cca1a2a5545a0850019a5727b98: Status 404 returned error can't find the container with id 5c032975c05264d274db39da490a41aee9763cca1a2a5545a0850019a5727b98
Sep 08 13:59:29.992655 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:59:29.992594    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82698349_e4c6_49f4_92e7_77cf5f5d120d.slice/crio-3149f3767f63850c81befc6e86e8a4b8c339bf18786fe9cb72d0ae4a183868e8 WatchSource:0}: Error finding container 3149f3767f63850c81befc6e86e8a4b8c339bf18786fe9cb72d0ae4a183868e8: Status 404 returned error can't find the container with id 3149f3767f63850c81befc6e86e8a4b8c339bf18786fe9cb72d0ae4a183868e8
Sep 08 13:59:30.841682 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:30.841643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2snxg" event={"ID":"53951034-ca2a-4a8a-ab31-d0482394d753","Type":"ContainerStarted","Data":"5c032975c05264d274db39da490a41aee9763cca1a2a5545a0850019a5727b98"}
Sep 08 13:59:30.843368 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:30.843328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4ch2v" event={"ID":"82698349-e4c6-49f4-92e7-77cf5f5d120d","Type":"ContainerStarted","Data":"3149f3767f63850c81befc6e86e8a4b8c339bf18786fe9cb72d0ae4a183868e8"}
Sep 08 13:59:31.324576 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:31.324536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 13:59:31.324793 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:31.324586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 13:59:31.324793 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:31.324721    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 13:59:31.324793 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:31.324726    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:59:31.324921 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:31.324801    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls podName:9b9c0f03-800a-418b-8588-72068e616bda nodeName:}" failed. No retries permitted until 2026-09-08 14:00:03.324780319 +0000 UTC m=+99.238685216 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls") pod "dns-default-lnq9g" (UID: "9b9c0f03-800a-418b-8588-72068e616bda") : secret "dns-default-metrics-tls" not found
Sep 08 13:59:31.324921 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:31.324733    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64784dcfb4-gxkct: secret "image-registry-tls" not found
Sep 08 13:59:31.324921 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:31.324850    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls podName:911db171-cc19-417a-9d12-02e7971a9816 nodeName:}" failed. No retries permitted until 2026-09-08 14:00:03.324839457 +0000 UTC m=+99.238744357 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls") pod "image-registry-64784dcfb4-gxkct" (UID: "911db171-cc19-417a-9d12-02e7971a9816") : secret "image-registry-tls" not found
Sep 08 13:59:33.854737 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:33.854693    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4ch2v" event={"ID":"82698349-e4c6-49f4-92e7-77cf5f5d120d","Type":"ContainerStarted","Data":"13dd05d3800568ffc5b328fa2975f088ff46eab12e71c2394163be1a51021571"}
Sep 08 13:59:33.855191 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:33.854827    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 13:59:33.873596 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:33.873528    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4ch2v" podStartSLOduration=65.660496469 podStartE2EDuration="1m8.873505974s" totalImagesPullingTime="3.213009505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:33.87265533 +0000 UTC m=+69.786560240" watchObservedRunningTime="2026-09-08 13:59:33.873505974 +0000 UTC m=+69.787410890"
Sep 08 13:59:34.211171 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.211088    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"]
Sep 08 13:59:34.214365 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.214336    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.217274 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.217232    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 08 13:59:34.217421 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.217315    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 08 13:59:34.217549 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.217526    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:59:34.218259 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.218237    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 08 13:59:34.218374 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.218284    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rlq8m\""
Sep 08 13:59:34.228233 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.228210    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"]
Sep 08 13:59:34.320145 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.320103    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"]
Sep 08 13:59:34.322961 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.322939    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.326877 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.326851    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 13:59:34.327034 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.326933    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pqb9f\""
Sep 08 13:59:34.327258 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.327196    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 08 13:59:34.327258 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.327214    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 08 13:59:34.327443 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.327221    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 13:59:34.344468 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.344436    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"]
Sep 08 13:59:34.354538 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.354500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.354735 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.354583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.354735 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.354697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fjld\" (UniqueName: \"kubernetes.io/projected/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-kube-api-access-8fjld\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.425150 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.425115    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9jxpg"]
Sep 08 13:59:34.428225 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.428200    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fxpzw"]
Sep 08 13:59:34.428399 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.428329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-9jxpg"
Sep 08 13:59:34.431207 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.431177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:34.431523 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.431497    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vsg7h\""
Sep 08 13:59:34.435422 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.435398    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-srnt4\""
Sep 08 13:59:34.435422 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.435414    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 08 13:59:34.435635 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.435398    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 08 13:59:34.446194 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.446161    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9jxpg"]
Sep 08 13:59:34.455866 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.455831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fjld\" (UniqueName: \"kubernetes.io/projected/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-kube-api-access-8fjld\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.456041 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.455874    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7g86\" (UniqueName: \"kubernetes.io/projected/395a59cc-68b7-4a12-9c80-a489d5f964d0-kube-api-access-j7g86\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.456041 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.455912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.456041 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.455978    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.456041 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.456007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/395a59cc-68b7-4a12-9c80-a489d5f964d0-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.456041 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.456035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.456645 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.456622    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.458781 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.458752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.471571 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.471487    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fxpzw"]
Sep 08 13:59:34.474530 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.474507    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fjld\" (UniqueName: \"kubernetes.io/projected/5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c-kube-api-access-8fjld\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9zsk\" (UID: \"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.524931 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.524890    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"
Sep 08 13:59:34.557391 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.557353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/395a59cc-68b7-4a12-9c80-a489d5f964d0-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.557391 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.557392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:34.557680 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.557578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfnfx\" (UniqueName: \"kubernetes.io/projected/67c8483c-335c-4e62-ae1d-cb47666a7c59-kube-api-access-vfnfx\") pod \"network-check-source-685456655f-9jxpg\" (UID: \"67c8483c-335c-4e62-ae1d-cb47666a7c59\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9jxpg"
Sep 08 13:59:34.557680 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.557640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7g86\" (UniqueName: \"kubernetes.io/projected/395a59cc-68b7-4a12-9c80-a489d5f964d0-kube-api-access-j7g86\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.557790 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.557688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.557790 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.557739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9fe0057-5561-4448-85d6-700f357da9c8-nginx-conf\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:34.557902 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:34.557883    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:34.557987 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:34.557957    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls podName:395a59cc-68b7-4a12-9c80-a489d5f964d0 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:35.057937338 +0000 UTC m=+70.971842237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bpvbn" (UID: "395a59cc-68b7-4a12-9c80-a489d5f964d0") : secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:34.558235 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.558208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/395a59cc-68b7-4a12-9c80-a489d5f964d0-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.568061 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.568037    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7g86\" (UniqueName: \"kubernetes.io/projected/395a59cc-68b7-4a12-9c80-a489d5f964d0-kube-api-access-j7g86\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:34.577193 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.577158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:34.659117 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.659070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9fe0057-5561-4448-85d6-700f357da9c8-nginx-conf\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:34.659331 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.659142    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:34.659331 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.659204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfnfx\" (UniqueName: \"kubernetes.io/projected/67c8483c-335c-4e62-ae1d-cb47666a7c59-kube-api-access-vfnfx\") pod \"network-check-source-685456655f-9jxpg\" (UID: \"67c8483c-335c-4e62-ae1d-cb47666a7c59\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9jxpg"
Sep 08 13:59:34.660399 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.660370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9fe0057-5561-4448-85d6-700f357da9c8-nginx-conf\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:34.660525 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:34.660479    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:59:34.660591 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:34.660550    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert podName:d9fe0057-5561-4448-85d6-700f357da9c8 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:35.160531446 +0000 UTC m=+71.074436354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fxpzw" (UID: "d9fe0057-5561-4448-85d6-700f357da9c8") : secret "networking-console-plugin-cert" not found
Sep 08 13:59:34.662120 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.662090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:34.670354 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.670325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfnfx\" (UniqueName: \"kubernetes.io/projected/67c8483c-335c-4e62-ae1d-cb47666a7c59-kube-api-access-vfnfx\") pod \"network-check-source-685456655f-9jxpg\" (UID: \"67c8483c-335c-4e62-ae1d-cb47666a7c59\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9jxpg"
Sep 08 13:59:34.740111 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.740026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-9jxpg"
Sep 08 13:59:34.989938 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:34.989904    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk"]
Sep 08 13:59:34.994652 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:59:34.994600    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f73bdc2_eb6e_4fde_a8ef_a860058ffe2c.slice/crio-64f77e687d585206e3cfde6403e23c6bfdaff2edfecd46a05dd8b12caa813b02 WatchSource:0}: Error finding container 64f77e687d585206e3cfde6403e23c6bfdaff2edfecd46a05dd8b12caa813b02: Status 404 returned error can't find the container with id 64f77e687d585206e3cfde6403e23c6bfdaff2edfecd46a05dd8b12caa813b02
Sep 08 13:59:35.031479 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.031441    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9jxpg"]
Sep 08 13:59:35.034869 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:59:35.034838    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c8483c_335c_4e62_ae1d_cb47666a7c59.slice/crio-a997840a23b7214efa21862590c4c17b49d697dfd546ad67a0df1d61bb24630e WatchSource:0}: Error finding container a997840a23b7214efa21862590c4c17b49d697dfd546ad67a0df1d61bb24630e: Status 404 returned error can't find the container with id a997840a23b7214efa21862590c4c17b49d697dfd546ad67a0df1d61bb24630e
Sep 08 13:59:35.062525 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.062494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:35.062681 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:35.062663    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:35.062738 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:35.062733    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls podName:395a59cc-68b7-4a12-9c80-a489d5f964d0 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:36.062716016 +0000 UTC m=+71.976620921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bpvbn" (UID: "395a59cc-68b7-4a12-9c80-a489d5f964d0") : secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:35.163015 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.162973    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:35.163203 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:35.163102    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:59:35.163203 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:35.163184    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert podName:d9fe0057-5561-4448-85d6-700f357da9c8 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:36.163167633 +0000 UTC m=+72.077072527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fxpzw" (UID: "d9fe0057-5561-4448-85d6-700f357da9c8") : secret "networking-console-plugin-cert" not found
Sep 08 13:59:35.862498 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.862445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk" event={"ID":"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c","Type":"ContainerStarted","Data":"64f77e687d585206e3cfde6403e23c6bfdaff2edfecd46a05dd8b12caa813b02"}
Sep 08 13:59:35.864446 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.864411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2snxg" event={"ID":"53951034-ca2a-4a8a-ab31-d0482394d753","Type":"ContainerStarted","Data":"83e3869a2914b38851dfb016145d08ffb8588568c900ce6df8dff77a490908d5"}
Sep 08 13:59:35.866202 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.866162    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-9jxpg" event={"ID":"67c8483c-335c-4e62-ae1d-cb47666a7c59","Type":"ContainerStarted","Data":"fe59c506363719cbfbf969163ed2510fe873a06e1108bf40a5e457dd178c44fd"}
Sep 08 13:59:35.866393 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.866218    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-9jxpg" event={"ID":"67c8483c-335c-4e62-ae1d-cb47666a7c59","Type":"ContainerStarted","Data":"a997840a23b7214efa21862590c4c17b49d697dfd546ad67a0df1d61bb24630e"}
Sep 08 13:59:35.883010 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.882950    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2snxg" podStartSLOduration=65.110827729 podStartE2EDuration="1m9.882934429s" totalImagesPullingTime="4.7721067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:35.882408968 +0000 UTC m=+71.796313884" watchObservedRunningTime="2026-09-08 13:59:35.882934429 +0000 UTC m=+71.796839344"
Sep 08 13:59:35.899251 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:35.899184    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-9jxpg" podStartSLOduration=1.89916177 podStartE2EDuration="1.89916177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:35.898484355 +0000 UTC m=+71.812389272" watchObservedRunningTime="2026-09-08 13:59:35.89916177 +0000 UTC m=+71.813066688"
Sep 08 13:59:36.071198 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:36.071150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:36.071645 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:36.071304    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:36.071645 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:36.071372    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls podName:395a59cc-68b7-4a12-9c80-a489d5f964d0 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:38.071355244 +0000 UTC m=+73.985260140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bpvbn" (UID: "395a59cc-68b7-4a12-9c80-a489d5f964d0") : secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:36.171750 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:36.171653    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:36.171903 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:36.171794    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:59:36.171903 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:36.171855    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert podName:d9fe0057-5561-4448-85d6-700f357da9c8 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:38.17183996 +0000 UTC m=+74.085744858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fxpzw" (UID: "d9fe0057-5561-4448-85d6-700f357da9c8") : secret "networking-console-plugin-cert" not found
Sep 08 13:59:36.346219 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:36.346180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:38.058993 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:38.058957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:38.085578 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:38.085532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:38.085758 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:38.085718    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:38.085825 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:38.085811    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls podName:395a59cc-68b7-4a12-9c80-a489d5f964d0 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:42.085787224 +0000 UTC m=+77.999692125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bpvbn" (UID: "395a59cc-68b7-4a12-9c80-a489d5f964d0") : secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:38.157163 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:38.157129    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:38.186600 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:38.186562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:38.186793 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:38.186743    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:59:38.186850 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:38.186823    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert podName:d9fe0057-5561-4448-85d6-700f357da9c8 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:42.18680225 +0000 UTC m=+78.100707162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fxpzw" (UID: "d9fe0057-5561-4448-85d6-700f357da9c8") : secret "networking-console-plugin-cert" not found
Sep 08 13:59:38.875856 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:38.875755    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk" event={"ID":"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c","Type":"ContainerStarted","Data":"f5a926503653bf3ae4e9861fd668593a6c3132eead21736fd4f1f6bdaf009ff4"}
Sep 08 13:59:38.892707 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:38.892654    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk" podStartSLOduration=1.298093338 podStartE2EDuration="4.892637817s" totalImagesPullingTime="3.594544479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:38.892634023 +0000 UTC m=+74.806538962" watchObservedRunningTime="2026-09-08 13:59:38.892637817 +0000 UTC m=+74.806542732"
Sep 08 13:59:39.098635 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.098572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:39.167458 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.167356    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:39.323957 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.323922    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7cqnp"]
Sep 08 13:59:39.327141 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.327124    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.330496 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:39.330461    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-8q4kl\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8q4kl\"" type="*v1.Secret"
Sep 08 13:59:39.330702 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:39.330529    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Sep 08 13:59:39.330702 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:39.330603    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap"
Sep 08 13:59:39.331226 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.331204    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 13:59:39.331324 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.331283    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 13:59:39.337108 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:39.337074    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-7cqnp\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" podUID="940f9c24-0d73-4050-862a-328786759de3" pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.343927 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.343894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:39.348039 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.348014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7cqnp"]
Sep 08 13:59:39.395491 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.395434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x8zw\" (UniqueName: \"kubernetes.io/projected/940f9c24-0d73-4050-862a-328786759de3-kube-api-access-7x8zw\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.395491 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.395488    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/940f9c24-0d73-4050-862a-328786759de3-crio-socket\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.395734 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.395508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.395734 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.395603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.395734 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.395662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/940f9c24-0d73-4050-862a-328786759de3-data-volume\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.444378 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.444283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:39.496749 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.496713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.496749 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.496764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/940f9c24-0d73-4050-862a-328786759de3-data-volume\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.496991 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.496811    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x8zw\" (UniqueName: \"kubernetes.io/projected/940f9c24-0d73-4050-862a-328786759de3-kube-api-access-7x8zw\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.496991 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.496830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/940f9c24-0d73-4050-862a-328786759de3-crio-socket\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.496991 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.496845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.496991 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.496936    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/940f9c24-0d73-4050-862a-328786759de3-crio-socket\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.497156 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.497138    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/940f9c24-0d73-4050-862a-328786759de3-data-volume\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.506941 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.506911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x8zw\" (UniqueName: \"kubernetes.io/projected/940f9c24-0d73-4050-862a-328786759de3-kube-api-access-7x8zw\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:39.584141 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.584109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:39.692404 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.692366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:39.786026 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.785988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:39.884389 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:39.884350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:40.220693 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:40.220587    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 13:59:40.226986 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:40.226956    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:40.227103 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:40.227074    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:40.727049182 +0000 UTC m=+76.640954076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:40.497652 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:40.497517    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition
Sep 08 13:59:40.497652 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:40.497650    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:40.997604927 +0000 UTC m=+76.911509821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : failed to sync secret cache: timed out waiting for the condition
Sep 08 13:59:40.751968 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:40.751884    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 13:59:40.764396 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:40.764372    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8q4kl\""
Sep 08 13:59:40.808097 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:40.808061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:40.808205 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:40.808186    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:40.808263 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:40.808253    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:41.808238081 +0000 UTC m=+77.722142979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:41.009471 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:41.009380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:41.009649 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:41.009541    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:41.009649 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:41.009635    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:42.009595387 +0000 UTC m=+77.923500280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:41.426450 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:41.426411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:41.466936 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:41.466914    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xb8x4_48d6c68d-5696-488b-8c0d-851fe59be022/dns-node-resolver/0.log"
Sep 08 13:59:41.491537 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:41.491505    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:41.814570 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:41.814537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:41.814753 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:41.814700    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:41.814790 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:41.814772    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:43.814755393 +0000 UTC m=+79.728660288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:42.016187 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:42.016123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:42.016404 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:42.016275    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:42.016404 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:42.016351    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:44.016331463 +0000 UTC m=+79.930236360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:42.116809 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:42.116703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:42.116952 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:42.116854    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:42.116952 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:42.116924    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls podName:395a59cc-68b7-4a12-9c80-a489d5f964d0 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:50.11690905 +0000 UTC m=+86.030813947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bpvbn" (UID: "395a59cc-68b7-4a12-9c80-a489d5f964d0") : secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:42.217372 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:42.217314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:42.217573 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:42.217465    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:59:42.217573 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:42.217532    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert podName:d9fe0057-5561-4448-85d6-700f357da9c8 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:50.217517329 +0000 UTC m=+86.131422224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fxpzw" (UID: "d9fe0057-5561-4448-85d6-700f357da9c8") : secret "networking-console-plugin-cert" not found
Sep 08 13:59:42.450845 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:42.450748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:42.467630 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:42.467575    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-scgr5_0b3b317c-8b92-4736-b169-694d75599ef1/node-ca/0.log"
Sep 08 13:59:43.267269 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:43.267234    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tzjbr_d2138ffc-17e7-4b73-9337-8b844458af2e/serve-healthcheck-canary/0.log"
Sep 08 13:59:43.831244 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:43.831204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:43.831670 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:43.831340    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:43.831670 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:43.831408    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:47.831390527 +0000 UTC m=+83.745295428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:44.032590 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:44.032548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:44.032779 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:44.032714    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:44.032827 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:44.032779    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:48.032764085 +0000 UTC m=+83.946668979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:45.386951 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:45.386919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:45.486888 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:45.486851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:45.696960 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:45.696788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:45.797382 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:45.797351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:45.885563 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:45.885531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:46.773802 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:46.773767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:47.194963 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:47.194930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:47.373720 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:47.373685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:47.575992 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:47.575958    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:47.772062 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:47.772021    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:47.862243 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:47.862161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:47.862621 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:47.862283    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:59:47.862621 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:47.862350    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:55.862333662 +0000 UTC m=+91.776238556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : configmap "kube-rbac-proxy" not found
Sep 08 13:59:48.063559 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:48.063498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:48.063766 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:48.063694    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:48.063766 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:48.063766    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls podName:940f9c24-0d73-4050-862a-328786759de3 nodeName:}" failed. No retries permitted until 2026-09-08 13:59:56.063748929 +0000 UTC m=+91.977653823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqnp" (UID: "940f9c24-0d73-4050-862a-328786759de3") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:59:48.787668 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:48.787620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:48.985499 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:48.985461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:49.182626 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:49.182514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:49.378782 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:49.378740    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:49.449073 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:49.448987    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:49.573407 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:49.573367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:49.976858 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:49.976824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:50.127277 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:50.127247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:50.181226 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:50.181191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 13:59:50.181358 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:50.181341    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:50.181417 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:50.181407    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls podName:395a59cc-68b7-4a12-9c80-a489d5f964d0 nodeName:}" failed. No retries permitted until 2026-09-08 14:00:06.181392537 +0000 UTC m=+102.095297435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bpvbn" (UID: "395a59cc-68b7-4a12-9c80-a489d5f964d0") : secret "cluster-monitoring-operator-tls" not found
Sep 08 13:59:50.281729 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:50.281697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 13:59:50.281875 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:50.281861    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:59:50.281942 ip-10-0-142-105 kubenswrapper[2559]: E0908 13:59:50.281929    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert podName:d9fe0057-5561-4448-85d6-700f357da9c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:00:06.281912329 +0000 UTC m=+102.195817239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fxpzw" (UID: "d9fe0057-5561-4448-85d6-700f357da9c8") : secret "networking-console-plugin-cert" not found
Sep 08 13:59:50.578734 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:50.578626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:50.980163 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:50.980062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:51.392235 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:51.392203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:51.573992 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:51.573949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:51.674069 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:51.673971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:51.980870 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:51.980774    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:52.385765 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:52.385729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:52.633847 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:52.633812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:52.736962 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:52.736875    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:53.699110 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:53.699080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:53.801032 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:53.800993    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:53.992567 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:53.992478    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:54.179487 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:54.179450    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:54.395317 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:54.395282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:54.571525 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:54.571495    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:55.577939 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:55.577898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:55.771328 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:55.771295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:55.927342 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:55.927261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:55.927758 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:55.927741    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/940f9c24-0d73-4050-862a-328786759de3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:55.972049 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:55.972013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:56.128854 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.128807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:56.131291 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.131272    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/940f9c24-0d73-4050-862a-328786759de3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqnp\" (UID: \"940f9c24-0d73-4050-862a-328786759de3\") " pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:56.136793 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.136771    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7cqnp"
Sep 08 13:59:56.176796 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.176752    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:56.440204 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.440115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7cqnp"]
Sep 08 13:59:56.443211 ip-10-0-142-105 kubenswrapper[2559]: W0908 13:59:56.443178    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940f9c24_0d73_4050_862a_328786759de3.slice/crio-3d04ef4263bf9307e253a8964526da0165d792ef223059f26ad983c32920873d WatchSource:0}: Error finding container 3d04ef4263bf9307e253a8964526da0165d792ef223059f26ad983c32920873d: Status 404 returned error can't find the container with id 3d04ef4263bf9307e253a8964526da0165d792ef223059f26ad983c32920873d
Sep 08 13:59:56.772809 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.772724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:56.904093 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.904048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:56.926496 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.926459    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cqnp" event={"ID":"940f9c24-0d73-4050-862a-328786759de3","Type":"ContainerStarted","Data":"9357c36abf25609b9728adf59dccd2eb50635e278e053cb96173922b5f8d1248"}
Sep 08 13:59:56.926679 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:56.926514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cqnp" event={"ID":"940f9c24-0d73-4050-862a-328786759de3","Type":"ContainerStarted","Data":"3d04ef4263bf9307e253a8964526da0165d792ef223059f26ad983c32920873d"}
Sep 08 13:59:57.069339 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:57.069304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:57.226828 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:57.226791    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:57.748738 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:57.748645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:57.935855 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:57.935825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cqnp" event={"ID":"940f9c24-0d73-4050-862a-328786759de3","Type":"ContainerStarted","Data":"58ef196902dce7785e1715100da142da7ce8ccdefae28c7c7925adc386ac9eb5"}
Sep 08 13:59:58.653740 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:58.653711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:58.755265 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:58.755234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:58.941393 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:58.941308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cqnp" event={"ID":"940f9c24-0d73-4050-862a-328786759de3","Type":"ContainerStarted","Data":"054bdbdfb2de0bf7e324563facba6b9419f6cf5fe88d76068f2aae93c9185e2a"}
Sep 08 13:59:58.961450 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:58.961406    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7cqnp" podStartSLOduration=17.81822234 podStartE2EDuration="19.961392058s" totalImagesPullingTime="2.143169718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:59:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:59:58.959993706 +0000 UTC m=+94.873898621" watchObservedRunningTime="2026-09-08 13:59:58.961392058 +0000 UTC m=+94.875296973"
Sep 08 13:59:59.843062 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:59.843025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 13:59:59.909893 ip-10-0-142-105 kubenswrapper[2559]: I0908 13:59:59.909855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:02.807367 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.807332    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"]
Sep 08 14:00:02.811383 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.811349    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"
Sep 08 14:00:02.816920 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.816898    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 14:00:02.817084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.816943    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 14:00:02.817084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.816997    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 14:00:02.817084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.817017    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 08 14:00:02.817084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.816997    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rb8gn\""
Sep 08 14:00:02.828928 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.828904    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"]
Sep 08 14:00:02.873145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.873118    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-xjcd6"]
Sep 08 14:00:02.876042 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.876020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-xjcd6"
Sep 08 14:00:02.879132 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.879096    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 14:00:02.879441 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.879419    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sv5nb\""
Sep 08 14:00:02.879555 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.879542    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 14:00:02.879730 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.879710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a059952-6cb0-456d-9b03-335d306e4aeb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b5b7f6f48-rng7n\" (UID: \"8a059952-6cb0-456d-9b03-335d306e4aeb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"
Sep 08 14:00:02.879844 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.879825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cld\" (UniqueName: \"kubernetes.io/projected/8a059952-6cb0-456d-9b03-335d306e4aeb-kube-api-access-f6cld\") pod \"managed-serviceaccount-addon-agent-b5b7f6f48-rng7n\" (UID: \"8a059952-6cb0-456d-9b03-335d306e4aeb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"
Sep 08 14:00:02.890728 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.890709    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-xjcd6"]
Sep 08 14:00:02.980670 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.980640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cld\" (UniqueName: \"kubernetes.io/projected/8a059952-6cb0-456d-9b03-335d306e4aeb-kube-api-access-f6cld\") pod \"managed-serviceaccount-addon-agent-b5b7f6f48-rng7n\" (UID: \"8a059952-6cb0-456d-9b03-335d306e4aeb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"
Sep 08 14:00:02.980842 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.980678    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz6l7\" (UniqueName: \"kubernetes.io/projected/c2996f25-3a2a-45ba-bc6e-08bba47a26ac-kube-api-access-pz6l7\") pod \"downloads-85d98c998f-xjcd6\" (UID: \"c2996f25-3a2a-45ba-bc6e-08bba47a26ac\") " pod="openshift-console/downloads-85d98c998f-xjcd6"
Sep 08 14:00:02.980842 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.980756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a059952-6cb0-456d-9b03-335d306e4aeb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b5b7f6f48-rng7n\" (UID: \"8a059952-6cb0-456d-9b03-335d306e4aeb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"
Sep 08 14:00:02.983301 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.983271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a059952-6cb0-456d-9b03-335d306e4aeb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b5b7f6f48-rng7n\" (UID: \"8a059952-6cb0-456d-9b03-335d306e4aeb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"
Sep 08 14:00:02.997514 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:02.997491    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cld\" (UniqueName: \"kubernetes.io/projected/8a059952-6cb0-456d-9b03-335d306e4aeb-kube-api-access-f6cld\") pod \"managed-serviceaccount-addon-agent-b5b7f6f48-rng7n\" (UID: \"8a059952-6cb0-456d-9b03-335d306e4aeb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"
Sep 08 14:00:03.081632 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.081536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz6l7\" (UniqueName: \"kubernetes.io/projected/c2996f25-3a2a-45ba-bc6e-08bba47a26ac-kube-api-access-pz6l7\") pod \"downloads-85d98c998f-xjcd6\" (UID: \"c2996f25-3a2a-45ba-bc6e-08bba47a26ac\") " pod="openshift-console/downloads-85d98c998f-xjcd6"
Sep 08 14:00:03.090927 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.090900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz6l7\" (UniqueName: \"kubernetes.io/projected/c2996f25-3a2a-45ba-bc6e-08bba47a26ac-kube-api-access-pz6l7\") pod \"downloads-85d98c998f-xjcd6\" (UID: \"c2996f25-3a2a-45ba-bc6e-08bba47a26ac\") " pod="openshift-console/downloads-85d98c998f-xjcd6"
Sep 08 14:00:03.133021 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.132995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"
Sep 08 14:00:03.184936 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.184910    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-xjcd6"
Sep 08 14:00:03.383782 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.383705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 14:00:03.383782 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.383753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 14:00:03.386220 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.386196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b9c0f03-800a-418b-8588-72068e616bda-metrics-tls\") pod \"dns-default-lnq9g\" (UID: \"9b9c0f03-800a-418b-8588-72068e616bda\") " pod="openshift-dns/dns-default-lnq9g"
Sep 08 14:00:03.386322 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.386235    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"image-registry-64784dcfb4-gxkct\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") " pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 14:00:03.400973 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.400940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:03.403314 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.403297    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b4mdc\""
Sep 08 14:00:03.405957 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.405936    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n"]
Sep 08 14:00:03.408744 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:03.408719    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a059952_6cb0_456d_9b03_335d306e4aeb.slice/crio-2034776872d716b2a304965ed5002e93a1687a4abfc5738a122bd34ed54e468b WatchSource:0}: Error finding container 2034776872d716b2a304965ed5002e93a1687a4abfc5738a122bd34ed54e468b: Status 404 returned error can't find the container with id 2034776872d716b2a304965ed5002e93a1687a4abfc5738a122bd34ed54e468b
Sep 08 14:00:03.410989 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.410959    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lnq9g"
Sep 08 14:00:03.464219 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.464148    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-xjcd6"]
Sep 08 14:00:03.470455 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:03.470431    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2996f25_3a2a_45ba_bc6e_08bba47a26ac.slice/crio-4b4c645212c998b11e572388fa968cd2c20c349abc68b6c905f5af7e6235a913 WatchSource:0}: Error finding container 4b4c645212c998b11e572388fa968cd2c20c349abc68b6c905f5af7e6235a913: Status 404 returned error can't find the container with id 4b4c645212c998b11e572388fa968cd2c20c349abc68b6c905f5af7e6235a913
Sep 08 14:00:03.649683 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.649588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:03.665960 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.665934    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j2pct\""
Sep 08 14:00:03.674142 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.674111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 14:00:03.702430 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.702405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lnq9g"]
Sep 08 14:00:03.707805 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:03.707777    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9c0f03_800a_418b_8588_72068e616bda.slice/crio-cc18fcd997f27e6c70c1bcfc7682ce5f48504fb0696757b976c7ee6c8159d8b0 WatchSource:0}: Error finding container cc18fcd997f27e6c70c1bcfc7682ce5f48504fb0696757b976c7ee6c8159d8b0: Status 404 returned error can't find the container with id cc18fcd997f27e6c70c1bcfc7682ce5f48504fb0696757b976c7ee6c8159d8b0
Sep 08 14:00:03.956021 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.955929    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64784dcfb4-gxkct"]
Sep 08 14:00:03.958304 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.958267    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lnq9g" event={"ID":"9b9c0f03-800a-418b-8588-72068e616bda","Type":"ContainerStarted","Data":"cc18fcd997f27e6c70c1bcfc7682ce5f48504fb0696757b976c7ee6c8159d8b0"}
Sep 08 14:00:03.959598 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.959571    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n" event={"ID":"8a059952-6cb0-456d-9b03-335d306e4aeb","Type":"ContainerStarted","Data":"2034776872d716b2a304965ed5002e93a1687a4abfc5738a122bd34ed54e468b"}
Sep 08 14:00:03.959779 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:03.959759    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911db171_cc19_417a_9d12_02e7971a9816.slice/crio-c22c5f8d74f57d849dfab50f2cf574691bf4be46d2158c5dcb6f91f414d8af05 WatchSource:0}: Error finding container c22c5f8d74f57d849dfab50f2cf574691bf4be46d2158c5dcb6f91f414d8af05: Status 404 returned error can't find the container with id c22c5f8d74f57d849dfab50f2cf574691bf4be46d2158c5dcb6f91f414d8af05
Sep 08 14:00:03.960807 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:03.960782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-xjcd6" event={"ID":"c2996f25-3a2a-45ba-bc6e-08bba47a26ac","Type":"ContainerStarted","Data":"4b4c645212c998b11e572388fa968cd2c20c349abc68b6c905f5af7e6235a913"}
Sep 08 14:00:04.860143 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:04.860117    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4ch2v"
Sep 08 14:00:04.969653 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:04.969595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct" event={"ID":"911db171-cc19-417a-9d12-02e7971a9816","Type":"ContainerStarted","Data":"9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda"}
Sep 08 14:00:04.969993 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:04.969706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct" event={"ID":"911db171-cc19-417a-9d12-02e7971a9816","Type":"ContainerStarted","Data":"c22c5f8d74f57d849dfab50f2cf574691bf4be46d2158c5dcb6f91f414d8af05"}
Sep 08 14:00:04.969993 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:04.969734    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 14:00:04.994507 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:04.994456    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct" podStartSLOduration=98.994442041 podStartE2EDuration="1m38.994442041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:04.993520359 +0000 UTC m=+100.907425275" watchObservedRunningTime="2026-09-08 14:00:04.994442041 +0000 UTC m=+100.908346954"
Sep 08 14:00:06.206802 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.206764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 14:00:06.209266 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.209238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/395a59cc-68b7-4a12-9c80-a489d5f964d0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bpvbn\" (UID: \"395a59cc-68b7-4a12-9c80-a489d5f964d0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 14:00:06.307713 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.307676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 14:00:06.310192 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.310170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9fe0057-5561-4448-85d6-700f357da9c8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fxpzw\" (UID: \"d9fe0057-5561-4448-85d6-700f357da9c8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 14:00:06.434093 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.434058    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"
Sep 08 14:00:06.546961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.546928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw"
Sep 08 14:00:06.734384 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.734265    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn"]
Sep 08 14:00:06.737257 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:06.737231    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395a59cc_68b7_4a12_9c80_a489d5f964d0.slice/crio-ece7180754602f46a71d622936bed52b71ae1ce785cf92d28271829a84fe0212 WatchSource:0}: Error finding container ece7180754602f46a71d622936bed52b71ae1ce785cf92d28271829a84fe0212: Status 404 returned error can't find the container with id ece7180754602f46a71d622936bed52b71ae1ce785cf92d28271829a84fe0212
Sep 08 14:00:06.838962 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.838926    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fxpzw"]
Sep 08 14:00:06.844504 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:06.844098    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9fe0057_5561_4448_85d6_700f357da9c8.slice/crio-ddfdb54cf807b2213a32845889c7f7c70b40e9b926052022ed3f33281b23d5a0 WatchSource:0}: Error finding container ddfdb54cf807b2213a32845889c7f7c70b40e9b926052022ed3f33281b23d5a0: Status 404 returned error can't find the container with id ddfdb54cf807b2213a32845889c7f7c70b40e9b926052022ed3f33281b23d5a0
Sep 08 14:00:06.980511 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.980468    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn" event={"ID":"395a59cc-68b7-4a12-9c80-a489d5f964d0","Type":"ContainerStarted","Data":"ece7180754602f46a71d622936bed52b71ae1ce785cf92d28271829a84fe0212"}
Sep 08 14:00:06.982417 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:06.982361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw" event={"ID":"d9fe0057-5561-4448-85d6-700f357da9c8","Type":"ContainerStarted","Data":"ddfdb54cf807b2213a32845889c7f7c70b40e9b926052022ed3f33281b23d5a0"}
Sep 08 14:00:11.000657 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.000307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn" event={"ID":"395a59cc-68b7-4a12-9c80-a489d5f964d0","Type":"ContainerStarted","Data":"a068ed0e4e0e63fd461d1353de9b50311e4b9598994497202e2ca7efd21257a1"}
Sep 08 14:00:11.003109 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.003077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw" event={"ID":"d9fe0057-5561-4448-85d6-700f357da9c8","Type":"ContainerStarted","Data":"5825c6a5ba8792135ea31f12de39b048e71597a14cb4ac1965e8b349467de0ee"}
Sep 08 14:00:11.005323 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.005298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lnq9g" event={"ID":"9b9c0f03-800a-418b-8588-72068e616bda","Type":"ContainerStarted","Data":"d68feb42e51412d9ab2df6e5e1a38c3a3635eb7dc433b0eb67f412113db68d34"}
Sep 08 14:00:11.005436 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.005352    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lnq9g" event={"ID":"9b9c0f03-800a-418b-8588-72068e616bda","Type":"ContainerStarted","Data":"2f29389290fc7719e4c033cc3911208069fb52c2410c6e23e48aa7027238d41b"}
Sep 08 14:00:11.005436 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.005413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lnq9g"
Sep 08 14:00:11.007038 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.007015    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n" event={"ID":"8a059952-6cb0-456d-9b03-335d306e4aeb","Type":"ContainerStarted","Data":"884235ba04f189f115d4a279bdc9a3c7b1fde120d367c241b46974c4eb9dabbf"}
Sep 08 14:00:11.032268 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.032212    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bpvbn" podStartSLOduration=33.162915578 podStartE2EDuration="37.032191611s" totalImagesPullingTime="3.869276033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:11.031347998 +0000 UTC m=+106.945252914" watchObservedRunningTime="2026-09-08 14:00:11.032191611 +0000 UTC m=+106.946096526"
Sep 08 14:00:11.051867 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.051773    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5b7f6f48-rng7n" podStartSLOduration=1.913030222 podStartE2EDuration="9.05175718s" totalImagesPullingTime="7.138726958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:11.050702645 +0000 UTC m=+106.964607803" watchObservedRunningTime="2026-09-08 14:00:11.05175718 +0000 UTC m=+106.965662096"
Sep 08 14:00:11.069593 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.069535    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-fxpzw" podStartSLOduration=33.312363129 podStartE2EDuration="37.069514489s" totalImagesPullingTime="3.75715136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:11.067763619 +0000 UTC m=+106.981668537" watchObservedRunningTime="2026-09-08 14:00:11.069514489 +0000 UTC m=+106.983419406"
Sep 08 14:00:11.086903 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.086844    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lnq9g" podStartSLOduration=65.192667847 podStartE2EDuration="1m12.086828127s" totalImagesPullingTime="6.89416028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:11.086109944 +0000 UTC m=+107.000014858" watchObservedRunningTime="2026-09-08 14:00:11.086828127 +0000 UTC m=+107.000733044"
Sep 08 14:00:11.201256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.201216    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"]
Sep 08 14:00:11.204685 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.204646    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"
Sep 08 14:00:11.207671 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.207384    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 14:00:11.207671 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.207451    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sp2s6\""
Sep 08 14:00:11.213566 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.213542    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"]
Sep 08 14:00:11.249835 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.249803    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/144c38ef-23cb-42de-97f3-a3bb329352e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8m2jg\" (UID: \"144c38ef-23cb-42de-97f3-a3bb329352e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"
Sep 08 14:00:11.351106 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.350984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/144c38ef-23cb-42de-97f3-a3bb329352e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8m2jg\" (UID: \"144c38ef-23cb-42de-97f3-a3bb329352e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"
Sep 08 14:00:11.351261 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:00:11.351206    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 14:00:11.351319 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:00:11.351288    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/144c38ef-23cb-42de-97f3-a3bb329352e1-tls-certificates podName:144c38ef-23cb-42de-97f3-a3bb329352e1 nodeName:}" failed. No retries permitted until 2026-09-08 14:00:11.85126707 +0000 UTC m=+107.765171970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/144c38ef-23cb-42de-97f3-a3bb329352e1-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-8m2jg" (UID: "144c38ef-23cb-42de-97f3-a3bb329352e1") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 14:00:11.575601 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.575568    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:11.675913 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.675830    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:11.855210 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.855174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/144c38ef-23cb-42de-97f3-a3bb329352e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8m2jg\" (UID: \"144c38ef-23cb-42de-97f3-a3bb329352e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"
Sep 08 14:00:11.858089 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:11.858062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/144c38ef-23cb-42de-97f3-a3bb329352e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8m2jg\" (UID: \"144c38ef-23cb-42de-97f3-a3bb329352e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"
Sep 08 14:00:12.115780 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.115741    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"
Sep 08 14:00:12.393282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.393206    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"]
Sep 08 14:00:12.396921 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:12.396887    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144c38ef_23cb_42de_97f3_a3bb329352e1.slice/crio-2b17765db009f7b7751612665b9b3d77518733af62edf58e51281e68ac2ebc79 WatchSource:0}: Error finding container 2b17765db009f7b7751612665b9b3d77518733af62edf58e51281e68ac2ebc79: Status 404 returned error can't find the container with id 2b17765db009f7b7751612665b9b3d77518733af62edf58e51281e68ac2ebc79
Sep 08 14:00:12.457539 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.457501    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:12.905039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.905005    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4965c4dd-7jzqg"]
Sep 08 14:00:12.909535 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.909504    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:12.912136 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.912109    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 14:00:12.913074 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.913051    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 14:00:12.913177 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.913085    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 14:00:12.913300 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.913286    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 14:00:12.913360 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.913345    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 14:00:12.913568 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.913545    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6cln7\""
Sep 08 14:00:12.919627 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.919561    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4965c4dd-7jzqg"]
Sep 08 14:00:12.965137 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.965094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-oauth-serving-cert\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:12.965309 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.965147    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-oauth-config\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:12.965309 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.965206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-serving-cert\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:12.965309 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.965273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-config\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:12.965483 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.965321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p4xc\" (UniqueName: \"kubernetes.io/projected/faa777ee-1313-4cc3-8d3b-05c8c93578da-kube-api-access-6p4xc\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:12.965483 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:12.965369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-service-ca\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.024057 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.024011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg" event={"ID":"144c38ef-23cb-42de-97f3-a3bb329352e1","Type":"ContainerStarted","Data":"2b17765db009f7b7751612665b9b3d77518733af62edf58e51281e68ac2ebc79"}
Sep 08 14:00:13.066371 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.066331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p4xc\" (UniqueName: \"kubernetes.io/projected/faa777ee-1313-4cc3-8d3b-05c8c93578da-kube-api-access-6p4xc\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.066581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.066386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-service-ca\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.066581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.066419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-oauth-serving-cert\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.066581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.066433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-oauth-config\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.066581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.066449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-serving-cert\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.066581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.066477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-config\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.067207 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.067175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-oauth-serving-cert\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.067461 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.067260    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-service-ca\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.067517 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.067469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-config\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.069127 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.069104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-oauth-config\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.069211 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.069192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-serving-cert\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.076152 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.076128    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p4xc\" (UniqueName: \"kubernetes.io/projected/faa777ee-1313-4cc3-8d3b-05c8c93578da-kube-api-access-6p4xc\") pod \"console-6f4965c4dd-7jzqg\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") " pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.222663 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.222555    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:13.508047 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:13.507967    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4965c4dd-7jzqg"]
Sep 08 14:00:13.511287 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:13.511250    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa777ee_1313_4cc3_8d3b_05c8c93578da.slice/crio-5a81e77451eea3e65cf8bc0fee09898c4cc3c202fc869033b5ffa11b36f9370e WatchSource:0}: Error finding container 5a81e77451eea3e65cf8bc0fee09898c4cc3c202fc869033b5ffa11b36f9370e: Status 404 returned error can't find the container with id 5a81e77451eea3e65cf8bc0fee09898c4cc3c202fc869033b5ffa11b36f9370e
Sep 08 14:00:14.032511 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:14.032470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4965c4dd-7jzqg" event={"ID":"faa777ee-1313-4cc3-8d3b-05c8c93578da","Type":"ContainerStarted","Data":"5a81e77451eea3e65cf8bc0fee09898c4cc3c202fc869033b5ffa11b36f9370e"}
Sep 08 14:00:15.039183 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.038759    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg" event={"ID":"144c38ef-23cb-42de-97f3-a3bb329352e1","Type":"ContainerStarted","Data":"9b7627590ec362db01e584f99966904de36b4186bb5647703440bf9cdad3f5f8"}
Sep 08 14:00:15.039183 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.039130    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"
Sep 08 14:00:15.045754 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.045725    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg"
Sep 08 14:00:15.057328 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.057262    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8m2jg" podStartSLOduration=1.866468474 podStartE2EDuration="4.057237258s" totalImagesPullingTime="2.190768784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:15.05634122 +0000 UTC m=+110.970246137" watchObservedRunningTime="2026-09-08 14:00:15.057237258 +0000 UTC m=+110.971142175"
Sep 08 14:00:15.234390 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.234350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:15.277236 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.277201    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-h9t75"]
Sep 08 14:00:15.280516 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.280491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.283007 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.282975    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 14:00:15.283007 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.282996    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 14:00:15.283192 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.283023    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 14:00:15.283343 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.283317    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4l8gr\""
Sep 08 14:00:15.289407 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.289077    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-h9t75"]
Sep 08 14:00:15.309269 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.309234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:15.385581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.385538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3806c820-469a-4d2f-b628-3c088fb47d10-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.385788 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.385650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3806c820-469a-4d2f-b628-3c088fb47d10-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.385788 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.385691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3806c820-469a-4d2f-b628-3c088fb47d10-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.385788 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.385768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkxqr\" (UniqueName: \"kubernetes.io/projected/3806c820-469a-4d2f-b628-3c088fb47d10-kube-api-access-wkxqr\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.414410 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.414372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:15.486850 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.486811    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3806c820-469a-4d2f-b628-3c088fb47d10-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.487032 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.486869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3806c820-469a-4d2f-b628-3c088fb47d10-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.487032 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.486905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3806c820-469a-4d2f-b628-3c088fb47d10-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.487032 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.486974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkxqr\" (UniqueName: \"kubernetes.io/projected/3806c820-469a-4d2f-b628-3c088fb47d10-kube-api-access-wkxqr\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.487751 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.487724    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3806c820-469a-4d2f-b628-3c088fb47d10-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.490248 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.490222    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3806c820-469a-4d2f-b628-3c088fb47d10-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.490440 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.490415    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3806c820-469a-4d2f-b628-3c088fb47d10-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.495799 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.495772    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkxqr\" (UniqueName: \"kubernetes.io/projected/3806c820-469a-4d2f-b628-3c088fb47d10-kube-api-access-wkxqr\") pod \"prometheus-operator-6f4946db56-h9t75\" (UID: \"3806c820-469a-4d2f-b628-3c088fb47d10\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.515531 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.515498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:15.592965 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.592886    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75"
Sep 08 14:00:15.879637 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:15.879533    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-h9t75"]
Sep 08 14:00:15.883019 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:15.882982    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3806c820_469a_4d2f_b628_3c088fb47d10.slice/crio-2198b3489ea9521c82368a4fce11d7f3820766a2c6da88c1b40f12620aef9597 WatchSource:0}: Error finding container 2198b3489ea9521c82368a4fce11d7f3820766a2c6da88c1b40f12620aef9597: Status 404 returned error can't find the container with id 2198b3489ea9521c82368a4fce11d7f3820766a2c6da88c1b40f12620aef9597
Sep 08 14:00:16.045126 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:16.045039    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75" event={"ID":"3806c820-469a-4d2f-b628-3c088fb47d10","Type":"ContainerStarted","Data":"2198b3489ea9521c82368a4fce11d7f3820766a2c6da88c1b40f12620aef9597"}
Sep 08 14:00:16.441798 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:16.441751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:18.645503 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:18.645456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:18.746365 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:18.746330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:21.016224 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:21.016190    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lnq9g"
Sep 08 14:00:21.474072 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:21.474036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:21.574145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:21.574076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:24.504223 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:24.504128    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:24.603964 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:24.603929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:25.085259 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.085216    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-xjcd6" event={"ID":"c2996f25-3a2a-45ba-bc6e-08bba47a26ac","Type":"ContainerStarted","Data":"728b1e6565a2570fb1e667712dc5d358708dec4df21bf351c06baf9b6ebe472c"}
Sep 08 14:00:25.085563 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.085416    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-xjcd6"
Sep 08 14:00:25.087671 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.087579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4965c4dd-7jzqg" event={"ID":"faa777ee-1313-4cc3-8d3b-05c8c93578da","Type":"ContainerStarted","Data":"64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2"}
Sep 08 14:00:25.098713 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.098657    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-xjcd6"
Sep 08 14:00:25.106263 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.106181    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-xjcd6" podStartSLOduration=2.131768605 podStartE2EDuration="23.106151131s" totalImagesPullingTime="20.974382526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:25.105561583 +0000 UTC m=+121.019466500" watchObservedRunningTime="2026-09-08 14:00:25.106151131 +0000 UTC m=+121.020056049"
Sep 08 14:00:25.128710 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.128275    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4965c4dd-7jzqg" podStartSLOduration=2.238131035 podStartE2EDuration="13.128256834s" totalImagesPullingTime="10.890125799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:25.127027718 +0000 UTC m=+121.040932635" watchObservedRunningTime="2026-09-08 14:00:25.128256834 +0000 UTC m=+121.042161749"
Sep 08 14:00:25.414717 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.413703    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64784dcfb4-gxkct"]
Sep 08 14:00:25.421479 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.421413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 14:00:25.493470 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.493434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:25.632741 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.632703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:25.692336 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:25.692148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:26.955805 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:26.955718    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:27.030328 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:27.030287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:27.099667 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:27.099599    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75" event={"ID":"3806c820-469a-4d2f-b628-3c088fb47d10","Type":"ContainerStarted","Data":"d56e457fe385d26515ba957c6a5b078b2f8c162ff82f20b05424d9122e1aef30"}
Sep 08 14:00:27.099856 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:27.099703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75" event={"ID":"3806c820-469a-4d2f-b628-3c088fb47d10","Type":"ContainerStarted","Data":"62dba2462d9b6f348b411c4db47da399713d2f5139844eb7a72f88492a534da4"}
Sep 08 14:00:27.116634 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:27.116544    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-h9t75" podStartSLOduration=1.399514493 podStartE2EDuration="12.11651897s" totalImagesPullingTime="10.717004477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:27.116213778 +0000 UTC m=+123.030118693" watchObservedRunningTime="2026-09-08 14:00:27.11651897 +0000 UTC m=+123.030423885"
Sep 08 14:00:28.699113 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.699075    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9lrz2"]
Sep 08 14:00:28.727328 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.727292    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.730214 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.730183    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 14:00:28.730214 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.730210    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 14:00:28.730425 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.730237    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 14:00:28.730425 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.730361    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-phh7g\""
Sep 08 14:00:28.804749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.804706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-tls\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.804935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.804779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66pb4\" (UniqueName: \"kubernetes.io/projected/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-kube-api-access-66pb4\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.804935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.804887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.804935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.804930    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-textfile\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.805103 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.804979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.805103 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.805016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-wtmp\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.805103 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.805087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-metrics-client-ca\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.805238 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.805113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-sys\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.805238 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.805151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-root\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.905766 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.905727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.905956 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.905779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-wtmp\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.905956 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.905832    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-metrics-client-ca\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.905956 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.905849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-sys\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.905956 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.905944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-sys\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.905883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-root\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906003    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-wtmp\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906027    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-root\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-tls\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66pb4\" (UniqueName: \"kubernetes.io/projected/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-kube-api-access-66pb4\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906117    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906167    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-textfile\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906536 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-textfile\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906595 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906541    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-metrics-client-ca\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.906919 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.906892    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.908942 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.908922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-tls\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.909102 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.909080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:28.916648 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:28.916597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66pb4\" (UniqueName: \"kubernetes.io/projected/e3c88e9b-0fe2-44c7-a3da-dbc598cedf11-kube-api-access-66pb4\") pod \"node-exporter-9lrz2\" (UID: \"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11\") " pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:29.038757 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.038710    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9lrz2"
Sep 08 14:00:29.080972 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:29.080938    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c88e9b_0fe2_44c7_a3da_dbc598cedf11.slice/crio-0b6e6dba7330481f657bb7465c6d74b289243af2908233a18f8c66e6be855629 WatchSource:0}: Error finding container 0b6e6dba7330481f657bb7465c6d74b289243af2908233a18f8c66e6be855629: Status 404 returned error can't find the container with id 0b6e6dba7330481f657bb7465c6d74b289243af2908233a18f8c66e6be855629
Sep 08 14:00:29.110154 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.110106    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrz2" event={"ID":"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11","Type":"ContainerStarted","Data":"0b6e6dba7330481f657bb7465c6d74b289243af2908233a18f8c66e6be855629"}
Sep 08 14:00:29.512893 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.512806    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4965c4dd-7jzqg"]
Sep 08 14:00:29.642373 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.640215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:29.745505 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.745462    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:00:29.752369 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.752335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:29.764862 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.764773    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.766739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.766709    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:00:29.768034 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.768004    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 14:00:29.768668 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.768649    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 14:00:29.768879 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.768863    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 14:00:29.769128 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.769113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 14:00:29.769301 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.769286    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 14:00:29.769481 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.769459    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 14:00:29.769777 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.769760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-49bpm\""
Sep 08 14:00:29.769998 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.769979    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 14:00:29.770228 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.770213    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 14:00:29.770540 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.770521    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 14:00:29.821595 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.821534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:29.916423 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-web-config\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6qmx\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-kube-api-access-q6qmx\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916917 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-out\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916917 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916754    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916917 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.916917 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.917092 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.917092 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.916970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.917092 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.917000    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:29.963176 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:29.963131    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:30.017903 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.017809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.017903 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.017854    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.017903 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.017883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.017913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.017954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.017975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-web-config\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.017995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.018022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.018053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6qmx\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-kube-api-access-q6qmx\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.018079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.018109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-out\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018187 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.018150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.018653 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.018198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.019428 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.019219    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.020946 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.020907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.021290 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.021229    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.021401 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.021314    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.021939 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.021654    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.021939 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.021900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.023161 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.023071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.023415 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.023388    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.024066 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.023973    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.024979 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.024937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.025281 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.025252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-web-config\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.026088 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.026060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-out\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.028952 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.028924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6qmx\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-kube-api-access-q6qmx\") pod \"alertmanager-main-0\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.081008 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.080969    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:00:30.149781 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.149582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:30.217895 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.217863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:30.418045 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:30.418005    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:00:30.422702 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:30.422673    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74dad451_09ab_4fa5_93b8_d2ff82d456f4.slice/crio-f938f3f210cce4d1caecf9e7cbe7c79576192ad6f62e84b08281a4d7eb170a94 WatchSource:0}: Error finding container f938f3f210cce4d1caecf9e7cbe7c79576192ad6f62e84b08281a4d7eb170a94: Status 404 returned error can't find the container with id f938f3f210cce4d1caecf9e7cbe7c79576192ad6f62e84b08281a4d7eb170a94
Sep 08 14:00:31.120811 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:31.120764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerStarted","Data":"f938f3f210cce4d1caecf9e7cbe7c79576192ad6f62e84b08281a4d7eb170a94"}
Sep 08 14:00:31.253769 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:31.253733    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:31.319811 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:31.319578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:31.645298 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:31.645257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:31.746957 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:31.746917    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:31.889691 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:31.889658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:32.131073 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:32.131035    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrz2" event={"ID":"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11","Type":"ContainerStarted","Data":"04e09e95e8337d9a4efcf4a4b43b0bb9a42391ed36f50420eb8091e350f39276"}
Sep 08 14:00:32.159964 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:32.159885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:33.138640 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.138590    2559 generic.go:356] "Generic (PLEG): container finished" podID="e3c88e9b-0fe2-44c7-a3da-dbc598cedf11" containerID="04e09e95e8337d9a4efcf4a4b43b0bb9a42391ed36f50420eb8091e350f39276" exitCode=0
Sep 08 14:00:33.139070 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.138650    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrz2" event={"ID":"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11","Type":"ContainerDied","Data":"04e09e95e8337d9a4efcf4a4b43b0bb9a42391ed36f50420eb8091e350f39276"}
Sep 08 14:00:33.139070 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.138701    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrz2" event={"ID":"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11","Type":"ContainerStarted","Data":"596e05ea0303a29fc6889e6ffbfd841c519d3cd2b04c636194c946fbbeb98393"}
Sep 08 14:00:33.139070 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.138727    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrz2" event={"ID":"e3c88e9b-0fe2-44c7-a3da-dbc598cedf11","Type":"ContainerStarted","Data":"6d514e495b4d2e23105d46496ecfafa4c006b9f4277492823573f855b9e57c4c"}
Sep 08 14:00:33.162122 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.162047    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9lrz2" podStartSLOduration=2.272699129 podStartE2EDuration="5.16202732s" totalImagesPullingTime="2.773740354s" totalInitContainerRuntime="115.587837ms" isStatefulPod=true podCreationTimestamp="2026-09-08 14:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:33.160807667 +0000 UTC m=+129.074712621" watchObservedRunningTime="2026-09-08 14:00:33.16202732 +0000 UTC m=+129.075932236"
Sep 08 14:00:33.223055 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.223010    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:33.429544 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.429510    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745dbc8d95-vxpgt"]
Sep 08 14:00:33.450586 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.450478    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745dbc8d95-vxpgt"]
Sep 08 14:00:33.450812 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.450665    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.451487 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.451463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 14:00:33.454568 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.454533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3603e41-2516-4a8f-ba67-862fd59e9dc5-metrics-certs\") pod \"network-metrics-daemon-lf79g\" (UID: \"e3603e41-2516-4a8f-ba67-862fd59e9dc5\") " pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 14:00:33.459242 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.459208    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 14:00:33.552246 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.552206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-serving-cert\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.552246 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.552253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-config\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.552499 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.552292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-oauth-config\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.552499 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.552354    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6q7g\" (UniqueName: \"kubernetes.io/projected/ea6519c2-507e-45c1-82be-54f1e3ca4d82-kube-api-access-m6q7g\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.552499 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.552413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-oauth-serving-cert\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.552499 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.552448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-service-ca\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.552785 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.552514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-trusted-ca-bundle\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.599027 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.598996    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r4t74\""
Sep 08 14:00:33.607338 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.607305    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf79g"
Sep 08 14:00:33.653112 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.653023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-oauth-serving-cert\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.653112 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.653084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-service-ca\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.653112 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.653111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-trusted-ca-bundle\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.653373 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.653143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-serving-cert\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.653373 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.653169    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-config\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.653373 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.653205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-oauth-config\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.653373 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.653242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6q7g\" (UniqueName: \"kubernetes.io/projected/ea6519c2-507e-45c1-82be-54f1e3ca4d82-kube-api-access-m6q7g\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.653999 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.653948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-oauth-serving-cert\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.654256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.654230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-service-ca\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.655182 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.654847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-config\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.655182 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.655096    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-trusted-ca-bundle\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.657960 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.657917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-serving-cert\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.658664 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.658644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-oauth-config\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.663977 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.663930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6q7g\" (UniqueName: \"kubernetes.io/projected/ea6519c2-507e-45c1-82be-54f1e3ca4d82-kube-api-access-m6q7g\") pod \"console-745dbc8d95-vxpgt\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") " pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.777124 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.777080    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:33.923704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:33.923591    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lf79g"]
Sep 08 14:00:33.927977 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:33.927947    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3603e41_2516_4a8f_ba67_862fd59e9dc5.slice/crio-5324e94f5e1967d056c1d7c41dd21406bc8473b2622ed35790eadc2ad95fad57 WatchSource:0}: Error finding container 5324e94f5e1967d056c1d7c41dd21406bc8473b2622ed35790eadc2ad95fad57: Status 404 returned error can't find the container with id 5324e94f5e1967d056c1d7c41dd21406bc8473b2622ed35790eadc2ad95fad57
Sep 08 14:00:34.100484 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:34.100391    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745dbc8d95-vxpgt"]
Sep 08 14:00:34.103469 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:34.103436    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6519c2_507e_45c1_82be_54f1e3ca4d82.slice/crio-0dbc354522de663eec001c9c8d6052af02e96c8d4d1cec82113e86508c6324bb WatchSource:0}: Error finding container 0dbc354522de663eec001c9c8d6052af02e96c8d4d1cec82113e86508c6324bb: Status 404 returned error can't find the container with id 0dbc354522de663eec001c9c8d6052af02e96c8d4d1cec82113e86508c6324bb
Sep 08 14:00:34.147505 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:34.147457    2559 generic.go:356] "Generic (PLEG): container finished" podID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerID="009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367" exitCode=0
Sep 08 14:00:34.147963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:34.147581    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerDied","Data":"009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367"}
Sep 08 14:00:34.149877 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:34.149843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745dbc8d95-vxpgt" event={"ID":"ea6519c2-507e-45c1-82be-54f1e3ca4d82","Type":"ContainerStarted","Data":"0dbc354522de663eec001c9c8d6052af02e96c8d4d1cec82113e86508c6324bb"}
Sep 08 14:00:34.151235 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:34.151196    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf79g" event={"ID":"e3603e41-2516-4a8f-ba67-862fd59e9dc5","Type":"ContainerStarted","Data":"5324e94f5e1967d056c1d7c41dd21406bc8473b2622ed35790eadc2ad95fad57"}
Sep 08 14:00:34.909143 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:34.909102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:35.033422 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:35.033387    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:35.159357 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:35.159272    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745dbc8d95-vxpgt" event={"ID":"ea6519c2-507e-45c1-82be-54f1e3ca4d82","Type":"ContainerStarted","Data":"a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b"}
Sep 08 14:00:35.183559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:35.182787    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745dbc8d95-vxpgt" podStartSLOduration=2.182766543 podStartE2EDuration="2.182766543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:35.181760109 +0000 UTC m=+131.095665038" watchObservedRunningTime="2026-09-08 14:00:35.182766543 +0000 UTC m=+131.096671459"
Sep 08 14:00:36.164496 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:36.164462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf79g" event={"ID":"e3603e41-2516-4a8f-ba67-862fd59e9dc5","Type":"ContainerStarted","Data":"e98e1699f62374fc363660294eaa4268851e1290c2579d17534da8f8cc607d57"}
Sep 08 14:00:36.164961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:36.164515    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf79g" event={"ID":"e3603e41-2516-4a8f-ba67-862fd59e9dc5","Type":"ContainerStarted","Data":"248742f311a722975bb3c81c54dbca5bd5ef80ab3ae47a72dd3f0ff44965d8a4"}
Sep 08 14:00:36.187263 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:36.187195    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lf79g" podStartSLOduration=128.711465656 podStartE2EDuration="2m10.187179797s" totalImagesPullingTime="1.475714141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:36.186024669 +0000 UTC m=+132.099929586" watchObservedRunningTime="2026-09-08 14:00:36.187179797 +0000 UTC m=+132.101084745"
Sep 08 14:00:36.309525 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:36.309481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:36.411112 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:36.411078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:38.633946 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.633906    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745dbc8d95-vxpgt"]
Sep 08 14:00:38.678230 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.678192    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9bd4b9fbb-8dgtm"]
Sep 08 14:00:38.702981 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.702951    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bd4b9fbb-8dgtm"]
Sep 08 14:00:38.703161 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.703067    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.796308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.796279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-oauth-config\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.796427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.796322    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-service-ca\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.796427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.796359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-serving-cert\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.796427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.796380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-trusted-ca-bundle\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.796427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.796398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-config\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.796427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.796415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqc8c\" (UniqueName: \"kubernetes.io/projected/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-kube-api-access-zqc8c\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.796851 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.796484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-oauth-serving-cert\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.897938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.897284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-oauth-serving-cert\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.897938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.897427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-oauth-config\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.897938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.897487    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-service-ca\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.897938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.897535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-serving-cert\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.897938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.897582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-trusted-ca-bundle\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.897938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.897653    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-config\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.897938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.897681    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqc8c\" (UniqueName: \"kubernetes.io/projected/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-kube-api-access-zqc8c\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.898766 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.898736    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-service-ca\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.899071 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.898793    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-config\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.899184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.899142    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-oauth-serving-cert\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.899405 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.899384    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-trusted-ca-bundle\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.900750 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.900727    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-oauth-config\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.901216 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.901192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-serving-cert\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:38.906437 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:38.906408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqc8c\" (UniqueName: \"kubernetes.io/projected/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-kube-api-access-zqc8c\") pod \"console-9bd4b9fbb-8dgtm\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") " pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:39.012558 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:39.012529    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:39.180687 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:39.180653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerStarted","Data":"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a"}
Sep 08 14:00:39.180875 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:39.180722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerStarted","Data":"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff"}
Sep 08 14:00:39.335545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:39.335452    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bd4b9fbb-8dgtm"]
Sep 08 14:00:39.338479 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:00:39.338454    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88aa192d_f9f5_4e2f_ab7b_5e3fc5708653.slice/crio-4b170e80aaafecc90911de630ea1d4a39837f2f08d0110eb98a75861bc191f48 WatchSource:0}: Error finding container 4b170e80aaafecc90911de630ea1d4a39837f2f08d0110eb98a75861bc191f48: Status 404 returned error can't find the container with id 4b170e80aaafecc90911de630ea1d4a39837f2f08d0110eb98a75861bc191f48
Sep 08 14:00:40.188421 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:40.188387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerStarted","Data":"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69"}
Sep 08 14:00:40.188941 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:40.188473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerStarted","Data":"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e"}
Sep 08 14:00:40.188941 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:40.188517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerStarted","Data":"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38"}
Sep 08 14:00:40.190049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:40.190026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bd4b9fbb-8dgtm" event={"ID":"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653","Type":"ContainerStarted","Data":"d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99"}
Sep 08 14:00:40.190121 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:40.190070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bd4b9fbb-8dgtm" event={"ID":"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653","Type":"ContainerStarted","Data":"4b170e80aaafecc90911de630ea1d4a39837f2f08d0110eb98a75861bc191f48"}
Sep 08 14:00:40.212288 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:40.212228    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9bd4b9fbb-8dgtm" podStartSLOduration=2.212211269 podStartE2EDuration="2.212211269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:40.210802869 +0000 UTC m=+136.124707789" watchObservedRunningTime="2026-09-08 14:00:40.212211269 +0000 UTC m=+136.126116185"
Sep 08 14:00:40.429836 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:40.429796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:40.530695 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:40.530663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:41.197247 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:41.197208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerStarted","Data":"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7"}
Sep 08 14:00:41.234476 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:41.234409    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.633477946 podStartE2EDuration="12.234388019s" totalImagesPullingTime="8.571561063s" totalInitContainerRuntime="29.34901ms" isStatefulPod=false podCreationTimestamp="2026-09-08 14:00:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:00:41.233176878 +0000 UTC m=+137.147081794" watchObservedRunningTime="2026-09-08 14:00:41.234388019 +0000 UTC m=+137.148292936"
Sep 08 14:00:42.668217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:42.668177    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:42.736413 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:42.736376    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:43.778049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:43.778011    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:00:48.425901 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:48.425855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:48.492104 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:48.492067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:49.013123 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.012942    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:49.013123 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.013019    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:49.018023 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.018000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:49.235440 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.235409    2559 generic.go:356] "Generic (PLEG): container finished" podID="5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c" containerID="f5a926503653bf3ae4e9861fd668593a6c3132eead21736fd4f1f6bdaf009ff4" exitCode=0
Sep 08 14:00:49.235634 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.235494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk" event={"ID":"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c","Type":"ContainerDied","Data":"f5a926503653bf3ae4e9861fd668593a6c3132eead21736fd4f1f6bdaf009ff4"}
Sep 08 14:00:49.235949 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.235932    2559 scope.go:117] "RemoveContainer" containerID="f5a926503653bf3ae4e9861fd668593a6c3132eead21736fd4f1f6bdaf009ff4"
Sep 08 14:00:49.240416 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.240364    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:00:49.495983 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.495873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:49.595838 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:49.595804    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:50.242591 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.242554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9zsk" event={"ID":"5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c","Type":"ContainerStarted","Data":"2fa63c7d8c69682aad11f9e7b995f0f6426573f636b15bbd90844102f55cc439"}
Sep 08 14:00:50.451294 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.451243    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct" podUID="911db171-cc19-417a-9d12-02e7971a9816" containerName="registry" containerID="cri-o://9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda" gracePeriod=30
Sep 08 14:00:50.701416 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.701389    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 14:00:50.704910 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.704890    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-registry-certificates\") pod \"911db171-cc19-417a-9d12-02e7971a9816\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") "
Sep 08 14:00:50.704975 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.704934    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbf25\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-kube-api-access-mbf25\") pod \"911db171-cc19-417a-9d12-02e7971a9816\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") "
Sep 08 14:00:50.705010 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.704977    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-bound-sa-token\") pod \"911db171-cc19-417a-9d12-02e7971a9816\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") "
Sep 08 14:00:50.705010 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.705001    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/911db171-cc19-417a-9d12-02e7971a9816-ca-trust-extracted\") pod \"911db171-cc19-417a-9d12-02e7971a9816\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") "
Sep 08 14:00:50.705085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.705048    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") pod \"911db171-cc19-417a-9d12-02e7971a9816\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") "
Sep 08 14:00:50.705135 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.705082    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-trusted-ca\") pod \"911db171-cc19-417a-9d12-02e7971a9816\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") "
Sep 08 14:00:50.705135 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.705109    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-image-registry-private-configuration\") pod \"911db171-cc19-417a-9d12-02e7971a9816\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") "
Sep 08 14:00:50.705497 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.705244    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "911db171-cc19-417a-9d12-02e7971a9816" (UID: "911db171-cc19-417a-9d12-02e7971a9816"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:00:50.705497 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.705138    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-installation-pull-secrets\") pod \"911db171-cc19-417a-9d12-02e7971a9816\" (UID: \"911db171-cc19-417a-9d12-02e7971a9816\") "
Sep 08 14:00:50.705694 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.705596    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "911db171-cc19-417a-9d12-02e7971a9816" (UID: "911db171-cc19-417a-9d12-02e7971a9816"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:00:50.706159 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.706138    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-trusted-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:50.706259 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.706166    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/911db171-cc19-417a-9d12-02e7971a9816-registry-certificates\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:50.707797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.707764    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "911db171-cc19-417a-9d12-02e7971a9816" (UID: "911db171-cc19-417a-9d12-02e7971a9816"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:00:50.707909 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.707890    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "911db171-cc19-417a-9d12-02e7971a9816" (UID: "911db171-cc19-417a-9d12-02e7971a9816"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:00:50.707991 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.707890    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-kube-api-access-mbf25" (OuterVolumeSpecName: "kube-api-access-mbf25") pod "911db171-cc19-417a-9d12-02e7971a9816" (UID: "911db171-cc19-417a-9d12-02e7971a9816"). InnerVolumeSpecName "kube-api-access-mbf25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:00:50.708057 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.708038    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "911db171-cc19-417a-9d12-02e7971a9816" (UID: "911db171-cc19-417a-9d12-02e7971a9816"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:00:50.708876 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.708851    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "911db171-cc19-417a-9d12-02e7971a9816" (UID: "911db171-cc19-417a-9d12-02e7971a9816"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:00:50.713849 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.713816    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/911db171-cc19-417a-9d12-02e7971a9816-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "911db171-cc19-417a-9d12-02e7971a9816" (UID: "911db171-cc19-417a-9d12-02e7971a9816"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:00:50.806964 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.806922    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbf25\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-kube-api-access-mbf25\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:50.806964 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.806960    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-bound-sa-token\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:50.806964 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.806970    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/911db171-cc19-417a-9d12-02e7971a9816-ca-trust-extracted\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:50.807199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.806979    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911db171-cc19-417a-9d12-02e7971a9816-registry-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:50.807199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.806988    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-image-registry-private-configuration\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:50.807199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:50.806998    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/911db171-cc19-417a-9d12-02e7971a9816-installation-pull-secrets\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:51.247396 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.247365    2559 generic.go:356] "Generic (PLEG): container finished" podID="911db171-cc19-417a-9d12-02e7971a9816" containerID="9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda" exitCode=0
Sep 08 14:00:51.247628 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.247411    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct"
Sep 08 14:00:51.247628 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.247411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct" event={"ID":"911db171-cc19-417a-9d12-02e7971a9816","Type":"ContainerDied","Data":"9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda"}
Sep 08 14:00:51.247628 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.247541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64784dcfb4-gxkct" event={"ID":"911db171-cc19-417a-9d12-02e7971a9816","Type":"ContainerDied","Data":"c22c5f8d74f57d849dfab50f2cf574691bf4be46d2158c5dcb6f91f414d8af05"}
Sep 08 14:00:51.247628 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.247582    2559 scope.go:117] "RemoveContainer" containerID="9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda"
Sep 08 14:00:51.257565 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.257547    2559 scope.go:117] "RemoveContainer" containerID="9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda"
Sep 08 14:00:51.257993 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:00:51.257973    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda\": container with ID starting with 9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda not found: ID does not exist" containerID="9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda"
Sep 08 14:00:51.258047 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.258004    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda"} err="failed to get container status \"9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda\": rpc error: code = NotFound desc = could not find container \"9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda\": container with ID starting with 9b7022352a0654c75a61e934b21ec3a275f532873dd555b53a893f191c1c7eda not found: ID does not exist"
Sep 08 14:00:51.272094 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.272054    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64784dcfb4-gxkct"]
Sep 08 14:00:51.276407 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:51.276375    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64784dcfb4-gxkct"]
Sep 08 14:00:52.581398 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:52.581359    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="911db171-cc19-417a-9d12-02e7971a9816" path="/var/lib/kubelet/pods/911db171-cc19-417a-9d12-02e7971a9816/volumes"
Sep 08 14:00:54.536953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.536897    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f4965c4dd-7jzqg" podUID="faa777ee-1313-4cc3-8d3b-05c8c93578da" containerName="console" containerID="cri-o://64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2" gracePeriod=15
Sep 08 14:00:54.803508 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.803416    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:54.838950 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.838909    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-service-ca\") pod \"faa777ee-1313-4cc3-8d3b-05c8c93578da\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") "
Sep 08 14:00:54.839139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.838969    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-oauth-config\") pod \"faa777ee-1313-4cc3-8d3b-05c8c93578da\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") "
Sep 08 14:00:54.839139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.838999    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p4xc\" (UniqueName: \"kubernetes.io/projected/faa777ee-1313-4cc3-8d3b-05c8c93578da-kube-api-access-6p4xc\") pod \"faa777ee-1313-4cc3-8d3b-05c8c93578da\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") "
Sep 08 14:00:54.839139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.839025    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-serving-cert\") pod \"faa777ee-1313-4cc3-8d3b-05c8c93578da\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") "
Sep 08 14:00:54.839299 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.839143    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-config\") pod \"faa777ee-1313-4cc3-8d3b-05c8c93578da\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") "
Sep 08 14:00:54.839299 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.839171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-oauth-serving-cert\") pod \"faa777ee-1313-4cc3-8d3b-05c8c93578da\" (UID: \"faa777ee-1313-4cc3-8d3b-05c8c93578da\") "
Sep 08 14:00:54.839413 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.839386    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-service-ca" (OuterVolumeSpecName: "service-ca") pod "faa777ee-1313-4cc3-8d3b-05c8c93578da" (UID: "faa777ee-1313-4cc3-8d3b-05c8c93578da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:00:54.839651 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.839515    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-config" (OuterVolumeSpecName: "console-config") pod "faa777ee-1313-4cc3-8d3b-05c8c93578da" (UID: "faa777ee-1313-4cc3-8d3b-05c8c93578da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:00:54.839788 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.839706    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "faa777ee-1313-4cc3-8d3b-05c8c93578da" (UID: "faa777ee-1313-4cc3-8d3b-05c8c93578da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:00:54.841519 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.841494    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "faa777ee-1313-4cc3-8d3b-05c8c93578da" (UID: "faa777ee-1313-4cc3-8d3b-05c8c93578da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:00:54.841815 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.841795    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faa777ee-1313-4cc3-8d3b-05c8c93578da-kube-api-access-6p4xc" (OuterVolumeSpecName: "kube-api-access-6p4xc") pod "faa777ee-1313-4cc3-8d3b-05c8c93578da" (UID: "faa777ee-1313-4cc3-8d3b-05c8c93578da"). InnerVolumeSpecName "kube-api-access-6p4xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:00:54.841888 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.841819    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "faa777ee-1313-4cc3-8d3b-05c8c93578da" (UID: "faa777ee-1313-4cc3-8d3b-05c8c93578da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:00:54.940281 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.940240    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:54.940281 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.940270    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-oauth-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:54.940281 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.940282    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p4xc\" (UniqueName: \"kubernetes.io/projected/faa777ee-1313-4cc3-8d3b-05c8c93578da-kube-api-access-6p4xc\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:54.940281 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.940291    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-serving-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:54.940541 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.940299    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-console-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:54.940541 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:54.940307    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa777ee-1313-4cc3-8d3b-05c8c93578da-oauth-serving-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:00:55.264656 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.264549    2559 generic.go:356] "Generic (PLEG): container finished" podID="faa777ee-1313-4cc3-8d3b-05c8c93578da" containerID="64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2" exitCode=0
Sep 08 14:00:55.264656 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.264596    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4965c4dd-7jzqg"
Sep 08 14:00:55.264656 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.264604    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4965c4dd-7jzqg" event={"ID":"faa777ee-1313-4cc3-8d3b-05c8c93578da","Type":"ContainerDied","Data":"64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2"}
Sep 08 14:00:55.264898 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.264671    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4965c4dd-7jzqg" event={"ID":"faa777ee-1313-4cc3-8d3b-05c8c93578da","Type":"ContainerDied","Data":"5a81e77451eea3e65cf8bc0fee09898c4cc3c202fc869033b5ffa11b36f9370e"}
Sep 08 14:00:55.264898 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.264693    2559 scope.go:117] "RemoveContainer" containerID="64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2"
Sep 08 14:00:55.284040 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.284015    2559 scope.go:117] "RemoveContainer" containerID="64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2"
Sep 08 14:00:55.284479 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:00:55.284450    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2\": container with ID starting with 64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2 not found: ID does not exist" containerID="64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2"
Sep 08 14:00:55.284589 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.284491    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2"} err="failed to get container status \"64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2\": rpc error: code = NotFound desc = could not find container \"64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2\": container with ID starting with 64afcd94e8b3942f7d5e7e64df634751dcb2f1354878f689ac3c902cc36b2da2 not found: ID does not exist"
Sep 08 14:00:55.285346 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.285328    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4965c4dd-7jzqg"]
Sep 08 14:00:55.288580 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.288555    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4965c4dd-7jzqg"]
Sep 08 14:00:55.568133 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:55.568105    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tzjbr_d2138ffc-17e7-4b73-9337-8b844458af2e/serve-healthcheck-canary/0.log"
Sep 08 14:00:56.581070 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:56.581032    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faa777ee-1313-4cc3-8d3b-05c8c93578da" path="/var/lib/kubelet/pods/faa777ee-1313-4cc3-8d3b-05c8c93578da/volumes"
Sep 08 14:00:56.731987 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:56.731953    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:00:56.811434 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:00:56.811381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:03.430145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:03.430109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:03.654236 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:03.654189    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-745dbc8d95-vxpgt" podUID="ea6519c2-507e-45c1-82be-54f1e3ca4d82" containerName="console" containerID="cri-o://a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b" gracePeriod=15
Sep 08 14:01:03.935252 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:03.935220    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:01:04.012427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.012331    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-oauth-config\") pod \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") "
Sep 08 14:01:04.012427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.012390    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-serving-cert\") pod \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") "
Sep 08 14:01:04.012427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.012427    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6q7g\" (UniqueName: \"kubernetes.io/projected/ea6519c2-507e-45c1-82be-54f1e3ca4d82-kube-api-access-m6q7g\") pod \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") "
Sep 08 14:01:04.012704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.012483    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-service-ca\") pod \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") "
Sep 08 14:01:04.012704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.012537    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-oauth-serving-cert\") pod \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") "
Sep 08 14:01:04.012704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.012658    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-trusted-ca-bundle\") pod \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") "
Sep 08 14:01:04.012845 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.012746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-config\") pod \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\" (UID: \"ea6519c2-507e-45c1-82be-54f1e3ca4d82\") "
Sep 08 14:01:04.013094 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.013029    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea6519c2-507e-45c1-82be-54f1e3ca4d82" (UID: "ea6519c2-507e-45c1-82be-54f1e3ca4d82"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:04.013181 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.013138    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea6519c2-507e-45c1-82be-54f1e3ca4d82" (UID: "ea6519c2-507e-45c1-82be-54f1e3ca4d82"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:04.013291 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.013263    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-config" (OuterVolumeSpecName: "console-config") pod "ea6519c2-507e-45c1-82be-54f1e3ca4d82" (UID: "ea6519c2-507e-45c1-82be-54f1e3ca4d82"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:04.013329 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.013271    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ea6519c2-507e-45c1-82be-54f1e3ca4d82" (UID: "ea6519c2-507e-45c1-82be-54f1e3ca4d82"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:04.014970 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.014949    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6519c2-507e-45c1-82be-54f1e3ca4d82-kube-api-access-m6q7g" (OuterVolumeSpecName: "kube-api-access-m6q7g") pod "ea6519c2-507e-45c1-82be-54f1e3ca4d82" (UID: "ea6519c2-507e-45c1-82be-54f1e3ca4d82"). InnerVolumeSpecName "kube-api-access-m6q7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:01:04.015213 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.015196    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea6519c2-507e-45c1-82be-54f1e3ca4d82" (UID: "ea6519c2-507e-45c1-82be-54f1e3ca4d82"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:04.015277 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.015210    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea6519c2-507e-45c1-82be-54f1e3ca4d82" (UID: "ea6519c2-507e-45c1-82be-54f1e3ca4d82"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:04.113813 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.113773    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-oauth-serving-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:04.113813 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.113807    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-trusted-ca-bundle\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:04.113813 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.113817    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:04.113813 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.113825    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-oauth-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:04.114076 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.113836    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6519c2-507e-45c1-82be-54f1e3ca4d82-console-serving-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:04.114076 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.113845    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6q7g\" (UniqueName: \"kubernetes.io/projected/ea6519c2-507e-45c1-82be-54f1e3ca4d82-kube-api-access-m6q7g\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:04.114076 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.113855    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6519c2-507e-45c1-82be-54f1e3ca4d82-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:04.302879 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.302844    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea6519c2-507e-45c1-82be-54f1e3ca4d82" containerID="a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b" exitCode=0
Sep 08 14:01:04.303060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.302895    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745dbc8d95-vxpgt"
Sep 08 14:01:04.303060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.302899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745dbc8d95-vxpgt" event={"ID":"ea6519c2-507e-45c1-82be-54f1e3ca4d82","Type":"ContainerDied","Data":"a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b"}
Sep 08 14:01:04.303060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.303000    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745dbc8d95-vxpgt" event={"ID":"ea6519c2-507e-45c1-82be-54f1e3ca4d82","Type":"ContainerDied","Data":"0dbc354522de663eec001c9c8d6052af02e96c8d4d1cec82113e86508c6324bb"}
Sep 08 14:01:04.303060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.303020    2559 scope.go:117] "RemoveContainer" containerID="a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b"
Sep 08 14:01:04.316681 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.316654    2559 scope.go:117] "RemoveContainer" containerID="a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b"
Sep 08 14:01:04.317051 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:01:04.317031    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b\": container with ID starting with a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b not found: ID does not exist" containerID="a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b"
Sep 08 14:01:04.317102 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.317060    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b"} err="failed to get container status \"a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b\": rpc error: code = NotFound desc = could not find container \"a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b\": container with ID starting with a162983bc929823f05670e57548f888d60fc595c1bfea1524852f75f60f1959b not found: ID does not exist"
Sep 08 14:01:04.328443 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.328409    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745dbc8d95-vxpgt"]
Sep 08 14:01:04.332651 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.332599    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745dbc8d95-vxpgt"]
Sep 08 14:01:04.453871 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.453837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:04.581734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:04.581656    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea6519c2-507e-45c1-82be-54f1e3ca4d82" path="/var/lib/kubelet/pods/ea6519c2-507e-45c1-82be-54f1e3ca4d82/volumes"
Sep 08 14:01:11.454739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:11.454701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:11.556699 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:11.556661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:11.662470 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:11.662435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:44.826676 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:44.826634    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:44.902387 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:44.902349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:49.113974 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.113932    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:01:49.114464 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.114322    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="alertmanager" containerID="cri-o://814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff" gracePeriod=120
Sep 08 14:01:49.114464 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.114375    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy-metric" containerID="cri-o://aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69" gracePeriod=120
Sep 08 14:01:49.114464 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.114399    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="config-reloader" containerID="cri-o://8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a" gracePeriod=120
Sep 08 14:01:49.114668 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.114441    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="prom-label-proxy" containerID="cri-o://30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7" gracePeriod=120
Sep 08 14:01:49.114668 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.114375    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy-web" containerID="cri-o://04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38" gracePeriod=120
Sep 08 14:01:49.114668 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.114406    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy" containerID="cri-o://43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e" gracePeriod=120
Sep 08 14:01:49.483854 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.483764    2559 generic.go:356] "Generic (PLEG): container finished" podID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerID="30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7" exitCode=0
Sep 08 14:01:49.483854 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.483795    2559 generic.go:356] "Generic (PLEG): container finished" podID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerID="43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e" exitCode=0
Sep 08 14:01:49.483854 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.483801    2559 generic.go:356] "Generic (PLEG): container finished" podID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerID="8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a" exitCode=0
Sep 08 14:01:49.483854 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.483810    2559 generic.go:356] "Generic (PLEG): container finished" podID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerID="814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff" exitCode=0
Sep 08 14:01:49.483854 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.483831    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerDied","Data":"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7"}
Sep 08 14:01:49.484116 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.483922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerDied","Data":"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e"}
Sep 08 14:01:49.484116 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.483950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerDied","Data":"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a"}
Sep 08 14:01:49.484116 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:49.483993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerDied","Data":"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff"}
Sep 08 14:01:50.362466 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.362434    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.483449 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483354    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-web-config\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.483449 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483407    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.483449 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483434    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-trusted-ca-bundle\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.483763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483460    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-volume\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.483763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-main-db\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.483763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483509    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-metrics-client-ca\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.483763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483663    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-main-tls\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.483763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483703    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-cluster-tls-config\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.483763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483739    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.484039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483776    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6qmx\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-kube-api-access-q6qmx\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.484039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483805    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-out\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.484039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483833    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.484039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483878    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-tls-assets\") pod \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\" (UID: \"74dad451-09ab-4fa5-93b8-d2ff82d456f4\") "
Sep 08 14:01:50.484039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483885    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:50.484039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483905    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:01:50.484039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.483897    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:01:50.484370 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.484161    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.484370 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.484183    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-alertmanager-main-db\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.484370 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.484197    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74dad451-09ab-4fa5-93b8-d2ff82d456f4-metrics-client-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.487146 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.487097    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-volume" (OuterVolumeSpecName: "config-volume") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:50.487622 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.487467    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-out" (OuterVolumeSpecName: "config-out") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:01:50.487733 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.487671    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:50.488729 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.488701    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-kube-api-access-q6qmx" (OuterVolumeSpecName: "kube-api-access-q6qmx") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "kube-api-access-q6qmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:01:50.488838 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.488700    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:50.489081 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.489050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:01:50.489316 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.489284    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:50.489316 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.489303    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:50.492625 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.492456    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:50.494783 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.494752    2559 generic.go:356] "Generic (PLEG): container finished" podID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerID="aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69" exitCode=0
Sep 08 14:01:50.494783 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.494781    2559 generic.go:356] "Generic (PLEG): container finished" podID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerID="04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38" exitCode=0
Sep 08 14:01:50.494922 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.494876    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.494922 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.494876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerDied","Data":"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69"}
Sep 08 14:01:50.494997 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.494979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerDied","Data":"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38"}
Sep 08 14:01:50.495039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.495027    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74dad451-09ab-4fa5-93b8-d2ff82d456f4","Type":"ContainerDied","Data":"f938f3f210cce4d1caecf9e7cbe7c79576192ad6f62e84b08281a4d7eb170a94"}
Sep 08 14:01:50.495079 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.495046    2559 scope.go:117] "RemoveContainer" containerID="30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7"
Sep 08 14:01:50.500042 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.500012    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-web-config" (OuterVolumeSpecName: "web-config") pod "74dad451-09ab-4fa5-93b8-d2ff82d456f4" (UID: "74dad451-09ab-4fa5-93b8-d2ff82d456f4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:01:50.503175 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.503152    2559 scope.go:117] "RemoveContainer" containerID="aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69"
Sep 08 14:01:50.511028 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.511004    2559 scope.go:117] "RemoveContainer" containerID="43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e"
Sep 08 14:01:50.518471 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.518449    2559 scope.go:117] "RemoveContainer" containerID="04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38"
Sep 08 14:01:50.526091 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.526070    2559 scope.go:117] "RemoveContainer" containerID="8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a"
Sep 08 14:01:50.533905 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.533885    2559 scope.go:117] "RemoveContainer" containerID="814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff"
Sep 08 14:01:50.541842 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.541821    2559 scope.go:117] "RemoveContainer" containerID="009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367"
Sep 08 14:01:50.549886 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.549861    2559 scope.go:117] "RemoveContainer" containerID="30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7"
Sep 08 14:01:50.550246 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:01:50.550225    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7\": container with ID starting with 30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7 not found: ID does not exist" containerID="30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7"
Sep 08 14:01:50.550310 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.550258    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7"} err="failed to get container status \"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7\": rpc error: code = NotFound desc = could not find container \"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7\": container with ID starting with 30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7 not found: ID does not exist"
Sep 08 14:01:50.550310 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.550280    2559 scope.go:117] "RemoveContainer" containerID="aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69"
Sep 08 14:01:50.550656 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:01:50.550636    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69\": container with ID starting with aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69 not found: ID does not exist" containerID="aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69"
Sep 08 14:01:50.550719 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.550662    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69"} err="failed to get container status \"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69\": rpc error: code = NotFound desc = could not find container \"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69\": container with ID starting with aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69 not found: ID does not exist"
Sep 08 14:01:50.550719 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.550679    2559 scope.go:117] "RemoveContainer" containerID="43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e"
Sep 08 14:01:50.550940 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:01:50.550922    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e\": container with ID starting with 43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e not found: ID does not exist" containerID="43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e"
Sep 08 14:01:50.550977 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.550946    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e"} err="failed to get container status \"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e\": rpc error: code = NotFound desc = could not find container \"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e\": container with ID starting with 43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e not found: ID does not exist"
Sep 08 14:01:50.550977 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.550961    2559 scope.go:117] "RemoveContainer" containerID="04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38"
Sep 08 14:01:50.551220 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:01:50.551203    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38\": container with ID starting with 04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38 not found: ID does not exist" containerID="04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38"
Sep 08 14:01:50.551285 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.551225    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38"} err="failed to get container status \"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38\": rpc error: code = NotFound desc = could not find container \"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38\": container with ID starting with 04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38 not found: ID does not exist"
Sep 08 14:01:50.551285 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.551238    2559 scope.go:117] "RemoveContainer" containerID="8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a"
Sep 08 14:01:50.551472 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:01:50.551456    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a\": container with ID starting with 8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a not found: ID does not exist" containerID="8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a"
Sep 08 14:01:50.551514 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.551486    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a"} err="failed to get container status \"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a\": rpc error: code = NotFound desc = could not find container \"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a\": container with ID starting with 8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a not found: ID does not exist"
Sep 08 14:01:50.551514 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.551500    2559 scope.go:117] "RemoveContainer" containerID="814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff"
Sep 08 14:01:50.551757 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:01:50.551743    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff\": container with ID starting with 814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff not found: ID does not exist" containerID="814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff"
Sep 08 14:01:50.551801 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.551761    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff"} err="failed to get container status \"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff\": rpc error: code = NotFound desc = could not find container \"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff\": container with ID starting with 814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff not found: ID does not exist"
Sep 08 14:01:50.551801 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.551772    2559 scope.go:117] "RemoveContainer" containerID="009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367"
Sep 08 14:01:50.551997 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:01:50.551981    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367\": container with ID starting with 009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367 not found: ID does not exist" containerID="009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367"
Sep 08 14:01:50.552042 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.552001    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367"} err="failed to get container status \"009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367\": rpc error: code = NotFound desc = could not find container \"009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367\": container with ID starting with 009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367 not found: ID does not exist"
Sep 08 14:01:50.552042 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.552014    2559 scope.go:117] "RemoveContainer" containerID="30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7"
Sep 08 14:01:50.552265 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.552248    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7"} err="failed to get container status \"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7\": rpc error: code = NotFound desc = could not find container \"30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7\": container with ID starting with 30ca67cef2ce9d3d716719ea3fe91fbca9058455dcac746c28113a97967a2ed7 not found: ID does not exist"
Sep 08 14:01:50.552334 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.552265    2559 scope.go:117] "RemoveContainer" containerID="aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69"
Sep 08 14:01:50.552544 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.552525    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69"} err="failed to get container status \"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69\": rpc error: code = NotFound desc = could not find container \"aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69\": container with ID starting with aeb1b35b317d189b06923eb9c968a1a456c555623a47624a9f9616e0a34def69 not found: ID does not exist"
Sep 08 14:01:50.552598 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.552544    2559 scope.go:117] "RemoveContainer" containerID="43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e"
Sep 08 14:01:50.552793 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.552778    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e"} err="failed to get container status \"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e\": rpc error: code = NotFound desc = could not find container \"43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e\": container with ID starting with 43938fad1f794a6d6b4423d9cb22882c1a5472b3e7be7909227034cf9458ec7e not found: ID does not exist"
Sep 08 14:01:50.552833 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.552793    2559 scope.go:117] "RemoveContainer" containerID="04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38"
Sep 08 14:01:50.553040 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.553021    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38"} err="failed to get container status \"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38\": rpc error: code = NotFound desc = could not find container \"04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38\": container with ID starting with 04bac4f48439d861690a6c0f876914da8de430fc9cbee09e3c8775db10846d38 not found: ID does not exist"
Sep 08 14:01:50.553085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.553041    2559 scope.go:117] "RemoveContainer" containerID="8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a"
Sep 08 14:01:50.553269 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.553253    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a"} err="failed to get container status \"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a\": rpc error: code = NotFound desc = could not find container \"8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a\": container with ID starting with 8e61d1499554997f951f6230ea716ce8c172fda9421dac49fe1105ad74382b1a not found: ID does not exist"
Sep 08 14:01:50.553269 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.553268    2559 scope.go:117] "RemoveContainer" containerID="814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff"
Sep 08 14:01:50.553498 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.553481    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff"} err="failed to get container status \"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff\": rpc error: code = NotFound desc = could not find container \"814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff\": container with ID starting with 814d41461feabca5320760e8e5e09f9bebc3db4540dde4d624d5ae1828b8e7ff not found: ID does not exist"
Sep 08 14:01:50.553498 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.553497    2559 scope.go:117] "RemoveContainer" containerID="009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367"
Sep 08 14:01:50.553752 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.553735    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367"} err="failed to get container status \"009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367\": rpc error: code = NotFound desc = could not find container \"009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367\": container with ID starting with 009aa4ce29281d62c377ae1db4d30bfc4b52f49209144edfa73a0fadb7c1a367 not found: ID does not exist"
Sep 08 14:01:50.585301 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585260    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-tls-assets\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585301 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585298    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-web-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585315    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585330    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585347    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-main-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585363    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-cluster-tls-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585377    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585392    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6qmx\" (UniqueName: \"kubernetes.io/projected/74dad451-09ab-4fa5-93b8-d2ff82d456f4-kube-api-access-q6qmx\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585405    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74dad451-09ab-4fa5-93b8-d2ff82d456f4-config-out\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.585453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.585420    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74dad451-09ab-4fa5-93b8-d2ff82d456f4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:01:50.813176 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.813108    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:01:50.819543 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.819514    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:01:50.848036 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.847999    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:01:50.848291 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848279    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faa777ee-1313-4cc3-8d3b-05c8c93578da" containerName="console"
Sep 08 14:01:50.848344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848294    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="faa777ee-1313-4cc3-8d3b-05c8c93578da" containerName="console"
Sep 08 14:01:50.848344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848303    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6519c2-507e-45c1-82be-54f1e3ca4d82" containerName="console"
Sep 08 14:01:50.848344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848311    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6519c2-507e-45c1-82be-54f1e3ca4d82" containerName="console"
Sep 08 14:01:50.848344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848318    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy-metric"
Sep 08 14:01:50.848344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848323    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy-metric"
Sep 08 14:01:50.848344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848339    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy-web"
Sep 08 14:01:50.848344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848344    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy-web"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848350    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="alertmanager"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848355    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="alertmanager"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848361    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="init-config-reloader"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848366    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="init-config-reloader"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848372    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="config-reloader"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848376    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="config-reloader"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848382    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="911db171-cc19-417a-9d12-02e7971a9816" containerName="registry"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848387    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="911db171-cc19-417a-9d12-02e7971a9816" containerName="registry"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848392    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848397    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848406    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="prom-label-proxy"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848411    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="prom-label-proxy"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848448    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy-web"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848455    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848462    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea6519c2-507e-45c1-82be-54f1e3ca4d82" containerName="console"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848467    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="kube-rbac-proxy-metric"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848473    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="911db171-cc19-417a-9d12-02e7971a9816" containerName="registry"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848477    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="alertmanager"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848483    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="config-reloader"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848489    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" containerName="prom-label-proxy"
Sep 08 14:01:50.848545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.848494    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="faa777ee-1313-4cc3-8d3b-05c8c93578da" containerName="console"
Sep 08 14:01:50.855887 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.855858    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.858909    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.858922    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-49bpm\""
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.858913    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.858960    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.858926    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.858909    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.858962    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.859042    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 14:01:50.859099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.858913    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 14:01:50.864767 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.864573    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 14:01:50.867226 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.867204    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:01:50.988994 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.988943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9jx7\" (UniqueName: \"kubernetes.io/projected/62f0df48-c611-467d-aef1-41232d4049ad-kube-api-access-d9jx7\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.988994 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.988994    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62f0df48-c611-467d-aef1-41232d4049ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989244 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-web-config\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989244 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989083    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989244 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989244 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989139    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f0df48-c611-467d-aef1-41232d4049ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989244 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989244 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62f0df48-c611-467d-aef1-41232d4049ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989244 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62f0df48-c611-467d-aef1-41232d4049ad-config-out\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f0df48-c611-467d-aef1-41232d4049ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:50.989512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:50.989310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095067 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.094967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095067 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095067 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f0df48-c611-467d-aef1-41232d4049ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095347 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095347 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62f0df48-c611-467d-aef1-41232d4049ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095347 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095347 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62f0df48-c611-467d-aef1-41232d4049ad-config-out\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095347 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f0df48-c611-467d-aef1-41232d4049ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095347 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095701 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095701 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9jx7\" (UniqueName: \"kubernetes.io/projected/62f0df48-c611-467d-aef1-41232d4049ad-kube-api-access-d9jx7\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095701 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62f0df48-c611-467d-aef1-41232d4049ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095701 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-web-config\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.095701 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.095508    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62f0df48-c611-467d-aef1-41232d4049ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.096681 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.096653    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f0df48-c611-467d-aef1-41232d4049ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.098592 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.098247    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.098592 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.098431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.098592 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.098513    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-web-config\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.098854 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.098716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.098922 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.098900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.099126 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.099098    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f0df48-c611-467d-aef1-41232d4049ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.099580 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.099552    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.099580 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.099566    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62f0df48-c611-467d-aef1-41232d4049ad-config-out\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.100015 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.099980    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62f0df48-c611-467d-aef1-41232d4049ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.100667 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.100649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62f0df48-c611-467d-aef1-41232d4049ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.104441 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.104416    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9jx7\" (UniqueName: \"kubernetes.io/projected/62f0df48-c611-467d-aef1-41232d4049ad-kube-api-access-d9jx7\") pod \"alertmanager-main-0\" (UID: \"62f0df48-c611-467d-aef1-41232d4049ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.167559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.167521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:01:51.454233 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.454140    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:01:51.458431 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:01:51.458389    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f0df48_c611_467d_aef1_41232d4049ad.slice/crio-cc44ba5965a4dfcf8b27541b4d726729f41761544f60ea2755ab6737ceb397ec WatchSource:0}: Error finding container cc44ba5965a4dfcf8b27541b4d726729f41761544f60ea2755ab6737ceb397ec: Status 404 returned error can't find the container with id cc44ba5965a4dfcf8b27541b4d726729f41761544f60ea2755ab6737ceb397ec
Sep 08 14:01:51.500224 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:51.500190    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62f0df48-c611-467d-aef1-41232d4049ad","Type":"ContainerStarted","Data":"cc44ba5965a4dfcf8b27541b4d726729f41761544f60ea2755ab6737ceb397ec"}
Sep 08 14:01:52.507390 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:52.507302    2559 generic.go:356] "Generic (PLEG): container finished" podID="62f0df48-c611-467d-aef1-41232d4049ad" containerID="21081b1f9ebeee607885c55ee005fd62e34746cae653f08325eff38d1118f69e" exitCode=0
Sep 08 14:01:52.507390 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:52.507375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62f0df48-c611-467d-aef1-41232d4049ad","Type":"ContainerDied","Data":"21081b1f9ebeee607885c55ee005fd62e34746cae653f08325eff38d1118f69e"}
Sep 08 14:01:52.580349 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:52.580318    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74dad451-09ab-4fa5-93b8-d2ff82d456f4" path="/var/lib/kubelet/pods/74dad451-09ab-4fa5-93b8-d2ff82d456f4/volumes"
Sep 08 14:01:53.516911 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:53.516870    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62f0df48-c611-467d-aef1-41232d4049ad","Type":"ContainerStarted","Data":"74a982f93c108daf407baff2f258fadc87edde4193e25304b610c841a32102a2"}
Sep 08 14:01:53.517282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:53.516937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62f0df48-c611-467d-aef1-41232d4049ad","Type":"ContainerStarted","Data":"ed5d4eff0145bd71c18efcb412b83d8b1732d9bef977649d9876d8f867f70626"}
Sep 08 14:01:53.517282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:53.516963    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62f0df48-c611-467d-aef1-41232d4049ad","Type":"ContainerStarted","Data":"e0796bdd6f00c0a311de28e4728dc2cd8b6fac5c38694f3b940018c75af3d9a5"}
Sep 08 14:01:53.517282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:53.516993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62f0df48-c611-467d-aef1-41232d4049ad","Type":"ContainerStarted","Data":"a6e5d6922de7baa3e9100089a0e6389b62cc77044d703010fb62dc891dd6225c"}
Sep 08 14:01:53.517282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:53.517018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62f0df48-c611-467d-aef1-41232d4049ad","Type":"ContainerStarted","Data":"76ebb6b055d19c2ed38c32cd5c097495aeb7fa922e7db99640ced8feee5405dd"}
Sep 08 14:01:53.517282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:53.517042    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62f0df48-c611-467d-aef1-41232d4049ad","Type":"ContainerStarted","Data":"b4abf96cb0c3d5be021caf16decb4c3662db4470d468975a3238d7ae446669bb"}
Sep 08 14:01:53.544550 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:53.544493    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.5278008290000002 podStartE2EDuration="3.544471811s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.670982ms" isStatefulPod=false podCreationTimestamp="2026-09-08 14:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:01:53.543512874 +0000 UTC m=+209.457417827" watchObservedRunningTime="2026-09-08 14:01:53.544471811 +0000 UTC m=+209.458376727"
Sep 08 14:01:56.744150 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.744073    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8d899f97d-z7q2z"]
Sep 08 14:01:56.747421 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.747395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:56.759325 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.759296    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d899f97d-z7q2z"]
Sep 08 14:01:56.840002 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.839968    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:56.901498 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.901461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:01:56.939680 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.939645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-service-ca\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:56.939808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.939701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rzk\" (UniqueName: \"kubernetes.io/projected/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-kube-api-access-c9rzk\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:56.939808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.939774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-serving-cert\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:56.939889 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.939804    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-config\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:56.939889 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.939823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-trusted-ca-bundle\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:56.939889 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.939844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-oauth-config\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:56.939989 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:56.939892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-oauth-serving-cert\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-serving-cert\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041249 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-config\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041249 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-trusted-ca-bundle\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041249 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-oauth-config\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041249 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-oauth-serving-cert\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041249 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-service-ca\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041507 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rzk\" (UniqueName: \"kubernetes.io/projected/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-kube-api-access-c9rzk\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041878 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-config\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041980 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-service-ca\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.041980 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.041904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-oauth-serving-cert\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.042643 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.042597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-trusted-ca-bundle\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.043780 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.043756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-oauth-config\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.043898 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.043883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-serving-cert\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.054794 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.054762    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rzk\" (UniqueName: \"kubernetes.io/projected/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-kube-api-access-c9rzk\") pod \"console-8d899f97d-z7q2z\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") " pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.057589 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.057560    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:01:57.331066 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.330960    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d899f97d-z7q2z"]
Sep 08 14:01:57.334430 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:01:57.334395    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e1fd83_c671_4852_92c1_f4f3fb1b8035.slice/crio-328d6524c052d6676f94f034f86be94504c068a7d0ca11c8e569ba62ab485ac2 WatchSource:0}: Error finding container 328d6524c052d6676f94f034f86be94504c068a7d0ca11c8e569ba62ab485ac2: Status 404 returned error can't find the container with id 328d6524c052d6676f94f034f86be94504c068a7d0ca11c8e569ba62ab485ac2
Sep 08 14:01:57.534434 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.534390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d899f97d-z7q2z" event={"ID":"e8e1fd83-c671-4852-92c1-f4f3fb1b8035","Type":"ContainerStarted","Data":"3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f"}
Sep 08 14:01:57.534638 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.534457    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d899f97d-z7q2z" event={"ID":"e8e1fd83-c671-4852-92c1-f4f3fb1b8035","Type":"ContainerStarted","Data":"328d6524c052d6676f94f034f86be94504c068a7d0ca11c8e569ba62ab485ac2"}
Sep 08 14:01:57.551692 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:01:57.551568    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8d899f97d-z7q2z" podStartSLOduration=1.551549313 podStartE2EDuration="1.551549313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:01:57.551291772 +0000 UTC m=+213.465196688" watchObservedRunningTime="2026-09-08 14:01:57.551549313 +0000 UTC m=+213.465454230"
Sep 08 14:02:03.434068 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:03.434021    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:03.534671 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:03.534622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:07.058175 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:07.058120    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:02:07.058569 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:07.058212    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:02:07.063095 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:07.063064    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:02:07.577065 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:07.577030    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:02:07.624189 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:07.624158    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9bd4b9fbb-8dgtm"]
Sep 08 14:02:07.732278 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:07.732246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:07.793691 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:07.793652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:07.861168 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:07.861085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:25.686318 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:25.686279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:25.786856 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:25.786824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:32.646651 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:32.646582    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9bd4b9fbb-8dgtm" podUID="88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" containerName="console" containerID="cri-o://d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99" gracePeriod=15
Sep 08 14:02:32.884768 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:32.884743    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:02:33.007484 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007387    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqc8c\" (UniqueName: \"kubernetes.io/projected/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-kube-api-access-zqc8c\") pod \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") "
Sep 08 14:02:33.007484 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007432    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-trusted-ca-bundle\") pod \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") "
Sep 08 14:02:33.007484 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007481    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-service-ca\") pod \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") "
Sep 08 14:02:33.007808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007577    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-config\") pod \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") "
Sep 08 14:02:33.007808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007662    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-serving-cert\") pod \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") "
Sep 08 14:02:33.007808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007689    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-oauth-config\") pod \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") "
Sep 08 14:02:33.007808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007724    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-oauth-serving-cert\") pod \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\" (UID: \"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653\") "
Sep 08 14:02:33.008010 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007893    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-service-ca" (OuterVolumeSpecName: "service-ca") pod "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" (UID: "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:02:33.008010 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007905    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" (UID: "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:02:33.008010 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.007936    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-config" (OuterVolumeSpecName: "console-config") pod "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" (UID: "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:02:33.008154 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.008113    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:33.008154 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.008132    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:33.008154 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.008144    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-trusted-ca-bundle\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:33.008463 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.008180    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" (UID: "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:02:33.009871 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.009837    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-kube-api-access-zqc8c" (OuterVolumeSpecName: "kube-api-access-zqc8c") pod "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" (UID: "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653"). InnerVolumeSpecName "kube-api-access-zqc8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:02:33.009980 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.009896    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" (UID: "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:02:33.009980 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.009928    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" (UID: "88aa192d-f9f5-4e2f-ab7b-5e3fc5708653"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:02:33.108808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.108757    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-serving-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:33.108808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.108800    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-console-oauth-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:33.108808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.108811    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-oauth-serving-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:33.108808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.108819    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqc8c\" (UniqueName: \"kubernetes.io/projected/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653-kube-api-access-zqc8c\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:33.672067 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.672034    2559 generic.go:356] "Generic (PLEG): container finished" podID="88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" containerID="d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99" exitCode=0
Sep 08 14:02:33.672443 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.672080    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bd4b9fbb-8dgtm"
Sep 08 14:02:33.672443 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.672109    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bd4b9fbb-8dgtm" event={"ID":"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653","Type":"ContainerDied","Data":"d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99"}
Sep 08 14:02:33.672443 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.672151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bd4b9fbb-8dgtm" event={"ID":"88aa192d-f9f5-4e2f-ab7b-5e3fc5708653","Type":"ContainerDied","Data":"4b170e80aaafecc90911de630ea1d4a39837f2f08d0110eb98a75861bc191f48"}
Sep 08 14:02:33.672443 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.672173    2559 scope.go:117] "RemoveContainer" containerID="d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99"
Sep 08 14:02:33.680848 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.680831    2559 scope.go:117] "RemoveContainer" containerID="d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99"
Sep 08 14:02:33.681145 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:02:33.681128    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99\": container with ID starting with d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99 not found: ID does not exist" containerID="d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99"
Sep 08 14:02:33.681182 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.681156    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99"} err="failed to get container status \"d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99\": rpc error: code = NotFound desc = could not find container \"d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99\": container with ID starting with d975e1b8a878d62a08d4bd0e651a314d8a4b3e7aac3d0c818a6c3ca4b4262e99 not found: ID does not exist"
Sep 08 14:02:33.693013 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.692985    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9bd4b9fbb-8dgtm"]
Sep 08 14:02:33.698095 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:33.698074    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9bd4b9fbb-8dgtm"]
Sep 08 14:02:34.580545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:34.580511    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" path="/var/lib/kubelet/pods/88aa192d-f9f5-4e2f-ab7b-5e3fc5708653/volumes"
Sep 08 14:02:36.746150 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:36.746111    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:36.883824 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:36.883788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:37.016514 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.016423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:37.858491 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.858452    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"]
Sep 08 14:02:37.858892 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.858849    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" containerName="console"
Sep 08 14:02:37.858892 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.858864    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" containerName="console"
Sep 08 14:02:37.858961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.858915    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="88aa192d-f9f5-4e2f-ab7b-5e3fc5708653" containerName="console"
Sep 08 14:02:37.863159 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.863141    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"]
Sep 08 14:02:37.863295 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.863273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:37.866179 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.866139    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:02:37.866291 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.866273    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:02:37.866393 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.866380    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hd7f\""
Sep 08 14:02:37.866808 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.866790    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:37.877097 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.877076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"]
Sep 08 14:02:37.878899 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.878877    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"]
Sep 08 14:02:37.945782 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.945738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:37.945963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.945802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7hmd\" (UniqueName: \"kubernetes.io/projected/ec2b4dd5-1658-49b0-8fc1-646a685b438c-kube-api-access-z7hmd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:37.945963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.945899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:37.946104 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.945970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn5b8\" (UniqueName: \"kubernetes.io/projected/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-kube-api-access-fn5b8\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:37.946104 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.946018    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:37.946104 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:37.946042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:38.047119 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:38.047119 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:38.047329 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:38.047329 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7hmd\" (UniqueName: \"kubernetes.io/projected/ec2b4dd5-1658-49b0-8fc1-646a685b438c-kube-api-access-z7hmd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:38.047401 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:38.047401 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn5b8\" (UniqueName: \"kubernetes.io/projected/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-kube-api-access-fn5b8\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:38.047536 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047514    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:38.047573 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047529    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:38.047573 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047557    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:38.047698 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.047682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:38.056050 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.056018    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn5b8\" (UniqueName: \"kubernetes.io/projected/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-kube-api-access-fn5b8\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:38.056164 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.056075    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7hmd\" (UniqueName: \"kubernetes.io/projected/ec2b4dd5-1658-49b0-8fc1-646a685b438c-kube-api-access-z7hmd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:38.174408 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.174329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:38.179925 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.179900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:38.261124 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.261090    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"]
Sep 08 14:02:38.266463 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.266439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.269287 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.269246    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h8hnm\""
Sep 08 14:02:38.269715 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.269235    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 14:02:38.269715 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.269574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 14:02:38.270228 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.270085    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 14:02:38.270228 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.270161    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 14:02:38.270228 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.270182    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 14:02:38.270651 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.270394    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 14:02:38.275543 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.275216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"]
Sep 08 14:02:38.351054 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.351021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.351054 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.351056    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.351321 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.351077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.351321 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.351133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.351321 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.351206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdmvk\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-kube-api-access-bdmvk\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.351321 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.351261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e55e9-4e11-4094-b707-7ddb079711c3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.351321 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.351286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.386987 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.386946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:38.449854 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.449719    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"]
Sep 08 14:02:38.452085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.451694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.452085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.451736    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.452085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.451769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.452085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.451806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.452085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.451867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdmvk\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-kube-api-access-bdmvk\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.452085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.451935    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e55e9-4e11-4094-b707-7ddb079711c3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.452085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.451960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.452475 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:02:38.452185    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89a1cdc_553b_4089_9e71_ffc1f0a0ba42.slice/crio-b9a364faaf24859c9e92925f9dd602044de83c5fcc4fbf7d3b7393b1aeecd6dc WatchSource:0}: Error finding container b9a364faaf24859c9e92925f9dd602044de83c5fcc4fbf7d3b7393b1aeecd6dc: Status 404 returned error can't find the container with id b9a364faaf24859c9e92925f9dd602044de83c5fcc4fbf7d3b7393b1aeecd6dc
Sep 08 14:02:38.452475 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.452310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:38.452776 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.452750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.455129 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.455102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e55e9-4e11-4094-b707-7ddb079711c3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.455308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.455283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.455308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.455300    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.455490 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.455445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.462139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.462117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdmvk\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-kube-api-access-bdmvk\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.462218 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.462162    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5wwfx\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.469113 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.469091    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"]
Sep 08 14:02:38.471889 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:02:38.471866    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2b4dd5_1658_49b0_8fc1_646a685b438c.slice/crio-b4f30f61e572574b6b2ae32fea0d38a86fb406f08d3adfdbdb77dd995f78fe2a WatchSource:0}: Error finding container b4f30f61e572574b6b2ae32fea0d38a86fb406f08d3adfdbdb77dd995f78fe2a: Status 404 returned error can't find the container with id b4f30f61e572574b6b2ae32fea0d38a86fb406f08d3adfdbdb77dd995f78fe2a
Sep 08 14:02:38.577737 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.577698    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:38.692958 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.692923    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d" event={"ID":"ec2b4dd5-1658-49b0-8fc1-646a685b438c","Type":"ContainerStarted","Data":"b4f30f61e572574b6b2ae32fea0d38a86fb406f08d3adfdbdb77dd995f78fe2a"}
Sep 08 14:02:38.694133 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.694107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794" event={"ID":"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42","Type":"ContainerStarted","Data":"b9a364faaf24859c9e92925f9dd602044de83c5fcc4fbf7d3b7393b1aeecd6dc"}
Sep 08 14:02:38.854649 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:38.854502    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"]
Sep 08 14:02:38.857576 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:02:38.857543    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2e55e9_4e11_4094_b707_7ddb079711c3.slice/crio-47e894e165c5581b338378a4754ab99d38b0c7fe3c708ae44f5e55a1540a9dfc WatchSource:0}: Error finding container 47e894e165c5581b338378a4754ab99d38b0c7fe3c708ae44f5e55a1540a9dfc: Status 404 returned error can't find the container with id 47e894e165c5581b338378a4754ab99d38b0c7fe3c708ae44f5e55a1540a9dfc
Sep 08 14:02:39.355944 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:39.355792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:39.699810 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:39.699716    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx" event={"ID":"4d2e55e9-4e11-4094-b707-7ddb079711c3","Type":"ContainerStarted","Data":"47e894e165c5581b338378a4754ab99d38b0c7fe3c708ae44f5e55a1540a9dfc"}
Sep 08 14:02:42.039418 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:42.039367    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:02:42.039775 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:42.039465    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:02:42.718016 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:42.717970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx" event={"ID":"4d2e55e9-4e11-4094-b707-7ddb079711c3","Type":"ContainerStarted","Data":"5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac"}
Sep 08 14:02:42.718288 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:42.718120    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:42.742947 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:42.742879    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx" podStartSLOduration=1.564252637 podStartE2EDuration="4.742855013s" totalImagesPullingTime="3.178602376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:02:42.740129996 +0000 UTC m=+258.654034912" watchObservedRunningTime="2026-09-08 14:02:42.742855013 +0000 UTC m=+258.656759930"
Sep 08 14:02:43.154040 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:43.154002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:43.247850 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:43.247812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:43.723814 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:43.723774    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-5wwfx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:02:43.724023 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:43.723838    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx" podUID="4d2e55e9-4e11-4094-b707-7ddb079711c3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:02:44.178256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:44.178221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:45.732152 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:45.732068    2559 generic.go:356] "Generic (PLEG): container finished" podID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerID="97c2f9f1b6ae06b3fc9364e7c6c960240376db03060a2651ff1d47d4a4dc150d" exitCode=0
Sep 08 14:02:45.732593 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:45.732158    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794" event={"ID":"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42","Type":"ContainerDied","Data":"97c2f9f1b6ae06b3fc9364e7c6c960240376db03060a2651ff1d47d4a4dc150d"}
Sep 08 14:02:45.733965 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:45.733938    2559 generic.go:356] "Generic (PLEG): container finished" podID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerID="a17d7276379e1338feffbb4de7b1ebafb6a36fbcb87f80e5771a86dd4f349668" exitCode=0
Sep 08 14:02:45.734280 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:45.733994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d" event={"ID":"ec2b4dd5-1658-49b0-8fc1-646a685b438c","Type":"ContainerDied","Data":"a17d7276379e1338feffbb4de7b1ebafb6a36fbcb87f80e5771a86dd4f349668"}
Sep 08 14:02:45.760391 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:45.760360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:45.848267 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:45.848232    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:46.723655 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:46.723601    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:02:47.374942 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:47.374893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:48.369633 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:48.369578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:02:48.749764 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:48.749732    2559 generic.go:356] "Generic (PLEG): container finished" podID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerID="e7e031e4e7e920a1027d82435893cb2cfabfbc0846b8de6c9d70257d2feb2256" exitCode=0
Sep 08 14:02:48.750113 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:48.749784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d" event={"ID":"ec2b4dd5-1658-49b0-8fc1-646a685b438c","Type":"ContainerDied","Data":"e7e031e4e7e920a1027d82435893cb2cfabfbc0846b8de6c9d70257d2feb2256"}
Sep 08 14:02:49.756540 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:49.756502    2559 generic.go:356] "Generic (PLEG): container finished" podID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerID="b92ba4a24c65450739b24a44c52c2654231c4656dd7366a91c57b9096b463119" exitCode=0
Sep 08 14:02:49.756931 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:49.756549    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794" event={"ID":"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42","Type":"ContainerDied","Data":"b92ba4a24c65450739b24a44c52c2654231c4656dd7366a91c57b9096b463119"}
Sep 08 14:02:56.795255 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:56.795221    2559 generic.go:356] "Generic (PLEG): container finished" podID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerID="8e67e10c6e8c810ab21c0102428cc187b8e442fd5ac57e3563d0f8eaa017940e" exitCode=0
Sep 08 14:02:56.795761 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:56.795303    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d" event={"ID":"ec2b4dd5-1658-49b0-8fc1-646a685b438c","Type":"ContainerDied","Data":"8e67e10c6e8c810ab21c0102428cc187b8e442fd5ac57e3563d0f8eaa017940e"}
Sep 08 14:02:56.797452 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:56.797427    2559 generic.go:356] "Generic (PLEG): container finished" podID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerID="9719aaa107a821b3b497fb2546cc781e84dfbd5c5d7c7c0d026be2dc18a2c5b9" exitCode=0
Sep 08 14:02:56.797552 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:56.797460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794" event={"ID":"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42","Type":"ContainerDied","Data":"9719aaa107a821b3b497fb2546cc781e84dfbd5c5d7c7c0d026be2dc18a2c5b9"}
Sep 08 14:02:57.928904 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:57.928882    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:57.955722 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:57.955696    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:58.025335 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.025298    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-util\") pod \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") "
Sep 08 14:02:58.025513 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.025343    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn5b8\" (UniqueName: \"kubernetes.io/projected/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-kube-api-access-fn5b8\") pod \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") "
Sep 08 14:02:58.025513 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.025363    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-bundle\") pod \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\" (UID: \"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42\") "
Sep 08 14:02:58.025822 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.025798    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-bundle" (OuterVolumeSpecName: "bundle") pod "d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" (UID: "d89a1cdc-553b-4089-9e71-ffc1f0a0ba42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:58.027787 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.027757    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-kube-api-access-fn5b8" (OuterVolumeSpecName: "kube-api-access-fn5b8") pod "d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" (UID: "d89a1cdc-553b-4089-9e71-ffc1f0a0ba42"). InnerVolumeSpecName "kube-api-access-fn5b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:02:58.029548 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.029528    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-util" (OuterVolumeSpecName: "util") pod "d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" (UID: "d89a1cdc-553b-4089-9e71-ffc1f0a0ba42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:58.126142 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.126056    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-util\") pod \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") "
Sep 08 14:02:58.126142 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.126105    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7hmd\" (UniqueName: \"kubernetes.io/projected/ec2b4dd5-1658-49b0-8fc1-646a685b438c-kube-api-access-z7hmd\") pod \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") "
Sep 08 14:02:58.126356 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.126186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-bundle\") pod \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\" (UID: \"ec2b4dd5-1658-49b0-8fc1-646a685b438c\") "
Sep 08 14:02:58.126430 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.126409    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-util\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:58.126478 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.126432    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn5b8\" (UniqueName: \"kubernetes.io/projected/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-kube-api-access-fn5b8\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:58.126478 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.126447    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d89a1cdc-553b-4089-9e71-ffc1f0a0ba42-bundle\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:58.126898 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.126867    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-bundle" (OuterVolumeSpecName: "bundle") pod "ec2b4dd5-1658-49b0-8fc1-646a685b438c" (UID: "ec2b4dd5-1658-49b0-8fc1-646a685b438c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:58.128363 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.128332    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2b4dd5-1658-49b0-8fc1-646a685b438c-kube-api-access-z7hmd" (OuterVolumeSpecName: "kube-api-access-z7hmd") pod "ec2b4dd5-1658-49b0-8fc1-646a685b438c" (UID: "ec2b4dd5-1658-49b0-8fc1-646a685b438c"). InnerVolumeSpecName "kube-api-access-z7hmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:02:58.131156 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.131130    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-util" (OuterVolumeSpecName: "util") pod "ec2b4dd5-1658-49b0-8fc1-646a685b438c" (UID: "ec2b4dd5-1658-49b0-8fc1-646a685b438c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:02:58.227769 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.227725    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-util\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:58.227769 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.227765    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7hmd\" (UniqueName: \"kubernetes.io/projected/ec2b4dd5-1658-49b0-8fc1-646a685b438c-kube-api-access-z7hmd\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:58.227769 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.227775    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec2b4dd5-1658-49b0-8fc1-646a685b438c-bundle\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:02:58.807960 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.807929    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794"
Sep 08 14:02:58.808153 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.807963    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edn794" event={"ID":"d89a1cdc-553b-4089-9e71-ffc1f0a0ba42","Type":"ContainerDied","Data":"b9a364faaf24859c9e92925f9dd602044de83c5fcc4fbf7d3b7393b1aeecd6dc"}
Sep 08 14:02:58.808153 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.808012    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9a364faaf24859c9e92925f9dd602044de83c5fcc4fbf7d3b7393b1aeecd6dc"
Sep 08 14:02:58.810097 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.810066    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d" event={"ID":"ec2b4dd5-1658-49b0-8fc1-646a685b438c","Type":"ContainerDied","Data":"b4f30f61e572574b6b2ae32fea0d38a86fb406f08d3adfdbdb77dd995f78fe2a"}
Sep 08 14:02:58.810272 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.810120    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4f30f61e572574b6b2ae32fea0d38a86fb406f08d3adfdbdb77dd995f78fe2a"
Sep 08 14:02:58.810272 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:58.810194    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r8l9d"
Sep 08 14:02:59.343198 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:02:59.343159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:00.363342 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:00.363293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:07.310429 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:07.310387    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:09.852081 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:09.852041    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:11.069368 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:11.069329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:12.322272 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:12.322236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:12.567188 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:12.567150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:14.144158 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:14.144124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:14.248061 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:14.248023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:14.628306 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:14.628263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:14.816773 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:14.816734    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:16.840036 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:16.839997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:17.323062 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:17.323029    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:18.686538 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:18.686484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:20.696591 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:20.696558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:22.862550 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:22.862508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:23.061924 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:23.061859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:23.226372 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:23.226270    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:24.526382 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.526359    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 14:03:24.693447 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.693299    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:24.812544 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.812516    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:24.943273 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.943237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:24.947759 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.947724    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"]
Sep 08 14:03:24.948033 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948020    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerName="util"
Sep 08 14:03:24.948074 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948035    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerName="util"
Sep 08 14:03:24.948074 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948045    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerName="extract"
Sep 08 14:03:24.948074 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948050    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerName="extract"
Sep 08 14:03:24.948074 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948070    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerName="pull"
Sep 08 14:03:24.948074 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948076    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerName="pull"
Sep 08 14:03:24.948217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948089    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerName="util"
Sep 08 14:03:24.948217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948094    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerName="util"
Sep 08 14:03:24.948217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948100    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerName="extract"
Sep 08 14:03:24.948217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948104    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerName="extract"
Sep 08 14:03:24.948217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948113    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerName="pull"
Sep 08 14:03:24.948217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948117    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerName="pull"
Sep 08 14:03:24.948217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948170    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d89a1cdc-553b-4089-9e71-ffc1f0a0ba42" containerName="extract"
Sep 08 14:03:24.948217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.948176    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2b4dd5-1658-49b0-8fc1-646a685b438c" containerName="extract"
Sep 08 14:03:24.951140 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.951122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:24.960271 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.960248    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 08 14:03:24.964980 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.964959    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 14:03:24.983779 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.983747    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 14:03:24.985097 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.985080    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-kzwgl\""
Sep 08 14:03:24.987263 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.987238    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 08 14:03:24.987434 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.987416    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 08 14:03:24.997377 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:24.997342    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"]
Sep 08 14:03:25.038301 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.038264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-metrics-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.038491 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.038322    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.038491 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.038341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.038491 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.038391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faab413e-b811-4c81-b1e8-2f1d14efe60f-manifests\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.038491 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.038425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faab413e-b811-4c81-b1e8-2f1d14efe60f-tmp\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.038663 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.038486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dp6d\" (UniqueName: \"kubernetes.io/projected/faab413e-b811-4c81-b1e8-2f1d14efe60f-kube-api-access-2dp6d\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.139215 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.139109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-metrics-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.139215 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.139174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.139215 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.139191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.139485 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.139319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faab413e-b811-4c81-b1e8-2f1d14efe60f-manifests\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.139485 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.139352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faab413e-b811-4c81-b1e8-2f1d14efe60f-tmp\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.139485 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.139404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dp6d\" (UniqueName: \"kubernetes.io/projected/faab413e-b811-4c81-b1e8-2f1d14efe60f-kube-api-access-2dp6d\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.139775 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.139750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faab413e-b811-4c81-b1e8-2f1d14efe60f-manifests\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.141693 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.141661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faab413e-b811-4c81-b1e8-2f1d14efe60f-tmp\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.141856 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.141836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.142142 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.142125    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-metrics-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.142268 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.142245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faab413e-b811-4c81-b1e8-2f1d14efe60f-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.151347 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.151317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dp6d\" (UniqueName: \"kubernetes.io/projected/faab413e-b811-4c81-b1e8-2f1d14efe60f-kube-api-access-2dp6d\") pod \"opendatahub-operator-controller-manager-77cd5f6c85-v4q6w\" (UID: \"faab413e-b811-4c81-b1e8-2f1d14efe60f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.260805 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.260766    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:25.375445 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.375409    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:25.483006 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.482919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:25.545890 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.545848    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"]
Sep 08 14:03:25.547954 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:03:25.547928    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaab413e_b811_4c81_b1e8_2f1d14efe60f.slice/crio-6bfd6e8ade84b19a21417180e2323fe7bed9882d0bc2aa5f8fe3670c5bdeedec WatchSource:0}: Error finding container 6bfd6e8ade84b19a21417180e2323fe7bed9882d0bc2aa5f8fe3670c5bdeedec: Status 404 returned error can't find the container with id 6bfd6e8ade84b19a21417180e2323fe7bed9882d0bc2aa5f8fe3670c5bdeedec
Sep 08 14:03:25.591255 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.591217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:25.700365 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.700333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:25.793661 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.793628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:25.926806 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:25.926772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w" event={"ID":"faab413e-b811-4c81-b1e8-2f1d14efe60f","Type":"ContainerStarted","Data":"6bfd6e8ade84b19a21417180e2323fe7bed9882d0bc2aa5f8fe3670c5bdeedec"}
Sep 08 14:03:27.841066 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:27.841032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:27.937545 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:27.937490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:28.947730 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:28.947703    2559 generic.go:356] "Generic (PLEG): container finished" podID="faab413e-b811-4c81-b1e8-2f1d14efe60f" containerID="9c79d87798b0d211d8d3a8cc63eb0deb6b8b7c5ef1b21238d86848a1f474a5ce" exitCode=0
Sep 08 14:03:28.948150 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:28.947750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w" event={"ID":"faab413e-b811-4c81-b1e8-2f1d14efe60f","Type":"ContainerDied","Data":"9c79d87798b0d211d8d3a8cc63eb0deb6b8b7c5ef1b21238d86848a1f474a5ce"}
Sep 08 14:03:28.948238 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:28.948222    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:03:29.956542 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:29.956506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w" event={"ID":"faab413e-b811-4c81-b1e8-2f1d14efe60f","Type":"ContainerStarted","Data":"4df302c4a0294b42ac11b6fc4f5bce69bce83af7d7498837d9d6d0cea6d3a7c9"}
Sep 08 14:03:29.956941 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:29.956650    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:29.985241 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:29.985177    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w" podStartSLOduration=2.4248605899999998 podStartE2EDuration="5.985160323s" totalImagesPullingTime="3.067679448s" totalInitContainerRuntime="492.620285ms" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:29.983211297 +0000 UTC m=+305.897116213" watchObservedRunningTime="2026-09-08 14:03:29.985160323 +0000 UTC m=+305.899065302"
Sep 08 14:03:32.545336 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:32.545281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:32.636522 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:32.636484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:33.899496 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:33.899456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:34.210955 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.210858    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"]
Sep 08 14:03:34.217559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.217532    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:34.221386 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.221350    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 14:03:34.238771 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.238739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pp4z7\""
Sep 08 14:03:34.238947 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.238845    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 14:03:34.243947 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.243910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"]
Sep 08 14:03:34.314475 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.314442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0175d028-274b-4831-a5e4-7dba33bac42c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-74jxt\" (UID: \"0175d028-274b-4831-a5e4-7dba33bac42c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:34.314680 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.314480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm5fk\" (UniqueName: \"kubernetes.io/projected/0175d028-274b-4831-a5e4-7dba33bac42c-kube-api-access-zm5fk\") pod \"kuadrant-operator-controller-manager-7456d9997c-74jxt\" (UID: \"0175d028-274b-4831-a5e4-7dba33bac42c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:34.415458 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.415422    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0175d028-274b-4831-a5e4-7dba33bac42c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-74jxt\" (UID: \"0175d028-274b-4831-a5e4-7dba33bac42c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:34.415638 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.415473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm5fk\" (UniqueName: \"kubernetes.io/projected/0175d028-274b-4831-a5e4-7dba33bac42c-kube-api-access-zm5fk\") pod \"kuadrant-operator-controller-manager-7456d9997c-74jxt\" (UID: \"0175d028-274b-4831-a5e4-7dba33bac42c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:34.415787 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.415765    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0175d028-274b-4831-a5e4-7dba33bac42c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-74jxt\" (UID: \"0175d028-274b-4831-a5e4-7dba33bac42c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:34.432466 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.432445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm5fk\" (UniqueName: \"kubernetes.io/projected/0175d028-274b-4831-a5e4-7dba33bac42c-kube-api-access-zm5fk\") pod \"kuadrant-operator-controller-manager-7456d9997c-74jxt\" (UID: \"0175d028-274b-4831-a5e4-7dba33bac42c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:34.527873 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.527774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:34.815203 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.815178    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"]
Sep 08 14:03:34.817934 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:03:34.817899    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0175d028_274b_4831_a5e4_7dba33bac42c.slice/crio-ccefc4c9e034dbba1bd1e753f86a3d693b04998bf4d44cc50ba3aa28b4964f9f WatchSource:0}: Error finding container ccefc4c9e034dbba1bd1e753f86a3d693b04998bf4d44cc50ba3aa28b4964f9f: Status 404 returned error can't find the container with id ccefc4c9e034dbba1bd1e753f86a3d693b04998bf4d44cc50ba3aa28b4964f9f
Sep 08 14:03:34.979331 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.979298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt" event={"ID":"0175d028-274b-4831-a5e4-7dba33bac42c","Type":"ContainerStarted","Data":"ccefc4c9e034dbba1bd1e753f86a3d693b04998bf4d44cc50ba3aa28b4964f9f"}
Sep 08 14:03:34.987390 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:34.987351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:36.167967 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:36.167910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:36.268926 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:36.268882    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:39.003248 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:39.003148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt" event={"ID":"0175d028-274b-4831-a5e4-7dba33bac42c","Type":"ContainerStarted","Data":"be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0"}
Sep 08 14:03:39.003248 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:39.003221    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:39.024963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:39.024913    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt" podStartSLOduration=1.180942026 podStartE2EDuration="5.024897429s" totalImagesPullingTime="3.843955403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:03:39.023783359 +0000 UTC m=+314.937688275" watchObservedRunningTime="2026-09-08 14:03:39.024897429 +0000 UTC m=+314.938802345"
Sep 08 14:03:40.963782 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:40.963750    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77cd5f6c85-v4q6w"
Sep 08 14:03:41.841812 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:41.841770    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:41.924437 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:41.924401    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:48.262237 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:48.262195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:48.360018 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:48.359981    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:50.009881 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:50.009839    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:03:51.090040 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:51.090006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:51.200576 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:51.200542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:55.897991 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:55.897947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:55.992311 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:55.992276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:56.091861 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:56.091826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:56.740033 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:56.739923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:03:56.843772 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:03:56.843731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:00.310353 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.310317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:00.416001 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.415969    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:00.517342 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.517308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:00.660637 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.660546    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"]
Sep 08 14:04:00.661718 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.661689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:00.664105 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.664089    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:00.667184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.667160    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qfj4b\""
Sep 08 14:04:00.667381 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.667165    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 14:04:00.668797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.668777    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 14:04:00.677405 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.677327    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"]
Sep 08 14:04:00.738582 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.738534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mljtd\" (UniqueName: \"kubernetes.io/projected/9322718d-a262-44db-b787-0f8bf738e5e4-kube-api-access-mljtd\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:00.738582 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.738580    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9322718d-a262-44db-b787-0f8bf738e5e4-tls-certs\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:00.738882 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.738715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9322718d-a262-44db-b787-0f8bf738e5e4-tmp\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:00.817106 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.817062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:00.839972 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.839930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9322718d-a262-44db-b787-0f8bf738e5e4-tls-certs\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:00.840169 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.840016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9322718d-a262-44db-b787-0f8bf738e5e4-tmp\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:00.840169 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.840105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mljtd\" (UniqueName: \"kubernetes.io/projected/9322718d-a262-44db-b787-0f8bf738e5e4-kube-api-access-mljtd\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:00.840169 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:04:00.840115    2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 08 14:04:00.840345 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:04:00.840215    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9322718d-a262-44db-b787-0f8bf738e5e4-tls-certs podName:9322718d-a262-44db-b787-0f8bf738e5e4 nodeName:}" failed. No retries permitted until 2026-09-08 14:04:01.340193932 +0000 UTC m=+337.254098841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9322718d-a262-44db-b787-0f8bf738e5e4-tls-certs") pod "kube-auth-proxy-58f4c5d6b6-r2k46" (UID: "9322718d-a262-44db-b787-0f8bf738e5e4") : secret "kube-auth-proxy-tls" not found
Sep 08 14:04:00.842699 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.842678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9322718d-a262-44db-b787-0f8bf738e5e4-tmp\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:00.851851 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:00.851822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mljtd\" (UniqueName: \"kubernetes.io/projected/9322718d-a262-44db-b787-0f8bf738e5e4-kube-api-access-mljtd\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:01.273034 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:01.272994    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:01.345456 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:01.345420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9322718d-a262-44db-b787-0f8bf738e5e4-tls-certs\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:01.348107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:01.348081    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9322718d-a262-44db-b787-0f8bf738e5e4-tls-certs\") pod \"kube-auth-proxy-58f4c5d6b6-r2k46\" (UID: \"9322718d-a262-44db-b787-0f8bf738e5e4\") " pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:01.469500 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:01.469456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:01.575103 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:01.575070    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"
Sep 08 14:04:01.795599 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:01.795564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:01.859968 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:01.859943    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46"]
Sep 08 14:04:01.862491 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:04:01.862462    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9322718d_a262_44db_b787_0f8bf738e5e4.slice/crio-d8589ce1fa3f04988ff8e60d43644401055a4a843754859cd4577dcd83014961 WatchSource:0}: Error finding container d8589ce1fa3f04988ff8e60d43644401055a4a843754859cd4577dcd83014961: Status 404 returned error can't find the container with id d8589ce1fa3f04988ff8e60d43644401055a4a843754859cd4577dcd83014961
Sep 08 14:04:01.898468 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:01.898433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:02.054517 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:02.054479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:02.112494 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:02.112410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46" event={"ID":"9322718d-a262-44db-b787-0f8bf738e5e4","Type":"ContainerStarted","Data":"d8589ce1fa3f04988ff8e60d43644401055a4a843754859cd4577dcd83014961"}
Sep 08 14:04:02.146727 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:02.146691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:02.439252 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:02.439156    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:02.588600 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:02.588553    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:03.362479 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:03.362414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:04.124852 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:04.124757    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46" event={"ID":"9322718d-a262-44db-b787-0f8bf738e5e4","Type":"ContainerStarted","Data":"0eb7fc76052035e447230400e6c4dd658cf9310c31d973e910ed02136c6c640b"}
Sep 08 14:04:04.162265 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:04.162207    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58f4c5d6b6-r2k46" podStartSLOduration=2.23978985 podStartE2EDuration="4.162190952s" totalImagesPullingTime="1.922401102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:04.161466042 +0000 UTC m=+340.075370959" watchObservedRunningTime="2026-09-08 14:04:04.162190952 +0000 UTC m=+340.076095868"
Sep 08 14:04:06.954224 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:06.954182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:06.961442 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:06.961405    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"]
Sep 08 14:04:06.965089 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:06.965067    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:06.967403 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:06.967384    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tvfsh\""
Sep 08 14:04:06.967505 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:06.967437    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 14:04:06.975352 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:06.975329    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"]
Sep 08 14:04:07.057192 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.057159    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"]
Sep 08 14:04:07.088023 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.087994    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:07.098655 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.098588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66pgk\" (UniqueName: \"kubernetes.io/projected/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-kube-api-access-66pgk\") pod \"limitador-limitador-859c4d96d6-6r8xj\" (UID: \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:07.098822 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.098714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-config-file\") pod \"limitador-limitador-859c4d96d6-6r8xj\" (UID: \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:07.199439 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.199406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66pgk\" (UniqueName: \"kubernetes.io/projected/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-kube-api-access-66pgk\") pod \"limitador-limitador-859c4d96d6-6r8xj\" (UID: \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:07.199675 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.199450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-config-file\") pod \"limitador-limitador-859c4d96d6-6r8xj\" (UID: \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:07.200114 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.200092    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-config-file\") pod \"limitador-limitador-859c4d96d6-6r8xj\" (UID: \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:07.211186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.211121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66pgk\" (UniqueName: \"kubernetes.io/projected/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-kube-api-access-66pgk\") pod \"limitador-limitador-859c4d96d6-6r8xj\" (UID: \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:07.276651 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.276601    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:07.413186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.413149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:07.554239 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.554208    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"]
Sep 08 14:04:07.557278 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:04:07.557251    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105a15cb_5e84_40ea_aa84_8a3c1c1c6e56.slice/crio-2ab05de35db5471c19132dfb61d53d2c645312ba11cf2b6efeb9093b77a007d1 WatchSource:0}: Error finding container 2ab05de35db5471c19132dfb61d53d2c645312ba11cf2b6efeb9093b77a007d1: Status 404 returned error can't find the container with id 2ab05de35db5471c19132dfb61d53d2c645312ba11cf2b6efeb9093b77a007d1
Sep 08 14:04:07.762687 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.762654    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-fwr4p"]
Sep 08 14:04:07.767123 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.767099    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-fwr4p"
Sep 08 14:04:07.769683 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.769664    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sp9m6\""
Sep 08 14:04:07.774692 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.774665    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-fwr4p"]
Sep 08 14:04:07.877932 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.877828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:07.905025 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.904991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xz8z\" (UniqueName: \"kubernetes.io/projected/e18dd631-86cd-4110-a58a-7cd5a6cccbe0-kube-api-access-9xz8z\") pod \"authorino-b54df94b4-fwr4p\" (UID: \"e18dd631-86cd-4110-a58a-7cd5a6cccbe0\") " pod="kuadrant-system/authorino-b54df94b4-fwr4p"
Sep 08 14:04:07.947478 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:07.947448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:08.006423 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:08.006390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xz8z\" (UniqueName: \"kubernetes.io/projected/e18dd631-86cd-4110-a58a-7cd5a6cccbe0-kube-api-access-9xz8z\") pod \"authorino-b54df94b4-fwr4p\" (UID: \"e18dd631-86cd-4110-a58a-7cd5a6cccbe0\") " pod="kuadrant-system/authorino-b54df94b4-fwr4p"
Sep 08 14:04:08.015560 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:08.015537    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xz8z\" (UniqueName: \"kubernetes.io/projected/e18dd631-86cd-4110-a58a-7cd5a6cccbe0-kube-api-access-9xz8z\") pod \"authorino-b54df94b4-fwr4p\" (UID: \"e18dd631-86cd-4110-a58a-7cd5a6cccbe0\") " pod="kuadrant-system/authorino-b54df94b4-fwr4p"
Sep 08 14:04:08.077663 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:08.077630    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-fwr4p"
Sep 08 14:04:08.145908 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:08.145878    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj" event={"ID":"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56","Type":"ContainerStarted","Data":"2ab05de35db5471c19132dfb61d53d2c645312ba11cf2b6efeb9093b77a007d1"}
Sep 08 14:04:08.350863 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:08.350830    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-fwr4p"]
Sep 08 14:04:08.352966 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:04:08.352941    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode18dd631_86cd_4110_a58a_7cd5a6cccbe0.slice/crio-89d74c68243af36d52cbceb5eec02477c695f0b2e9ff200d64a09be061b60611 WatchSource:0}: Error finding container 89d74c68243af36d52cbceb5eec02477c695f0b2e9ff200d64a09be061b60611: Status 404 returned error can't find the container with id 89d74c68243af36d52cbceb5eec02477c695f0b2e9ff200d64a09be061b60611
Sep 08 14:04:09.154335 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:09.154295    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-fwr4p" event={"ID":"e18dd631-86cd-4110-a58a-7cd5a6cccbe0","Type":"ContainerStarted","Data":"89d74c68243af36d52cbceb5eec02477c695f0b2e9ff200d64a09be061b60611"}
Sep 08 14:04:10.605400 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:10.605366    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-fwr4p"]
Sep 08 14:04:11.164772 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:11.164736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj" event={"ID":"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56","Type":"ContainerStarted","Data":"853076d071457b44d505f3f177c2f448efc8ca2757bc9444ff3527a0bdc2378f"}
Sep 08 14:04:11.165077 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:11.164811    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:11.166295 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:11.166271    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-fwr4p" event={"ID":"e18dd631-86cd-4110-a58a-7cd5a6cccbe0","Type":"ContainerStarted","Data":"3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4"}
Sep 08 14:04:11.187446 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:11.187388    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj" podStartSLOduration=2.621878277 podStartE2EDuration="5.187373351s" totalImagesPullingTime="2.565495074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:11.184919225 +0000 UTC m=+347.098824135" watchObservedRunningTime="2026-09-08 14:04:11.187373351 +0000 UTC m=+347.101278271"
Sep 08 14:04:11.204211 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:11.204153    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-fwr4p" podStartSLOduration=2.385975201 podStartE2EDuration="4.204141616s" totalImagesPullingTime="1.818166415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:11.202172217 +0000 UTC m=+347.116077133" watchObservedRunningTime="2026-09-08 14:04:11.204141616 +0000 UTC m=+347.118046534"
Sep 08 14:04:11.927874 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:11.927837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:12.170642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:12.170575    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-fwr4p" podUID="e18dd631-86cd-4110-a58a-7cd5a6cccbe0" containerName="authorino" containerID="cri-o://3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4" gracePeriod=30
Sep 08 14:04:12.308023 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:12.307994    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:12.415938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:12.415910    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-fwr4p"
Sep 08 14:04:12.544725 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:12.544696    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xz8z\" (UniqueName: \"kubernetes.io/projected/e18dd631-86cd-4110-a58a-7cd5a6cccbe0-kube-api-access-9xz8z\") pod \"e18dd631-86cd-4110-a58a-7cd5a6cccbe0\" (UID: \"e18dd631-86cd-4110-a58a-7cd5a6cccbe0\") "
Sep 08 14:04:12.547059 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:12.547030    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18dd631-86cd-4110-a58a-7cd5a6cccbe0-kube-api-access-9xz8z" (OuterVolumeSpecName: "kube-api-access-9xz8z") pod "e18dd631-86cd-4110-a58a-7cd5a6cccbe0" (UID: "e18dd631-86cd-4110-a58a-7cd5a6cccbe0"). InnerVolumeSpecName "kube-api-access-9xz8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:04:12.646344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:12.646309    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xz8z\" (UniqueName: \"kubernetes.io/projected/e18dd631-86cd-4110-a58a-7cd5a6cccbe0-kube-api-access-9xz8z\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:04:13.176090 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.176051    2559 generic.go:356] "Generic (PLEG): container finished" podID="e18dd631-86cd-4110-a58a-7cd5a6cccbe0" containerID="3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4" exitCode=0
Sep 08 14:04:13.176090 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.176092    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-fwr4p"
Sep 08 14:04:13.176629 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.176138    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-fwr4p" event={"ID":"e18dd631-86cd-4110-a58a-7cd5a6cccbe0","Type":"ContainerDied","Data":"3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4"}
Sep 08 14:04:13.176629 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.176191    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-fwr4p" event={"ID":"e18dd631-86cd-4110-a58a-7cd5a6cccbe0","Type":"ContainerDied","Data":"89d74c68243af36d52cbceb5eec02477c695f0b2e9ff200d64a09be061b60611"}
Sep 08 14:04:13.176629 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.176217    2559 scope.go:117] "RemoveContainer" containerID="3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4"
Sep 08 14:04:13.184655 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.184631    2559 scope.go:117] "RemoveContainer" containerID="3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4"
Sep 08 14:04:13.184982 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:04:13.184962    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4\": container with ID starting with 3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4 not found: ID does not exist" containerID="3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4"
Sep 08 14:04:13.185050 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.184992    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4"} err="failed to get container status \"3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4\": rpc error: code = NotFound desc = could not find container \"3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4\": container with ID starting with 3eeda409e16818c6575eba616a0c538d8a191a8d579bf0bfd1c5a2f84c7c87c4 not found: ID does not exist"
Sep 08 14:04:13.191309 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.191282    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-fwr4p"]
Sep 08 14:04:13.195171 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:13.195148    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-fwr4p"]
Sep 08 14:04:14.581573 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:14.581539    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e18dd631-86cd-4110-a58a-7cd5a6cccbe0" path="/var/lib/kubelet/pods/e18dd631-86cd-4110-a58a-7cd5a6cccbe0/volumes"
Sep 08 14:04:17.343042 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:17.342925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:17.409664 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:17.409589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:17.523775 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:17.523737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:17.597280 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:17.597195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:17.728980 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:17.728939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:17.874462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:17.874367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:19.885100 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:19.885060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:20.282329 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:20.282295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:20.385045 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:20.385006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:20.569362 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:20.569264    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:21.593145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:21.593107    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"]
Sep 08 14:04:21.593628 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:21.593353    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj" podUID="105a15cb-5e84-40ea-aa84-8a3c1c1c6e56" containerName="limitador" containerID="cri-o://853076d071457b44d505f3f177c2f448efc8ca2757bc9444ff3527a0bdc2378f" gracePeriod=30
Sep 08 14:04:21.594114 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:21.594036    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:22.216453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.216375    2559 generic.go:356] "Generic (PLEG): container finished" podID="105a15cb-5e84-40ea-aa84-8a3c1c1c6e56" containerID="853076d071457b44d505f3f177c2f448efc8ca2757bc9444ff3527a0bdc2378f" exitCode=0
Sep 08 14:04:22.216595 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.216448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj" event={"ID":"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56","Type":"ContainerDied","Data":"853076d071457b44d505f3f177c2f448efc8ca2757bc9444ff3527a0bdc2378f"}
Sep 08 14:04:22.537761 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.537730    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:22.633548 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.633516    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-config-file\") pod \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\" (UID: \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\") "
Sep 08 14:04:22.633990 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.633581    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66pgk\" (UniqueName: \"kubernetes.io/projected/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-kube-api-access-66pgk\") pod \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\" (UID: \"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56\") "
Sep 08 14:04:22.633990 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.633937    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-config-file" (OuterVolumeSpecName: "config-file") pod "105a15cb-5e84-40ea-aa84-8a3c1c1c6e56" (UID: "105a15cb-5e84-40ea-aa84-8a3c1c1c6e56"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:04:22.635826 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.635800    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-kube-api-access-66pgk" (OuterVolumeSpecName: "kube-api-access-66pgk") pod "105a15cb-5e84-40ea-aa84-8a3c1c1c6e56" (UID: "105a15cb-5e84-40ea-aa84-8a3c1c1c6e56"). InnerVolumeSpecName "kube-api-access-66pgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:04:22.735068 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.735025    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-config-file\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:04:22.735068 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:22.735061    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66pgk\" (UniqueName: \"kubernetes.io/projected/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56-kube-api-access-66pgk\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:04:23.023381 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:23.023335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:23.120976 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:23.120940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:23.226659 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:23.226627    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"
Sep 08 14:04:23.226852 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:23.226625    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6r8xj" event={"ID":"105a15cb-5e84-40ea-aa84-8a3c1c1c6e56","Type":"ContainerDied","Data":"2ab05de35db5471c19132dfb61d53d2c645312ba11cf2b6efeb9093b77a007d1"}
Sep 08 14:04:23.226852 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:23.226779    2559 scope.go:117] "RemoveContainer" containerID="853076d071457b44d505f3f177c2f448efc8ca2757bc9444ff3527a0bdc2378f"
Sep 08 14:04:23.256005 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:23.255970    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"]
Sep 08 14:04:23.260103 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:23.260074    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6r8xj"]
Sep 08 14:04:24.368750 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:24.368712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:24.469364 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:24.469333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:24.580974 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:24.580940    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="105a15cb-5e84-40ea-aa84-8a3c1c1c6e56" path="/var/lib/kubelet/pods/105a15cb-5e84-40ea-aa84-8a3c1c1c6e56/volumes"
Sep 08 14:04:28.934914 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:28.934876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:29.036266 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:29.036223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:33.758167 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:33.758136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:33.837278 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:33.837201    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:54.592211 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:54.592167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:54.751708 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:54.751676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:56.302332 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.302295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:56.405388 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.405355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:56.518997 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.518960    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-m965v"]
Sep 08 14:04:56.519375 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.519356    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="105a15cb-5e84-40ea-aa84-8a3c1c1c6e56" containerName="limitador"
Sep 08 14:04:56.519464 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.519378    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="105a15cb-5e84-40ea-aa84-8a3c1c1c6e56" containerName="limitador"
Sep 08 14:04:56.519464 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.519396    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18dd631-86cd-4110-a58a-7cd5a6cccbe0" containerName="authorino"
Sep 08 14:04:56.519464 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.519404    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18dd631-86cd-4110-a58a-7cd5a6cccbe0" containerName="authorino"
Sep 08 14:04:56.519648 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.519477    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="105a15cb-5e84-40ea-aa84-8a3c1c1c6e56" containerName="limitador"
Sep 08 14:04:56.519648 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.519494    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18dd631-86cd-4110-a58a-7cd5a6cccbe0" containerName="authorino"
Sep 08 14:04:56.522484 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.522455    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.526700 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.526680    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 14:04:56.526938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.526925    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2nwq2\""
Sep 08 14:04:56.527595 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.527579    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:04:56.527703 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.527687    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:04:56.527757 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.527685    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:04:56.540430 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.540403    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-m965v"]
Sep 08 14:04:56.586472 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.586369    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:56.623899 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.623868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-maas-api-tls\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.624081 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.623908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-metrics-certs\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.624081 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.623939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c362624c-24d8-4759-9ea0-8773a72f1c3c-openshift-service-ca\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.624081 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.623982    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvmg5\" (UniqueName: \"kubernetes.io/projected/c362624c-24d8-4759-9ea0-8773a72f1c3c-kube-api-access-jvmg5\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.724674 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.724634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c362624c-24d8-4759-9ea0-8773a72f1c3c-openshift-service-ca\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.724674 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.724670    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvmg5\" (UniqueName: \"kubernetes.io/projected/c362624c-24d8-4759-9ea0-8773a72f1c3c-kube-api-access-jvmg5\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.724887 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.724734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-maas-api-tls\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.724887 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.724760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-metrics-certs\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.725350 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.725317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c362624c-24d8-4759-9ea0-8773a72f1c3c-openshift-service-ca\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.727372 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.727353    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-maas-api-tls\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.727449 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.727391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-metrics-certs\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.748849 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.748822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvmg5\" (UniqueName: \"kubernetes.io/projected/c362624c-24d8-4759-9ea0-8773a72f1c3c-kube-api-access-jvmg5\") pod \"maas-api-768897d8b6-m965v\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:56.818132 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.818098    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:56.833160 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:56.833128    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:57.136839 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.136813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-m965v"]
Sep 08 14:04:57.138481 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:04:57.138459    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc362624c_24d8_4759_9ea0_8773a72f1c3c.slice/crio-17dba28cf487486b843c82621050160e5b86e443396d324d9471fdd3de63430f WatchSource:0}: Error finding container 17dba28cf487486b843c82621050160e5b86e443396d324d9471fdd3de63430f: Status 404 returned error can't find the container with id 17dba28cf487486b843c82621050160e5b86e443396d324d9471fdd3de63430f
Sep 08 14:04:57.377790 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.377753    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v" event={"ID":"c362624c-24d8-4759-9ea0-8773a72f1c3c","Type":"ContainerStarted","Data":"17dba28cf487486b843c82621050160e5b86e443396d324d9471fdd3de63430f"}
Sep 08 14:04:57.521551 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.521449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:57.650381 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.650343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:57.759767 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.759723    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"]
Sep 08 14:04:57.763179 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.763157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:04:57.765715 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.765694    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 14:04:57.766276 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.766254    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wqg6x\""
Sep 08 14:04:57.776707 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.776545    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"]
Sep 08 14:04:57.787900 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.787875    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"]
Sep 08 14:04:57.791375 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.791356    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:04:57.805701 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.805673    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"]
Sep 08 14:04:57.934536 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.934496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g54mp\" (UniqueName: \"kubernetes.io/projected/f56937cf-5625-422c-8796-28f1bd14a51d-kube-api-access-g54mp\") pod \"payload-pre-processing-59fbc47bf8-q4wm8\" (UID: \"f56937cf-5625-422c-8796-28f1bd14a51d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:04:57.934763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.934555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm5d2\" (UniqueName: \"kubernetes.io/projected/6b9662d3-1390-4eca-a3c3-82eb841865d9-kube-api-access-cm5d2\") pod \"payload-processing-5b54b7fbb7-d6cdq\" (UID: \"6b9662d3-1390-4eca-a3c3-82eb841865d9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:04:57.934763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.934636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f56937cf-5625-422c-8796-28f1bd14a51d-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-q4wm8\" (UID: \"f56937cf-5625-422c-8796-28f1bd14a51d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:04:57.934763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:57.934674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b9662d3-1390-4eca-a3c3-82eb841865d9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d6cdq\" (UID: \"6b9662d3-1390-4eca-a3c3-82eb841865d9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:04:58.035464 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.035433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g54mp\" (UniqueName: \"kubernetes.io/projected/f56937cf-5625-422c-8796-28f1bd14a51d-kube-api-access-g54mp\") pod \"payload-pre-processing-59fbc47bf8-q4wm8\" (UID: \"f56937cf-5625-422c-8796-28f1bd14a51d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:04:58.035684 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.035479    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm5d2\" (UniqueName: \"kubernetes.io/projected/6b9662d3-1390-4eca-a3c3-82eb841865d9-kube-api-access-cm5d2\") pod \"payload-processing-5b54b7fbb7-d6cdq\" (UID: \"6b9662d3-1390-4eca-a3c3-82eb841865d9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:04:58.035684 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.035513    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f56937cf-5625-422c-8796-28f1bd14a51d-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-q4wm8\" (UID: \"f56937cf-5625-422c-8796-28f1bd14a51d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:04:58.035684 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.035552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b9662d3-1390-4eca-a3c3-82eb841865d9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d6cdq\" (UID: \"6b9662d3-1390-4eca-a3c3-82eb841865d9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:04:58.036444 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.036412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b9662d3-1390-4eca-a3c3-82eb841865d9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d6cdq\" (UID: \"6b9662d3-1390-4eca-a3c3-82eb841865d9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:04:58.036556 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.036423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f56937cf-5625-422c-8796-28f1bd14a51d-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-q4wm8\" (UID: \"f56937cf-5625-422c-8796-28f1bd14a51d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:04:58.073217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.073185    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g54mp\" (UniqueName: \"kubernetes.io/projected/f56937cf-5625-422c-8796-28f1bd14a51d-kube-api-access-g54mp\") pod \"payload-pre-processing-59fbc47bf8-q4wm8\" (UID: \"f56937cf-5625-422c-8796-28f1bd14a51d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:04:58.076955 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.076935    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:04:58.089749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.089722    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm5d2\" (UniqueName: \"kubernetes.io/projected/6b9662d3-1390-4eca-a3c3-82eb841865d9-kube-api-access-cm5d2\") pod \"payload-processing-5b54b7fbb7-d6cdq\" (UID: \"6b9662d3-1390-4eca-a3c3-82eb841865d9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:04:58.104894 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.104856    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:04:58.407934 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.407905    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"]
Sep 08 14:04:58.430181 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.430123    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"]
Sep 08 14:04:58.741001 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:04:58.740930    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56937cf_5625_422c_8796_28f1bd14a51d.slice/crio-00cd21c99826aa4f889689ef755089d7d6d4ba8bc52f6e05a7e71857d0c9b817 WatchSource:0}: Error finding container 00cd21c99826aa4f889689ef755089d7d6d4ba8bc52f6e05a7e71857d0c9b817: Status 404 returned error can't find the container with id 00cd21c99826aa4f889689ef755089d7d6d4ba8bc52f6e05a7e71857d0c9b817
Sep 08 14:04:58.741747 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:04:58.741669    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9662d3_1390_4eca_a3c3_82eb841865d9.slice/crio-518a6a9e11e426d6ba1a6130a9ce9c4050551c6a620122c0536bb3f1a6731671 WatchSource:0}: Error finding container 518a6a9e11e426d6ba1a6130a9ce9c4050551c6a620122c0536bb3f1a6731671: Status 404 returned error can't find the container with id 518a6a9e11e426d6ba1a6130a9ce9c4050551c6a620122c0536bb3f1a6731671
Sep 08 14:04:58.822845 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.822816    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:58.954125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:58.954094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:59.086489 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.086454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:59.151750 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.151719    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-5wzjs"]
Sep 08 14:04:59.155160 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.155137    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:04:59.160216 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.160196    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 14:04:59.161179 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.161155    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lvgc5\""
Sep 08 14:04:59.161306 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.161196    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 14:04:59.161306 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.161216    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 14:04:59.187917 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.187886    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-5wzjs"]
Sep 08 14:04:59.246461 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.246420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg5ld\" (UniqueName: \"kubernetes.io/projected/be69ab76-074d-4184-ba89-f833c5a6e662-kube-api-access-hg5ld\") pod \"kserve-controller-manager-85d49875c6-5wzjs\" (UID: \"be69ab76-074d-4184-ba89-f833c5a6e662\") " pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:04:59.246646 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.246514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be69ab76-074d-4184-ba89-f833c5a6e662-cert\") pod \"kserve-controller-manager-85d49875c6-5wzjs\" (UID: \"be69ab76-074d-4184-ba89-f833c5a6e662\") " pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:04:59.284203 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.284170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:59.347797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.347720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be69ab76-074d-4184-ba89-f833c5a6e662-cert\") pod \"kserve-controller-manager-85d49875c6-5wzjs\" (UID: \"be69ab76-074d-4184-ba89-f833c5a6e662\") " pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:04:59.347959 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.347808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg5ld\" (UniqueName: \"kubernetes.io/projected/be69ab76-074d-4184-ba89-f833c5a6e662-kube-api-access-hg5ld\") pod \"kserve-controller-manager-85d49875c6-5wzjs\" (UID: \"be69ab76-074d-4184-ba89-f833c5a6e662\") " pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:04:59.350737 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.350711    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be69ab76-074d-4184-ba89-f833c5a6e662-cert\") pod \"kserve-controller-manager-85d49875c6-5wzjs\" (UID: \"be69ab76-074d-4184-ba89-f833c5a6e662\") " pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:04:59.393693 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.393642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v" event={"ID":"c362624c-24d8-4759-9ea0-8773a72f1c3c","Type":"ContainerStarted","Data":"3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8"}
Sep 08 14:04:59.394191 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.394171    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:04:59.396830 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.396497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8" event={"ID":"f56937cf-5625-422c-8796-28f1bd14a51d","Type":"ContainerStarted","Data":"00cd21c99826aa4f889689ef755089d7d6d4ba8bc52f6e05a7e71857d0c9b817"}
Sep 08 14:04:59.399026 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.399002    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq" event={"ID":"6b9662d3-1390-4eca-a3c3-82eb841865d9","Type":"ContainerStarted","Data":"518a6a9e11e426d6ba1a6130a9ce9c4050551c6a620122c0536bb3f1a6731671"}
Sep 08 14:04:59.405586 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.405561    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg5ld\" (UniqueName: \"kubernetes.io/projected/be69ab76-074d-4184-ba89-f833c5a6e662-kube-api-access-hg5ld\") pod \"kserve-controller-manager-85d49875c6-5wzjs\" (UID: \"be69ab76-074d-4184-ba89-f833c5a6e662\") " pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:04:59.453550 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.453510    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:04:59.466323 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.466297    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:04:59.479154 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.479105    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v" podStartSLOduration=1.830233725 podStartE2EDuration="3.479084347s" totalImagesPullingTime="1.648850622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:04:59.472031781 +0000 UTC m=+395.385936702" watchObservedRunningTime="2026-09-08 14:04:59.479084347 +0000 UTC m=+395.392989260"
Sep 08 14:04:59.763154 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.763121    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-5wzjs"]
Sep 08 14:04:59.765323 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:04:59.765293    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe69ab76_074d_4184_ba89_f833c5a6e662.slice/crio-0d19337292a172c127067505a1604d144191c688d1becd1919a29ccb7b0d3169 WatchSource:0}: Error finding container 0d19337292a172c127067505a1604d144191c688d1becd1919a29ccb7b0d3169: Status 404 returned error can't find the container with id 0d19337292a172c127067505a1604d144191c688d1becd1919a29ccb7b0d3169
Sep 08 14:04:59.815317 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.815287    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"]
Sep 08 14:04:59.820247 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.820220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:04:59.835115 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.835090    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"]
Sep 08 14:04:59.953049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.952996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:04:59.953049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.953043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc9cc562-5361-44c7-9774-c75feb686e82-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:04:59.953282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.953093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc9cc562-5361-44c7-9774-c75feb686e82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:04:59.953282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.953138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4cjl\" (UniqueName: \"kubernetes.io/projected/dc9cc562-5361-44c7-9774-c75feb686e82-kube-api-access-h4cjl\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:04:59.953282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.953170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:04:59.953282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.953217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:04:59.953282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:04:59.953261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc9cc562-5361-44c7-9774-c75feb686e82-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.054462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.054429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4cjl\" (UniqueName: \"kubernetes.io/projected/dc9cc562-5361-44c7-9774-c75feb686e82-kube-api-access-h4cjl\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.054749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.054468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.054749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.054516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.054749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.054579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc9cc562-5361-44c7-9774-c75feb686e82-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.054749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.054638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.054749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.054668    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc9cc562-5361-44c7-9774-c75feb686e82-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.054749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.054702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc9cc562-5361-44c7-9774-c75feb686e82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.055552 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.055460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc9cc562-5361-44c7-9774-c75feb686e82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.057650 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.057594    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc9cc562-5361-44c7-9774-c75feb686e82-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.057811 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.057795    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.057899 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.057835    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.057899 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.057851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc9cc562-5361-44c7-9774-c75feb686e82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.066795 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.066770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4cjl\" (UniqueName: \"kubernetes.io/projected/dc9cc562-5361-44c7-9774-c75feb686e82-kube-api-access-h4cjl\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.067297 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.067261    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc9cc562-5361-44c7-9774-c75feb686e82-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mb4nq\" (UID: \"dc9cc562-5361-44c7-9774-c75feb686e82\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.130328 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.130291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:00.411568 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.411482    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs" event={"ID":"be69ab76-074d-4184-ba89-f833c5a6e662","Type":"ContainerStarted","Data":"0d19337292a172c127067505a1604d144191c688d1becd1919a29ccb7b0d3169"}
Sep 08 14:05:00.447655 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.447604    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"]
Sep 08 14:05:00.463271 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.463225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:00.557906 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.557837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:00.571518 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:05:00.571484    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9cc562_5361_44c7_9774_c75feb686e82.slice/crio-a1b165682fe681f644123aa7b8519946e0fb1e1db99c71c990e73c9993c99af0 WatchSource:0}: Error finding container a1b165682fe681f644123aa7b8519946e0fb1e1db99c71c990e73c9993c99af0: Status 404 returned error can't find the container with id a1b165682fe681f644123aa7b8519946e0fb1e1db99c71c990e73c9993c99af0
Sep 08 14:05:00.574298 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.574264    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:05:00.574413 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.574330    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:05:00.660065 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.660033    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:00.756579 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.756519    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:00.868584 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:00.868544    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:01.420394 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.420239    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq" event={"ID":"6b9662d3-1390-4eca-a3c3-82eb841865d9","Type":"ContainerStarted","Data":"c1e912ad186450a3b58ccbcac2a7be1f8385cc0c228ad321d4b788d033074894"}
Sep 08 14:05:01.420394 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.420350    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:05:01.424048 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.423931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq" event={"ID":"dc9cc562-5361-44c7-9774-c75feb686e82","Type":"ContainerStarted","Data":"9cf570952d671813284cfd903736eb42a854b96172de141846f3aebc8efa08e1"}
Sep 08 14:05:01.424048 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.423975    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq" event={"ID":"dc9cc562-5361-44c7-9774-c75feb686e82","Type":"ContainerStarted","Data":"a1b165682fe681f644123aa7b8519946e0fb1e1db99c71c990e73c9993c99af0"}
Sep 08 14:05:01.424568 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.424521    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:01.426874 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.426545    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-mb4nq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:05:01.426874 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.426595    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq" podUID="dc9cc562-5361-44c7-9774-c75feb686e82" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:05:01.426874 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.426815    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8" event={"ID":"f56937cf-5625-422c-8796-28f1bd14a51d","Type":"ContainerStarted","Data":"10229d3b6e18a80d45383b5241988058f123c21535f394a624b09fa6f00acafa"}
Sep 08 14:05:01.427218 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.427163    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:05:01.457124 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.457024    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq" podStartSLOduration=2.25652744 podStartE2EDuration="4.457000153s" totalImagesPullingTime="2.200472713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:01.455728991 +0000 UTC m=+397.369633908" watchObservedRunningTime="2026-09-08 14:05:01.457000153 +0000 UTC m=+397.370905071"
Sep 08 14:05:01.495332 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.494353    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq" podStartSLOduration=2.494336111 podStartE2EDuration="2.494336111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:01.493829583 +0000 UTC m=+397.407734491" watchObservedRunningTime="2026-09-08 14:05:01.494336111 +0000 UTC m=+397.408241028"
Sep 08 14:05:01.521947 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:01.521861    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8" podStartSLOduration=2.626277095 podStartE2EDuration="4.521827112s" totalImagesPullingTime="1.895550017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:01.517511366 +0000 UTC m=+397.431416308" watchObservedRunningTime="2026-09-08 14:05:01.521827112 +0000 UTC m=+397.435732031"
Sep 08 14:05:02.433328 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:02.433274    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb4nq"
Sep 08 14:05:02.484946 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:02.484906    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"]
Sep 08 14:05:02.485189 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:02.485157    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx" podUID="4d2e55e9-4e11-4094-b707-7ddb079711c3" containerName="discovery" containerID="cri-o://5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac" gracePeriod=30
Sep 08 14:05:03.042181 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.042152    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:05:03.185887 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.185789    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e55e9-4e11-4094-b707-7ddb079711c3-local-certs\") pod \"4d2e55e9-4e11-4094-b707-7ddb079711c3\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") "
Sep 08 14:05:03.185887 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.185884    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdmvk\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-kube-api-access-bdmvk\") pod \"4d2e55e9-4e11-4094-b707-7ddb079711c3\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") "
Sep 08 14:05:03.186117 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.185916    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-kubeconfig\") pod \"4d2e55e9-4e11-4094-b707-7ddb079711c3\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") "
Sep 08 14:05:03.186117 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.185932    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-token\") pod \"4d2e55e9-4e11-4094-b707-7ddb079711c3\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") "
Sep 08 14:05:03.186117 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.185952    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-cacerts\") pod \"4d2e55e9-4e11-4094-b707-7ddb079711c3\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") "
Sep 08 14:05:03.186117 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.185991    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-ca-configmap\") pod \"4d2e55e9-4e11-4094-b707-7ddb079711c3\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") "
Sep 08 14:05:03.186295 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.186149    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-dns-cert\") pod \"4d2e55e9-4e11-4094-b707-7ddb079711c3\" (UID: \"4d2e55e9-4e11-4094-b707-7ddb079711c3\") "
Sep 08 14:05:03.186567 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.186403    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4d2e55e9-4e11-4094-b707-7ddb079711c3" (UID: "4d2e55e9-4e11-4094-b707-7ddb079711c3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:05:03.188538 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.188509    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2e55e9-4e11-4094-b707-7ddb079711c3-local-certs" (OuterVolumeSpecName: "local-certs") pod "4d2e55e9-4e11-4094-b707-7ddb079711c3" (UID: "4d2e55e9-4e11-4094-b707-7ddb079711c3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:05:03.188706 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.188686    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4d2e55e9-4e11-4094-b707-7ddb079711c3" (UID: "4d2e55e9-4e11-4094-b707-7ddb079711c3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:05:03.188882 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.188861    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-cacerts" (OuterVolumeSpecName: "cacerts") pod "4d2e55e9-4e11-4094-b707-7ddb079711c3" (UID: "4d2e55e9-4e11-4094-b707-7ddb079711c3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:05:03.188961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.188940    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4d2e55e9-4e11-4094-b707-7ddb079711c3" (UID: "4d2e55e9-4e11-4094-b707-7ddb079711c3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:05:03.189014 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.188995    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-kube-api-access-bdmvk" (OuterVolumeSpecName: "kube-api-access-bdmvk") pod "4d2e55e9-4e11-4094-b707-7ddb079711c3" (UID: "4d2e55e9-4e11-4094-b707-7ddb079711c3"). InnerVolumeSpecName "kube-api-access-bdmvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:05:03.189119 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.189100    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d2e55e9-4e11-4094-b707-7ddb079711c3" (UID: "4d2e55e9-4e11-4094-b707-7ddb079711c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:05:03.287372 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.287327    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdmvk\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-kube-api-access-bdmvk\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:03.287372 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.287363    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-kubeconfig\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:03.287372 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.287372    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-token\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:03.287372 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.287380    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-cacerts\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:03.287674 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.287388    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-ca-configmap\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:03.287674 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.287399    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d2e55e9-4e11-4094-b707-7ddb079711c3-istio-csr-dns-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:03.287674 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.287406    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e55e9-4e11-4094-b707-7ddb079711c3-local-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:03.440478 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.440381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs" event={"ID":"be69ab76-074d-4184-ba89-f833c5a6e662","Type":"ContainerStarted","Data":"a1e44a15893ca4c226170c0cd169a34f247763d0e523584f515542ca2a269d07"}
Sep 08 14:05:03.440668 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.440579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:05:03.441933 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.441902    2559 generic.go:356] "Generic (PLEG): container finished" podID="4d2e55e9-4e11-4094-b707-7ddb079711c3" containerID="5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac" exitCode=0
Sep 08 14:05:03.442060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.441933    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx" event={"ID":"4d2e55e9-4e11-4094-b707-7ddb079711c3","Type":"ContainerDied","Data":"5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac"}
Sep 08 14:05:03.442060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.441949    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"
Sep 08 14:05:03.442060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.441978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx" event={"ID":"4d2e55e9-4e11-4094-b707-7ddb079711c3","Type":"ContainerDied","Data":"47e894e165c5581b338378a4754ab99d38b0c7fe3c708ae44f5e55a1540a9dfc"}
Sep 08 14:05:03.442060 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.442005    2559 scope.go:117] "RemoveContainer" containerID="5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac"
Sep 08 14:05:03.451584 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.451567    2559 scope.go:117] "RemoveContainer" containerID="5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac"
Sep 08 14:05:03.451928 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:05:03.451909    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac\": container with ID starting with 5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac not found: ID does not exist" containerID="5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac"
Sep 08 14:05:03.451992 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.451939    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac"} err="failed to get container status \"5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac\": rpc error: code = NotFound desc = could not find container \"5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac\": container with ID starting with 5156d3034be7537a46af3a343dd51b55f30d293da2702c8a480c0b1f284bd2ac not found: ID does not exist"
Sep 08 14:05:03.455981 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.455850    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs" podStartSLOduration=1.272496237 podStartE2EDuration="4.455831557s" totalImagesPullingTime="3.18333532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:03.455689561 +0000 UTC m=+399.369594478" watchObservedRunningTime="2026-09-08 14:05:03.455831557 +0000 UTC m=+399.369736474"
Sep 08 14:05:03.472642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.472506    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"]
Sep 08 14:05:03.477965 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:03.477931    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5wwfx"]
Sep 08 14:05:04.581258 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:04.581224    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d2e55e9-4e11-4094-b707-7ddb079711c3" path="/var/lib/kubelet/pods/4d2e55e9-4e11-4094-b707-7ddb079711c3/volumes"
Sep 08 14:05:05.417377 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:05.417348    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:05:05.765802 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:05.765710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:06.011749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.011719    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rvw8g"]
Sep 08 14:05:06.012152 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.012130    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2e55e9-4e11-4094-b707-7ddb079711c3" containerName="discovery"
Sep 08 14:05:06.012152 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.012147    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2e55e9-4e11-4094-b707-7ddb079711c3" containerName="discovery"
Sep 08 14:05:06.012331 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.012199    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d2e55e9-4e11-4094-b707-7ddb079711c3" containerName="discovery"
Sep 08 14:05:06.016559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.016502    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g"
Sep 08 14:05:06.019030 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.019010    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sp9m6\""
Sep 08 14:05:06.022007 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.021987    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rvw8g"]
Sep 08 14:05:06.089216 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.089183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:06.108311 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.108271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srhd9\" (UniqueName: \"kubernetes.io/projected/0e72d739-e7aa-473b-b2e7-5688027cb41c-kube-api-access-srhd9\") pod \"authorino-5dc7ccb5f-rvw8g\" (UID: \"0e72d739-e7aa-473b-b2e7-5688027cb41c\") " pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g"
Sep 08 14:05:06.208929 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.208884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srhd9\" (UniqueName: \"kubernetes.io/projected/0e72d739-e7aa-473b-b2e7-5688027cb41c-kube-api-access-srhd9\") pod \"authorino-5dc7ccb5f-rvw8g\" (UID: \"0e72d739-e7aa-473b-b2e7-5688027cb41c\") " pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g"
Sep 08 14:05:06.218184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.218157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srhd9\" (UniqueName: \"kubernetes.io/projected/0e72d739-e7aa-473b-b2e7-5688027cb41c-kube-api-access-srhd9\") pod \"authorino-5dc7ccb5f-rvw8g\" (UID: \"0e72d739-e7aa-473b-b2e7-5688027cb41c\") " pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g"
Sep 08 14:05:06.278987 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.278899    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rvw8g"]
Sep 08 14:05:06.279183 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.279170    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g"
Sep 08 14:05:06.405714 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.405675    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-547db78699-6m8sk"]
Sep 08 14:05:06.410054 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.410031    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:05:06.412436 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.412414    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 08 14:05:06.419828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.419801    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-547db78699-6m8sk"]
Sep 08 14:05:06.510723 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.510688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf2q2\" (UniqueName: \"kubernetes.io/projected/2c73abc2-52a0-47c0-a8af-f44d5294f889-kube-api-access-tf2q2\") pod \"authorino-547db78699-6m8sk\" (UID: \"2c73abc2-52a0-47c0-a8af-f44d5294f889\") " pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:05:06.510872 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.510752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c73abc2-52a0-47c0-a8af-f44d5294f889-tls-cert\") pod \"authorino-547db78699-6m8sk\" (UID: \"2c73abc2-52a0-47c0-a8af-f44d5294f889\") " pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:05:06.555809 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.555769    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rvw8g"]
Sep 08 14:05:06.561541 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:05:06.561516    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e72d739_e7aa_473b_b2e7_5688027cb41c.slice/crio-6c0845a69fd64e2e5feb09c9819c30bbb379fa1b7e5250b19153a1960cb2bf93 WatchSource:0}: Error finding container 6c0845a69fd64e2e5feb09c9819c30bbb379fa1b7e5250b19153a1960cb2bf93: Status 404 returned error can't find the container with id 6c0845a69fd64e2e5feb09c9819c30bbb379fa1b7e5250b19153a1960cb2bf93
Sep 08 14:05:06.611625 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.611583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf2q2\" (UniqueName: \"kubernetes.io/projected/2c73abc2-52a0-47c0-a8af-f44d5294f889-kube-api-access-tf2q2\") pod \"authorino-547db78699-6m8sk\" (UID: \"2c73abc2-52a0-47c0-a8af-f44d5294f889\") " pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:05:06.611831 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.611695    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c73abc2-52a0-47c0-a8af-f44d5294f889-tls-cert\") pod \"authorino-547db78699-6m8sk\" (UID: \"2c73abc2-52a0-47c0-a8af-f44d5294f889\") " pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:05:06.614243 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.614212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c73abc2-52a0-47c0-a8af-f44d5294f889-tls-cert\") pod \"authorino-547db78699-6m8sk\" (UID: \"2c73abc2-52a0-47c0-a8af-f44d5294f889\") " pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:05:06.620395 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.620371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf2q2\" (UniqueName: \"kubernetes.io/projected/2c73abc2-52a0-47c0-a8af-f44d5294f889-kube-api-access-tf2q2\") pod \"authorino-547db78699-6m8sk\" (UID: \"2c73abc2-52a0-47c0-a8af-f44d5294f889\") " pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:05:06.721044 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.721007    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:05:06.994760 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:06.994733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-547db78699-6m8sk"]
Sep 08 14:05:06.997130 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:05:06.997106    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c73abc2_52a0_47c0_a8af_f44d5294f889.slice/crio-a624abb6a4c3be2298a20fdb4a06f8513b389f68e6ece87bfab12efc97fb4f78 WatchSource:0}: Error finding container a624abb6a4c3be2298a20fdb4a06f8513b389f68e6ece87bfab12efc97fb4f78: Status 404 returned error can't find the container with id a624abb6a4c3be2298a20fdb4a06f8513b389f68e6ece87bfab12efc97fb4f78
Sep 08 14:05:07.465317 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.465276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-547db78699-6m8sk" event={"ID":"2c73abc2-52a0-47c0-a8af-f44d5294f889","Type":"ContainerStarted","Data":"a624abb6a4c3be2298a20fdb4a06f8513b389f68e6ece87bfab12efc97fb4f78"}
Sep 08 14:05:07.466939 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.466908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g" event={"ID":"0e72d739-e7aa-473b-b2e7-5688027cb41c","Type":"ContainerStarted","Data":"39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef"}
Sep 08 14:05:07.467065 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.466952    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g" event={"ID":"0e72d739-e7aa-473b-b2e7-5688027cb41c","Type":"ContainerStarted","Data":"6c0845a69fd64e2e5feb09c9819c30bbb379fa1b7e5250b19153a1960cb2bf93"}
Sep 08 14:05:07.467065 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.467005    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g" podUID="0e72d739-e7aa-473b-b2e7-5688027cb41c" containerName="authorino" containerID="cri-o://39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef" gracePeriod=30
Sep 08 14:05:07.483714 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.483671    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g" podStartSLOduration=1.663075056 podStartE2EDuration="2.483655732s" totalImagesPullingTime="820.580676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:07.4833604 +0000 UTC m=+403.397265315" watchObservedRunningTime="2026-09-08 14:05:07.483655732 +0000 UTC m=+403.397560648"
Sep 08 14:05:07.727775 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.727752    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g"
Sep 08 14:05:07.819962 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.819932    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srhd9\" (UniqueName: \"kubernetes.io/projected/0e72d739-e7aa-473b-b2e7-5688027cb41c-kube-api-access-srhd9\") pod \"0e72d739-e7aa-473b-b2e7-5688027cb41c\" (UID: \"0e72d739-e7aa-473b-b2e7-5688027cb41c\") "
Sep 08 14:05:07.822226 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.822195    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e72d739-e7aa-473b-b2e7-5688027cb41c-kube-api-access-srhd9" (OuterVolumeSpecName: "kube-api-access-srhd9") pod "0e72d739-e7aa-473b-b2e7-5688027cb41c" (UID: "0e72d739-e7aa-473b-b2e7-5688027cb41c"). InnerVolumeSpecName "kube-api-access-srhd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:05:07.920600 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:07.920570    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srhd9\" (UniqueName: \"kubernetes.io/projected/0e72d739-e7aa-473b-b2e7-5688027cb41c-kube-api-access-srhd9\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:08.472687 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.472654    2559 generic.go:356] "Generic (PLEG): container finished" podID="0e72d739-e7aa-473b-b2e7-5688027cb41c" containerID="39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef" exitCode=2
Sep 08 14:05:08.473125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.472701    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g"
Sep 08 14:05:08.473125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.472739    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g" event={"ID":"0e72d739-e7aa-473b-b2e7-5688027cb41c","Type":"ContainerDied","Data":"39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef"}
Sep 08 14:05:08.473125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.472785    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-rvw8g" event={"ID":"0e72d739-e7aa-473b-b2e7-5688027cb41c","Type":"ContainerDied","Data":"6c0845a69fd64e2e5feb09c9819c30bbb379fa1b7e5250b19153a1960cb2bf93"}
Sep 08 14:05:08.473125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.472811    2559 scope.go:117] "RemoveContainer" containerID="39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef"
Sep 08 14:05:08.474648 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.474629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-547db78699-6m8sk" event={"ID":"2c73abc2-52a0-47c0-a8af-f44d5294f889","Type":"ContainerStarted","Data":"e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd"}
Sep 08 14:05:08.482546 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.482530    2559 scope.go:117] "RemoveContainer" containerID="39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef"
Sep 08 14:05:08.482814 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:05:08.482796    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef\": container with ID starting with 39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef not found: ID does not exist" containerID="39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef"
Sep 08 14:05:08.482866 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.482823    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef"} err="failed to get container status \"39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef\": rpc error: code = NotFound desc = could not find container \"39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef\": container with ID starting with 39a0dd4f53b027017fe67187138534fb9efe79e66d0286bac04ceefbccbceaef not found: ID does not exist"
Sep 08 14:05:08.492560 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.492516    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-547db78699-6m8sk" podStartSLOduration=1.6029990729999999 podStartE2EDuration="2.492503032s" totalImagesPullingTime="889.503959ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:05:08.492184998 +0000 UTC m=+404.406089915" watchObservedRunningTime="2026-09-08 14:05:08.492503032 +0000 UTC m=+404.406407949"
Sep 08 14:05:08.509633 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.509587    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rvw8g"]
Sep 08 14:05:08.515318 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.515288    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rvw8g"]
Sep 08 14:05:08.581992 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:08.581964    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e72d739-e7aa-473b-b2e7-5688027cb41c" path="/var/lib/kubelet/pods/0e72d739-e7aa-473b-b2e7-5688027cb41c/volumes"
Sep 08 14:05:10.740599 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:10.740567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:10.841814 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:10.841778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:12.434642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:12.434588    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d6cdq"
Sep 08 14:05:12.435073 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:12.434688    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q4wm8"
Sep 08 14:05:13.735572 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:13.735531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:13.842395 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:13.842365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:14.956135 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:14.956101    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-m965v"]
Sep 08 14:05:14.956555 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:14.956320    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v" podUID="c362624c-24d8-4759-9ea0-8773a72f1c3c" containerName="maas-api" containerID="cri-o://3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8" gracePeriod=30
Sep 08 14:05:15.205839 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.205804    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:05:15.277908 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.277813    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-maas-api-tls\") pod \"c362624c-24d8-4759-9ea0-8773a72f1c3c\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") "
Sep 08 14:05:15.277908 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.277865    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-metrics-certs\") pod \"c362624c-24d8-4759-9ea0-8773a72f1c3c\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") "
Sep 08 14:05:15.278135 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.277933    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c362624c-24d8-4759-9ea0-8773a72f1c3c-openshift-service-ca\") pod \"c362624c-24d8-4759-9ea0-8773a72f1c3c\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") "
Sep 08 14:05:15.278135 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.277957    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvmg5\" (UniqueName: \"kubernetes.io/projected/c362624c-24d8-4759-9ea0-8773a72f1c3c-kube-api-access-jvmg5\") pod \"c362624c-24d8-4759-9ea0-8773a72f1c3c\" (UID: \"c362624c-24d8-4759-9ea0-8773a72f1c3c\") "
Sep 08 14:05:15.278256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.278209    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c362624c-24d8-4759-9ea0-8773a72f1c3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c362624c-24d8-4759-9ea0-8773a72f1c3c" (UID: "c362624c-24d8-4759-9ea0-8773a72f1c3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:05:15.280275 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.280251    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c362624c-24d8-4759-9ea0-8773a72f1c3c-kube-api-access-jvmg5" (OuterVolumeSpecName: "kube-api-access-jvmg5") pod "c362624c-24d8-4759-9ea0-8773a72f1c3c" (UID: "c362624c-24d8-4759-9ea0-8773a72f1c3c"). InnerVolumeSpecName "kube-api-access-jvmg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:05:15.280382 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.280283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c362624c-24d8-4759-9ea0-8773a72f1c3c" (UID: "c362624c-24d8-4759-9ea0-8773a72f1c3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:05:15.280382 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.280299    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c362624c-24d8-4759-9ea0-8773a72f1c3c" (UID: "c362624c-24d8-4759-9ea0-8773a72f1c3c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:05:15.378953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.378914    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-metrics-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:15.378953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.378948    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c362624c-24d8-4759-9ea0-8773a72f1c3c-openshift-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:15.378953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.378960    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvmg5\" (UniqueName: \"kubernetes.io/projected/c362624c-24d8-4759-9ea0-8773a72f1c3c-kube-api-access-jvmg5\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:15.379190 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.378970    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c362624c-24d8-4759-9ea0-8773a72f1c3c-maas-api-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:15.510325 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.510291    2559 generic.go:356] "Generic (PLEG): container finished" podID="c362624c-24d8-4759-9ea0-8773a72f1c3c" containerID="3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8" exitCode=0
Sep 08 14:05:15.510517 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.510332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v" event={"ID":"c362624c-24d8-4759-9ea0-8773a72f1c3c","Type":"ContainerDied","Data":"3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8"}
Sep 08 14:05:15.510517 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.510339    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v"
Sep 08 14:05:15.510517 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.510369    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768897d8b6-m965v" event={"ID":"c362624c-24d8-4759-9ea0-8773a72f1c3c","Type":"ContainerDied","Data":"17dba28cf487486b843c82621050160e5b86e443396d324d9471fdd3de63430f"}
Sep 08 14:05:15.510517 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.510392    2559 scope.go:117] "RemoveContainer" containerID="3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8"
Sep 08 14:05:15.520017 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.520001    2559 scope.go:117] "RemoveContainer" containerID="3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8"
Sep 08 14:05:15.520289 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:05:15.520271    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8\": container with ID starting with 3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8 not found: ID does not exist" containerID="3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8"
Sep 08 14:05:15.520327 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.520296    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8"} err="failed to get container status \"3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8\": rpc error: code = NotFound desc = could not find container \"3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8\": container with ID starting with 3fd7d951623a9bfb53715166d7c18c7515baeb749367b9d000b36bea81b898a8 not found: ID does not exist"
Sep 08 14:05:15.533675 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.533652    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-m965v"]
Sep 08 14:05:15.536411 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:15.536388    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-m965v"]
Sep 08 14:05:16.586247 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:16.586211    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c362624c-24d8-4759-9ea0-8773a72f1c3c" path="/var/lib/kubelet/pods/c362624c-24d8-4759-9ea0-8773a72f1c3c/volumes"
Sep 08 14:05:25.023391 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:25.023304    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8d899f97d-z7q2z"]
Sep 08 14:05:25.144838 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:25.144802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:25.245124 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:25.245084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:25.305048 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:25.305009    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:34.454044 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:34.454006    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-85d49875c6-5wzjs"
Sep 08 14:05:39.080207 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:39.080170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:05:50.044229 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.044117    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8d899f97d-z7q2z" podUID="e8e1fd83-c671-4852-92c1-f4f3fb1b8035" containerName="console" containerID="cri-o://3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f" gracePeriod=15
Sep 08 14:05:50.295839 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.295778    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:05:50.378290 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-serving-cert\") pod \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") "
Sep 08 14:05:50.378480 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378309    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-config\") pod \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") "
Sep 08 14:05:50.378480 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378335    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-service-ca\") pod \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") "
Sep 08 14:05:50.378480 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378379    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-oauth-serving-cert\") pod \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") "
Sep 08 14:05:50.378480 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378409    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9rzk\" (UniqueName: \"kubernetes.io/projected/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-kube-api-access-c9rzk\") pod \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") "
Sep 08 14:05:50.378480 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378461    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-trusted-ca-bundle\") pod \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") "
Sep 08 14:05:50.378782 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378486    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-oauth-config\") pod \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\" (UID: \"e8e1fd83-c671-4852-92c1-f4f3fb1b8035\") "
Sep 08 14:05:50.378870 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378839    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8e1fd83-c671-4852-92c1-f4f3fb1b8035" (UID: "e8e1fd83-c671-4852-92c1-f4f3fb1b8035"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:05:50.378963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378775    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-config" (OuterVolumeSpecName: "console-config") pod "e8e1fd83-c671-4852-92c1-f4f3fb1b8035" (UID: "e8e1fd83-c671-4852-92c1-f4f3fb1b8035"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:05:50.378963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.378903    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8e1fd83-c671-4852-92c1-f4f3fb1b8035" (UID: "e8e1fd83-c671-4852-92c1-f4f3fb1b8035"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:05:50.379048 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.379005    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8e1fd83-c671-4852-92c1-f4f3fb1b8035" (UID: "e8e1fd83-c671-4852-92c1-f4f3fb1b8035"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:05:50.380762 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.380734    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8e1fd83-c671-4852-92c1-f4f3fb1b8035" (UID: "e8e1fd83-c671-4852-92c1-f4f3fb1b8035"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:05:50.380864 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.380829    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-kube-api-access-c9rzk" (OuterVolumeSpecName: "kube-api-access-c9rzk") pod "e8e1fd83-c671-4852-92c1-f4f3fb1b8035" (UID: "e8e1fd83-c671-4852-92c1-f4f3fb1b8035"). InnerVolumeSpecName "kube-api-access-c9rzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:05:50.380907 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.380899    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8e1fd83-c671-4852-92c1-f4f3fb1b8035" (UID: "e8e1fd83-c671-4852-92c1-f4f3fb1b8035"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:05:50.479208 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.479153    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9rzk\" (UniqueName: \"kubernetes.io/projected/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-kube-api-access-c9rzk\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:50.479208 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.479201    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-trusted-ca-bundle\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:50.479208 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.479212    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-oauth-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:50.479208 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.479222    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-serving-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:50.479498 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.479233    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-console-config\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:50.479498 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.479242    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:50.479498 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.479250    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8e1fd83-c671-4852-92c1-f4f3fb1b8035-oauth-serving-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:05:50.671629 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.671577    2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e1fd83-c671-4852-92c1-f4f3fb1b8035" containerID="3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f" exitCode=0
Sep 08 14:05:50.671797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.671657    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d899f97d-z7q2z"
Sep 08 14:05:50.671797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.671665    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d899f97d-z7q2z" event={"ID":"e8e1fd83-c671-4852-92c1-f4f3fb1b8035","Type":"ContainerDied","Data":"3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f"}
Sep 08 14:05:50.671797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.671720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d899f97d-z7q2z" event={"ID":"e8e1fd83-c671-4852-92c1-f4f3fb1b8035","Type":"ContainerDied","Data":"328d6524c052d6676f94f034f86be94504c068a7d0ca11c8e569ba62ab485ac2"}
Sep 08 14:05:50.671797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.671742    2559 scope.go:117] "RemoveContainer" containerID="3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f"
Sep 08 14:05:50.680516 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.680492    2559 scope.go:117] "RemoveContainer" containerID="3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f"
Sep 08 14:05:50.680876 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:05:50.680853    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f\": container with ID starting with 3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f not found: ID does not exist" containerID="3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f"
Sep 08 14:05:50.680962 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.680888    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f"} err="failed to get container status \"3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f\": rpc error: code = NotFound desc = could not find container \"3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f\": container with ID starting with 3f156733792e2eda13ef206dce7579f9cb355b532aa8b5186f65275fc265523f not found: ID does not exist"
Sep 08 14:05:50.689035 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.689007    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8d899f97d-z7q2z"]
Sep 08 14:05:50.692961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:50.692930    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8d899f97d-z7q2z"]
Sep 08 14:05:52.581919 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:05:52.581882    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e1fd83-c671-4852-92c1-f4f3fb1b8035" path="/var/lib/kubelet/pods/e8e1fd83-c671-4852-92c1-f4f3fb1b8035/volumes"
Sep 08 14:06:08.498059 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:08.498019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:06:09.909974 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:09.909937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:06:10.011222 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:10.011167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:06:18.280648 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:18.280587    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:06:28.784483 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784443    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"]
Sep 08 14:06:28.784886 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784799    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e72d739-e7aa-473b-b2e7-5688027cb41c" containerName="authorino"
Sep 08 14:06:28.784886 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784810    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e72d739-e7aa-473b-b2e7-5688027cb41c" containerName="authorino"
Sep 08 14:06:28.784886 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784818    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c362624c-24d8-4759-9ea0-8773a72f1c3c" containerName="maas-api"
Sep 08 14:06:28.784886 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784824    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c362624c-24d8-4759-9ea0-8773a72f1c3c" containerName="maas-api"
Sep 08 14:06:28.784886 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784836    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e1fd83-c671-4852-92c1-f4f3fb1b8035" containerName="console"
Sep 08 14:06:28.784886 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784842    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e1fd83-c671-4852-92c1-f4f3fb1b8035" containerName="console"
Sep 08 14:06:28.785084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784893    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c362624c-24d8-4759-9ea0-8773a72f1c3c" containerName="maas-api"
Sep 08 14:06:28.785084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784903    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e1fd83-c671-4852-92c1-f4f3fb1b8035" containerName="console"
Sep 08 14:06:28.785084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.784909    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e72d739-e7aa-473b-b2e7-5688027cb41c" containerName="authorino"
Sep 08 14:06:28.789136 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.789112    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.792370 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.792342    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b2v2m\""
Sep 08 14:06:28.792514 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.792454    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 14:06:28.792514 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.792456    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 08 14:06:28.792758 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.792743    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 14:06:28.798294 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.798270    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"]
Sep 08 14:06:28.880650 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.880586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:06:28.892670 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.892632    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.892852 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.892682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.892852 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.892726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.892852 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.892746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.892852 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.892766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.893002 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.892842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lwrc\" (UniqueName: \"kubernetes.io/projected/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-kube-api-access-5lwrc\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994005 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.993959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994005 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.994011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994262 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.994054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lwrc\" (UniqueName: \"kubernetes.io/projected/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-kube-api-access-5lwrc\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994262 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.994116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994262 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.994154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994262 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.994184    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994483 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.994460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994547 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.994504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.994693 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.994675    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.996593 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.996571    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:28.996870 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:28.996853    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:29.004171 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:29.004147    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lwrc\" (UniqueName: \"kubernetes.io/projected/1fe8e3e3-326a-4b0c-92d4-9416418f7e35-kube-api-access-5lwrc\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r\" (UID: \"1fe8e3e3-326a-4b0c-92d4-9416418f7e35\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:29.100686 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:29.100563    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:29.378466 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:29.378395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"]
Sep 08 14:06:29.380950 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:06:29.380924    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe8e3e3_326a_4b0c_92d4_9416418f7e35.slice/crio-91461cdd74834b88000904a66c68f30eba665ec0620ed71c94578d742157c478 WatchSource:0}: Error finding container 91461cdd74834b88000904a66c68f30eba665ec0620ed71c94578d742157c478: Status 404 returned error can't find the container with id 91461cdd74834b88000904a66c68f30eba665ec0620ed71c94578d742157c478
Sep 08 14:06:29.856926 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:29.856888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r" event={"ID":"1fe8e3e3-326a-4b0c-92d4-9416418f7e35","Type":"ContainerStarted","Data":"91461cdd74834b88000904a66c68f30eba665ec0620ed71c94578d742157c478"}
Sep 08 14:06:30.864431 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:30.864397    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r" event={"ID":"1fe8e3e3-326a-4b0c-92d4-9416418f7e35","Type":"ContainerStarted","Data":"5fa6a896e3bd9fef65e4096b47d4c095137984ef6daa4f227ea853e0cc246ba5"}
Sep 08 14:06:30.882524 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:30.882466    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r" podStartSLOduration=1.801077118 podStartE2EDuration="2.882447726s" totalImagesPullingTime="1.081370608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:06:30.882118222 +0000 UTC m=+486.796023142" watchObservedRunningTime="2026-09-08 14:06:30.882447726 +0000 UTC m=+486.796352641"
Sep 08 14:06:31.101528 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:31.101481    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:39.101334 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.101294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:39.114062 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.114029    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:39.588864 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.588822    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"]
Sep 08 14:06:39.592496 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.592470    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.595207 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.595184    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 14:06:39.602276 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.602246    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"]
Sep 08 14:06:39.628887 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.628843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:06:39.687759 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.687722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.687759 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.687761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.687983 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.687800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.687983 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.687822    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwctm\" (UniqueName: \"kubernetes.io/projected/985cef9a-f9c1-4309-8804-bb8f22d9fc68-kube-api-access-bwctm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.687983 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.687856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/985cef9a-f9c1-4309-8804-bb8f22d9fc68-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.687983 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.687919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.788958 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.788914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.788958 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.788955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwctm\" (UniqueName: \"kubernetes.io/projected/985cef9a-f9c1-4309-8804-bb8f22d9fc68-kube-api-access-bwctm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.789190 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.789080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/985cef9a-f9c1-4309-8804-bb8f22d9fc68-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.789190 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.789124    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.789273 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.789251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.789327 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.789308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.789395 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.789313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.789466 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.789450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.789554 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.789527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.791590 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.791563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/985cef9a-f9c1-4309-8804-bb8f22d9fc68-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.791837 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.791821    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/985cef9a-f9c1-4309-8804-bb8f22d9fc68-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.799711 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.799691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwctm\" (UniqueName: \"kubernetes.io/projected/985cef9a-f9c1-4309-8804-bb8f22d9fc68-kube-api-access-bwctm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-wfsq2\" (UID: \"985cef9a-f9c1-4309-8804-bb8f22d9fc68\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.904962 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.904872    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:39.916690 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:39.916667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r"
Sep 08 14:06:40.185085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:40.185060    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"]
Sep 08 14:06:40.187035 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:06:40.187011    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985cef9a_f9c1_4309_8804_bb8f22d9fc68.slice/crio-a89dcef071840fc94616c276e3d0a60aff815287e08273e5127eba75d340a979 WatchSource:0}: Error finding container a89dcef071840fc94616c276e3d0a60aff815287e08273e5127eba75d340a979: Status 404 returned error can't find the container with id a89dcef071840fc94616c276e3d0a60aff815287e08273e5127eba75d340a979
Sep 08 14:06:40.912742 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:40.912709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2" event={"ID":"985cef9a-f9c1-4309-8804-bb8f22d9fc68","Type":"ContainerStarted","Data":"95df84f01c416d549dd66dec65636bdf1635d11924b1a7afabce5d626b11bfbc"}
Sep 08 14:06:40.912954 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:40.912767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2" event={"ID":"985cef9a-f9c1-4309-8804-bb8f22d9fc68","Type":"ContainerStarted","Data":"a89dcef071840fc94616c276e3d0a60aff815287e08273e5127eba75d340a979"}
Sep 08 14:06:40.937167 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:40.937109    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2" podStartSLOduration=1.697980958 podStartE2EDuration="1.937088161s" totalImagesPullingTime="239.107203ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:06:40.934445521 +0000 UTC m=+496.848350438" watchObservedRunningTime="2026-09-08 14:06:40.937088161 +0000 UTC m=+496.850993239"
Sep 08 14:06:41.905559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:41.905505    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:49.101744 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:49.101699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:06:49.905701 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:49.905650    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:49.918209 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:49.918176    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:49.967011 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:49.966983    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-wfsq2"
Sep 08 14:06:58.730475 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:06:58.730437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:07:02.981234 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:02.981191    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:07:23.686583 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.686497    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"]
Sep 08 14:07:23.689846 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.689827    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.692463 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.692427    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 08 14:07:23.700968 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.700942    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"]
Sep 08 14:07:23.761829 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.761795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.762041 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.761843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.762041 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.761870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69788ba-04fb-4eae-a341-0e58bb9e6111-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.762041 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.761953    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.762041 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.761974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9x7t\" (UniqueName: \"kubernetes.io/projected/d69788ba-04fb-4eae-a341-0e58bb9e6111-kube-api-access-t9x7t\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.762041 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.762015    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.792920 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.792880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:07:23.863025 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.862989    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.863257 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.863046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.863257 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.863157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69788ba-04fb-4eae-a341-0e58bb9e6111-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.863257 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.863219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.863511 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.863339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9x7t\" (UniqueName: \"kubernetes.io/projected/d69788ba-04fb-4eae-a341-0e58bb9e6111-kube-api-access-t9x7t\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.863511 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.863418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.863511 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.863482    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.863511 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.863505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.863734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.863717    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.865693 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.865674    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69788ba-04fb-4eae-a341-0e58bb9e6111-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.866098 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.866075    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69788ba-04fb-4eae-a341-0e58bb9e6111-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:23.872171 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:23.872144    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9x7t\" (UniqueName: \"kubernetes.io/projected/d69788ba-04fb-4eae-a341-0e58bb9e6111-kube-api-access-t9x7t\") pod \"facebook-opt-125m-simulated-kserve-89945f574-dpjbr\" (UID: \"d69788ba-04fb-4eae-a341-0e58bb9e6111\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:24.001295 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:24.001181    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:24.279720 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:24.279690    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"]
Sep 08 14:07:24.281823 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:07:24.281797    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69788ba_04fb_4eae_a341_0e58bb9e6111.slice/crio-060ac1d58f9e32d7bf8a8d5c619bfcd2deb5e87db1ffc067fc0ebc445df91e91 WatchSource:0}: Error finding container 060ac1d58f9e32d7bf8a8d5c619bfcd2deb5e87db1ffc067fc0ebc445df91e91: Status 404 returned error can't find the container with id 060ac1d58f9e32d7bf8a8d5c619bfcd2deb5e87db1ffc067fc0ebc445df91e91
Sep 08 14:07:25.131092 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:25.131057    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr" event={"ID":"d69788ba-04fb-4eae-a341-0e58bb9e6111","Type":"ContainerStarted","Data":"148159777b1a1867242900225b1f01993758edc02b5bbc6de7ea1600c957eec6"}
Sep 08 14:07:25.131497 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:25.131145    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr" event={"ID":"d69788ba-04fb-4eae-a341-0e58bb9e6111","Type":"ContainerStarted","Data":"060ac1d58f9e32d7bf8a8d5c619bfcd2deb5e87db1ffc067fc0ebc445df91e91"}
Sep 08 14:07:25.149888 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:25.149831    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr" podStartSLOduration=1.909391634 podStartE2EDuration="2.149813971s" totalImagesPullingTime="240.422337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:07:25.149091475 +0000 UTC m=+541.062996397" watchObservedRunningTime="2026-09-08 14:07:25.149813971 +0000 UTC m=+541.063718954"
Sep 08 14:07:26.001647 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:26.001590    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:34.002153 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:34.002112    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:34.014860 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:34.014828    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:07:34.184705 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:07:34.184676    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-dpjbr"
Sep 08 14:08:05.803679 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:08:05.803640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:08:18.643654 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:08:18.643600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:08:18.747404 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:08:18.747367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:08:33.747445 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:08:33.747392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:08:33.835182 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:08:33.835144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:02.238268 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.238180    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-547db78699-6m8sk"]
Sep 08 14:09:02.238845 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.238414    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-547db78699-6m8sk" podUID="2c73abc2-52a0-47c0-a8af-f44d5294f889" containerName="authorino" containerID="cri-o://e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd" gracePeriod=30
Sep 08 14:09:02.487827 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.487802    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:09:02.534814 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.534782    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c73abc2-52a0-47c0-a8af-f44d5294f889-tls-cert\") pod \"2c73abc2-52a0-47c0-a8af-f44d5294f889\" (UID: \"2c73abc2-52a0-47c0-a8af-f44d5294f889\") "
Sep 08 14:09:02.534988 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.534855    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf2q2\" (UniqueName: \"kubernetes.io/projected/2c73abc2-52a0-47c0-a8af-f44d5294f889-kube-api-access-tf2q2\") pod \"2c73abc2-52a0-47c0-a8af-f44d5294f889\" (UID: \"2c73abc2-52a0-47c0-a8af-f44d5294f889\") "
Sep 08 14:09:02.536935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.536904    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c73abc2-52a0-47c0-a8af-f44d5294f889-kube-api-access-tf2q2" (OuterVolumeSpecName: "kube-api-access-tf2q2") pod "2c73abc2-52a0-47c0-a8af-f44d5294f889" (UID: "2c73abc2-52a0-47c0-a8af-f44d5294f889"). InnerVolumeSpecName "kube-api-access-tf2q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:09:02.544728 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.544704    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c73abc2-52a0-47c0-a8af-f44d5294f889-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2c73abc2-52a0-47c0-a8af-f44d5294f889" (UID: "2c73abc2-52a0-47c0-a8af-f44d5294f889"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:09:02.610036 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.609997    2559 generic.go:356] "Generic (PLEG): container finished" podID="2c73abc2-52a0-47c0-a8af-f44d5294f889" containerID="e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd" exitCode=0
Sep 08 14:09:02.610184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.610054    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-547db78699-6m8sk"
Sep 08 14:09:02.610184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.610086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-547db78699-6m8sk" event={"ID":"2c73abc2-52a0-47c0-a8af-f44d5294f889","Type":"ContainerDied","Data":"e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd"}
Sep 08 14:09:02.610184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.610129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-547db78699-6m8sk" event={"ID":"2c73abc2-52a0-47c0-a8af-f44d5294f889","Type":"ContainerDied","Data":"a624abb6a4c3be2298a20fdb4a06f8513b389f68e6ece87bfab12efc97fb4f78"}
Sep 08 14:09:02.610184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.610147    2559 scope.go:117] "RemoveContainer" containerID="e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd"
Sep 08 14:09:02.619472 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.619453    2559 scope.go:117] "RemoveContainer" containerID="e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd"
Sep 08 14:09:02.619806 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:09:02.619786    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd\": container with ID starting with e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd not found: ID does not exist" containerID="e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd"
Sep 08 14:09:02.619893 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.619815    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd"} err="failed to get container status \"e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd\": rpc error: code = NotFound desc = could not find container \"e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd\": container with ID starting with e889675907b07922b5acc393a9f2e1d363727d95187fcd1d3b4c6891356ec4fd not found: ID does not exist"
Sep 08 14:09:02.627070 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.627046    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-547db78699-6m8sk"]
Sep 08 14:09:02.631129 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.631107    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-547db78699-6m8sk"]
Sep 08 14:09:02.635703 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.635683    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c73abc2-52a0-47c0-a8af-f44d5294f889-tls-cert\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:09:02.635770 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.635706    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf2q2\" (UniqueName: \"kubernetes.io/projected/2c73abc2-52a0-47c0-a8af-f44d5294f889-kube-api-access-tf2q2\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:09:02.780172 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.780135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:02.876458 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:02.876368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:04.007978 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:04.007937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:04.106139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:04.106089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:04.581121 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:04.581091    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c73abc2-52a0-47c0-a8af-f44d5294f889" path="/var/lib/kubelet/pods/2c73abc2-52a0-47c0-a8af-f44d5294f889/volumes"
Sep 08 14:09:20.052717 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:20.052681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:21.485836 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.485805    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:21.904600 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.904558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:21.919143 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.919112    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:21.919494 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.919481    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c73abc2-52a0-47c0-a8af-f44d5294f889" containerName="authorino"
Sep 08 14:09:21.919536 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.919495    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c73abc2-52a0-47c0-a8af-f44d5294f889" containerName="authorino"
Sep 08 14:09:21.919571 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.919554    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c73abc2-52a0-47c0-a8af-f44d5294f889" containerName="authorino"
Sep 08 14:09:21.922405 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.922388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:21.927842 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.927816    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6shtd\""
Sep 08 14:09:21.931260 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.931236    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:21.999425 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:21.999388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmvkj\" (UniqueName: \"kubernetes.io/projected/1d899cc2-f06e-4624-9212-77030b87ee81-kube-api-access-dmvkj\") pod \"test-curl-5874-140412760297008\" (UID: \"1d899cc2-f06e-4624-9212-77030b87ee81\") " pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:22.100859 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:22.100822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvkj\" (UniqueName: \"kubernetes.io/projected/1d899cc2-f06e-4624-9212-77030b87ee81-kube-api-access-dmvkj\") pod \"test-curl-5874-140412760297008\" (UID: \"1d899cc2-f06e-4624-9212-77030b87ee81\") " pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:22.110577 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:22.110544    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmvkj\" (UniqueName: \"kubernetes.io/projected/1d899cc2-f06e-4624-9212-77030b87ee81-kube-api-access-dmvkj\") pod \"test-curl-5874-140412760297008\" (UID: \"1d899cc2-f06e-4624-9212-77030b87ee81\") " pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:22.232225 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:22.232131    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:22.520337 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:22.520170    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:22.522864 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:22.522838    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d899cc2_f06e_4624_9212_77030b87ee81.slice/crio-77714c7f8c8d56d43414acaf107f193dd31f3fbae09b48c1786354752bbbd3b7 WatchSource:0}: Error finding container 77714c7f8c8d56d43414acaf107f193dd31f3fbae09b48c1786354752bbbd3b7: Status 404 returned error can't find the container with id 77714c7f8c8d56d43414acaf107f193dd31f3fbae09b48c1786354752bbbd3b7
Sep 08 14:09:22.524513 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:22.524498    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:09:22.713864 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:22.713832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5874-140412760297008" event={"ID":"1d899cc2-f06e-4624-9212-77030b87ee81","Type":"ContainerStarted","Data":"77714c7f8c8d56d43414acaf107f193dd31f3fbae09b48c1786354752bbbd3b7"}
Sep 08 14:09:23.721203 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:23.721104    2559 generic.go:356] "Generic (PLEG): container finished" podID="1d899cc2-f06e-4624-9212-77030b87ee81" containerID="90bb7d2dcb61b8f64f8c39d0ead581969822ac1c6c6f8c53e84d65d4b4ba0aff" exitCode=0
Sep 08 14:09:23.721203 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:23.721169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5874-140412760297008" event={"ID":"1d899cc2-f06e-4624-9212-77030b87ee81","Type":"ContainerDied","Data":"90bb7d2dcb61b8f64f8c39d0ead581969822ac1c6c6f8c53e84d65d4b4ba0aff"}
Sep 08 14:09:24.866715 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:24.866564    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:24.912533 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:24.912501    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-5874-140412760297008_1d899cc2-f06e-4624-9212-77030b87ee81/test-curl-5874-140412760297008/0.log"
Sep 08 14:09:24.924126 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:24.924079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmvkj\" (UniqueName: \"kubernetes.io/projected/1d899cc2-f06e-4624-9212-77030b87ee81-kube-api-access-dmvkj\") pod \"1d899cc2-f06e-4624-9212-77030b87ee81\" (UID: \"1d899cc2-f06e-4624-9212-77030b87ee81\") "
Sep 08 14:09:24.926423 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:24.926392    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d899cc2-f06e-4624-9212-77030b87ee81-kube-api-access-dmvkj" (OuterVolumeSpecName: "kube-api-access-dmvkj") pod "1d899cc2-f06e-4624-9212-77030b87ee81" (UID: "1d899cc2-f06e-4624-9212-77030b87ee81"). InnerVolumeSpecName "kube-api-access-dmvkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:09:24.993763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:24.993728    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:24.998427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:24.998400    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:25.025248 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.025211    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmvkj\" (UniqueName: \"kubernetes.io/projected/1d899cc2-f06e-4624-9212-77030b87ee81-kube-api-access-dmvkj\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:09:25.147681 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.147569    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:25.147933 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.147920    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d899cc2-f06e-4624-9212-77030b87ee81" containerName="test-curl-5874-140412760297008"
Sep 08 14:09:25.147979 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.147935    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d899cc2-f06e-4624-9212-77030b87ee81" containerName="test-curl-5874-140412760297008"
Sep 08 14:09:25.148025 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.148016    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d899cc2-f06e-4624-9212-77030b87ee81" containerName="test-curl-5874-140412760297008"
Sep 08 14:09:25.150960 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.150945    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:25.168080 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.168041    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:25.226532 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.226500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkhr2\" (UniqueName: \"kubernetes.io/projected/4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb-kube-api-access-kkhr2\") pod \"test-curl-5874-140412760297008\" (UID: \"4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb\") " pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:25.327907 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.327876    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkhr2\" (UniqueName: \"kubernetes.io/projected/4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb-kube-api-access-kkhr2\") pod \"test-curl-5874-140412760297008\" (UID: \"4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb\") " pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:25.359494 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.359463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkhr2\" (UniqueName: \"kubernetes.io/projected/4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb-kube-api-access-kkhr2\") pod \"test-curl-5874-140412760297008\" (UID: \"4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb\") " pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:25.460139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.460048    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:25.733184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.733111    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:25.733326 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.733107    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77714c7f8c8d56d43414acaf107f193dd31f3fbae09b48c1786354752bbbd3b7"
Sep 08 14:09:25.747350 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.747326    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:25.749191 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:25.749165    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b2b2147_272b_4f94_9dfc_ddeb2b4a91eb.slice/crio-31c58392a47dce49b66bc7202a020c356a4773e33b284b51799e5470e1db1e70 WatchSource:0}: Error finding container 31c58392a47dce49b66bc7202a020c356a4773e33b284b51799e5470e1db1e70: Status 404 returned error can't find the container with id 31c58392a47dce49b66bc7202a020c356a4773e33b284b51799e5470e1db1e70
Sep 08 14:09:25.754326 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:25.754296    2559 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-5874-140412760297008" oldPodUID="1d899cc2-f06e-4624-9212-77030b87ee81" podUID="4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb"
Sep 08 14:09:26.091905 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:26.091869    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:26.310524 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:26.310466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:26.581824 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:26.581785    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d899cc2-f06e-4624-9212-77030b87ee81" path="/var/lib/kubelet/pods/1d899cc2-f06e-4624-9212-77030b87ee81/volumes"
Sep 08 14:09:26.739066 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:26.739028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5874-140412760297008" event={"ID":"4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb","Type":"ContainerStarted","Data":"1e10cc2240576a0b9c17629b9718ea8b17b714e735fc89e5f33bb949138bbfd4"}
Sep 08 14:09:26.739066 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:26.739068    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5874-140412760297008" event={"ID":"4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb","Type":"ContainerStarted","Data":"31c58392a47dce49b66bc7202a020c356a4773e33b284b51799e5470e1db1e70"}
Sep 08 14:09:26.818471 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:26.818415    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-5874-140412760297008" podStartSLOduration=0.945993813 podStartE2EDuration="1.818395371s" totalImagesPullingTime="872.401558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:26.81657229 +0000 UTC m=+662.730477206" watchObservedRunningTime="2026-09-08 14:09:26.818395371 +0000 UTC m=+662.732300287"
Sep 08 14:09:27.046263 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.046214    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-5874-140412760297008_4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb/test-curl-5874-140412760297008/0.log"
Sep 08 14:09:27.508812 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.508728    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"]
Sep 08 14:09:27.512118 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.512097    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.514539 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.514517    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:09:27.514776 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.514762    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-cb068d-serving-cert\""
Sep 08 14:09:27.514889 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.514869    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:09:27.515131 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.515118    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:09:27.515196 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.515182    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2nwq2\""
Sep 08 14:09:27.524644 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.524603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:27.532669 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.532644    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"]
Sep 08 14:09:27.623365 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.623324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:27.649388 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.649354    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.649577 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.649422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc6xk\" (UniqueName: \"kubernetes.io/projected/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-kube-api-access-cc6xk\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.649577 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.649506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-maas-api-tls\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.649577 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.649548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-metrics-certs\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.730425 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.730392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:27.745903 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.745866    2559 generic.go:356] "Generic (PLEG): container finished" podID="4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb" containerID="1e10cc2240576a0b9c17629b9718ea8b17b714e735fc89e5f33bb949138bbfd4" exitCode=0
Sep 08 14:09:27.746072 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.745923    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5874-140412760297008" event={"ID":"4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb","Type":"ContainerDied","Data":"1e10cc2240576a0b9c17629b9718ea8b17b714e735fc89e5f33bb949138bbfd4"}
Sep 08 14:09:27.750027 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.750005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc6xk\" (UniqueName: \"kubernetes.io/projected/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-kube-api-access-cc6xk\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.750145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.750052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-maas-api-tls\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.750145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.750077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-metrics-certs\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.750145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.750108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.750764 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.750742    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.752797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.752776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-metrics-certs\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.752894 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.752829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-maas-api-tls\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.762103 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.762044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc6xk\" (UniqueName: \"kubernetes.io/projected/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-kube-api-access-cc6xk\") pod \"maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:27.823590 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:27.823548    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:28.110523 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.110482    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"]
Sep 08 14:09:28.112995 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:28.112963    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c176bc3_eaaf_4e54_8d09_139fb32c8f55.slice/crio-58d61dd2490ad324d37391e804169884473a753162ec9ff00bd94e26c7065952 WatchSource:0}: Error finding container 58d61dd2490ad324d37391e804169884473a753162ec9ff00bd94e26c7065952: Status 404 returned error can't find the container with id 58d61dd2490ad324d37391e804169884473a753162ec9ff00bd94e26c7065952
Sep 08 14:09:28.174396 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.174357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:28.321343 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.321310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:28.446148 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.446062    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"]
Sep 08 14:09:28.450699 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.450674    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:28.457066 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.457042    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-cb068d\""
Sep 08 14:09:28.484655 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.484585    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"]
Sep 08 14:09:28.536603 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.536569    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"]
Sep 08 14:09:28.539925 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.539902    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:28.543044 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.543025    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-cb068d-dockercfg-5h4rf\""
Sep 08 14:09:28.555209 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.555182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlpvf\" (UniqueName: \"kubernetes.io/projected/75152985-dc1a-4eb4-935c-997f7e23eb19-kube-api-access-hlpvf\") pod \"payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp\" (UID: \"75152985-dc1a-4eb4-935c-997f7e23eb19\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:28.555344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.555256    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75152985-dc1a-4eb4-935c-997f7e23eb19-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp\" (UID: \"75152985-dc1a-4eb4-935c-997f7e23eb19\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:28.560604 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.560576    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"]
Sep 08 14:09:28.655918 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.655880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nghz\" (UniqueName: \"kubernetes.io/projected/63842712-ec37-4b69-bfdb-803d31ef6213-kube-api-access-5nghz\") pod \"payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn\" (UID: \"63842712-ec37-4b69-bfdb-803d31ef6213\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:28.656123 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.655935    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlpvf\" (UniqueName: \"kubernetes.io/projected/75152985-dc1a-4eb4-935c-997f7e23eb19-kube-api-access-hlpvf\") pod \"payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp\" (UID: \"75152985-dc1a-4eb4-935c-997f7e23eb19\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:28.662146 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.656654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63842712-ec37-4b69-bfdb-803d31ef6213-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn\" (UID: \"63842712-ec37-4b69-bfdb-803d31ef6213\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:28.662146 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.656762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75152985-dc1a-4eb4-935c-997f7e23eb19-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp\" (UID: \"75152985-dc1a-4eb4-935c-997f7e23eb19\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:28.662146 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.657596    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75152985-dc1a-4eb4-935c-997f7e23eb19-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp\" (UID: \"75152985-dc1a-4eb4-935c-997f7e23eb19\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:28.669288 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.669262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlpvf\" (UniqueName: \"kubernetes.io/projected/75152985-dc1a-4eb4-935c-997f7e23eb19-kube-api-access-hlpvf\") pod \"payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp\" (UID: \"75152985-dc1a-4eb4-935c-997f7e23eb19\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:28.753284 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.753202    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp" event={"ID":"7c176bc3-eaaf-4e54-8d09-139fb32c8f55","Type":"ContainerStarted","Data":"58d61dd2490ad324d37391e804169884473a753162ec9ff00bd94e26c7065952"}
Sep 08 14:09:28.757903 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.757865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nghz\" (UniqueName: \"kubernetes.io/projected/63842712-ec37-4b69-bfdb-803d31ef6213-kube-api-access-5nghz\") pod \"payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn\" (UID: \"63842712-ec37-4b69-bfdb-803d31ef6213\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:28.758030 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.757909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63842712-ec37-4b69-bfdb-803d31ef6213-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn\" (UID: \"63842712-ec37-4b69-bfdb-803d31ef6213\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:28.758556 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.758536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63842712-ec37-4b69-bfdb-803d31ef6213-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn\" (UID: \"63842712-ec37-4b69-bfdb-803d31ef6213\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:28.760715 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.760683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:28.767877 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.767848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nghz\" (UniqueName: \"kubernetes.io/projected/63842712-ec37-4b69-bfdb-803d31ef6213-kube-api-access-5nghz\") pod \"payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn\" (UID: \"63842712-ec37-4b69-bfdb-803d31ef6213\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:28.850056 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.850021    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:28.903560 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.903484    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:28.959226 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.959173    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkhr2\" (UniqueName: \"kubernetes.io/projected/4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb-kube-api-access-kkhr2\") pod \"4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb\" (UID: \"4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb\") "
Sep 08 14:09:28.961678 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.961650    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:28.961806 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.961695    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb-kube-api-access-kkhr2" (OuterVolumeSpecName: "kube-api-access-kkhr2") pod "4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb" (UID: "4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb"). InnerVolumeSpecName "kube-api-access-kkhr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:09:28.967189 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:28.967163    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-5874-140412760297008"]
Sep 08 14:09:29.060196 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.060166    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkhr2\" (UniqueName: \"kubernetes.io/projected/4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb-kube-api-access-kkhr2\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:09:29.064726 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.064650    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"]
Sep 08 14:09:29.067008 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:29.066981    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75152985_dc1a_4eb4_935c_997f7e23eb19.slice/crio-4608ec5c27362531097d6c8054e51673a859ff772beb5be7083e07a17f96424e WatchSource:0}: Error finding container 4608ec5c27362531097d6c8054e51673a859ff772beb5be7083e07a17f96424e: Status 404 returned error can't find the container with id 4608ec5c27362531097d6c8054e51673a859ff772beb5be7083e07a17f96424e
Sep 08 14:09:29.151210 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.151181    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"]
Sep 08 14:09:29.153821 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:29.153782    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63842712_ec37_4b69_bfdb_803d31ef6213.slice/crio-71fa52b98768aa7668ef2abb90f196c303e61c06a85c19c0b4ad256a6619fd30 WatchSource:0}: Error finding container 71fa52b98768aa7668ef2abb90f196c303e61c06a85c19c0b4ad256a6619fd30: Status 404 returned error can't find the container with id 71fa52b98768aa7668ef2abb90f196c303e61c06a85c19c0b4ad256a6619fd30
Sep 08 14:09:29.509184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.509086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:29.760390 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.760270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp" event={"ID":"7c176bc3-eaaf-4e54-8d09-139fb32c8f55","Type":"ContainerStarted","Data":"2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c"}
Sep 08 14:09:29.760802 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.760421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:29.761952 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.761925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn" event={"ID":"63842712-ec37-4b69-bfdb-803d31ef6213","Type":"ContainerStarted","Data":"c50e7b98426bdc3342a421ca087d751b41337cecd202c476e89e89840c939ba3"}
Sep 08 14:09:29.762067 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.761970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn" event={"ID":"63842712-ec37-4b69-bfdb-803d31ef6213","Type":"ContainerStarted","Data":"71fa52b98768aa7668ef2abb90f196c303e61c06a85c19c0b4ad256a6619fd30"}
Sep 08 14:09:29.762067 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.761996    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:29.763372 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.763350    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31c58392a47dce49b66bc7202a020c356a4773e33b284b51799e5470e1db1e70"
Sep 08 14:09:29.763372 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.763368    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:29.765426 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.765404    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp" event={"ID":"75152985-dc1a-4eb4-935c-997f7e23eb19","Type":"ContainerStarted","Data":"6b4aa84cc46a1aae15f68d2fac5b60abc159d3e523e32e95da31b63d1226909f"}
Sep 08 14:09:29.765534 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.765443    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp" event={"ID":"75152985-dc1a-4eb4-935c-997f7e23eb19","Type":"ContainerStarted","Data":"4608ec5c27362531097d6c8054e51673a859ff772beb5be7083e07a17f96424e"}
Sep 08 14:09:29.765782 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.765738    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:29.793744 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.793689    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp" podStartSLOduration=2.123869719 podStartE2EDuration="2.793672474s" totalImagesPullingTime="669.802755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:29.792030556 +0000 UTC m=+665.705935475" watchObservedRunningTime="2026-09-08 14:09:29.793672474 +0000 UTC m=+665.707577390"
Sep 08 14:09:29.824285 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.824232    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn" podStartSLOduration=1.824212199 podStartE2EDuration="1.824212199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:29.823282392 +0000 UTC m=+665.737187310" watchObservedRunningTime="2026-09-08 14:09:29.824212199 +0000 UTC m=+665.738117134"
Sep 08 14:09:29.853982 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.853930    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp" podStartSLOduration=1.853911968 podStartE2EDuration="1.853911968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:29.852907417 +0000 UTC m=+665.766812332" watchObservedRunningTime="2026-09-08 14:09:29.853911968 +0000 UTC m=+665.767816881"
Sep 08 14:09:29.857270 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:09:29.857239    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-5874-140412760297008\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" podUID="4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb" pod="opendatahub/test-curl-5874-140412760297008"
Sep 08 14:09:29.892042 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:29.891996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:30.054901 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:30.054863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:30.582522 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:30.582490    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb" path="/var/lib/kubelet/pods/4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb/volumes"
Sep 08 14:09:30.947935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:30.947851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:31.020326 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:31.020292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:31.180790 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:31.180759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:31.519315 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:31.519273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:31.784437 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:31.784405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:33.347346 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:33.347309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:33.437493 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:33.437458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:33.797796 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:33.797749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:33.917679 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:33.917640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:34.497748 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.497715    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"]
Sep 08 14:09:34.498657 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.498284    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb" containerName="test-curl-5874-140412760297008"
Sep 08 14:09:34.498657 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.498307    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb" containerName="test-curl-5874-140412760297008"
Sep 08 14:09:34.498657 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.498445    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b2b2147-272b-4f94-9dfc-ddeb2b4a91eb" containerName="test-curl-5874-140412760297008"
Sep 08 14:09:34.503084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.503061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.506084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.506062    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-41383d-serving-cert\""
Sep 08 14:09:34.515882 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.515856    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"]
Sep 08 14:09:34.554376 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.554340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:34.612517 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.612479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vbxk\" (UniqueName: \"kubernetes.io/projected/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-kube-api-access-7vbxk\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.612720 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.612520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-metrics-certs\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.612720 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.612662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.612720 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.612711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-openshift-service-ca\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.658434 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.658400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:34.713317 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.713282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.713512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.713337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-openshift-service-ca\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.713512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.713382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vbxk\" (UniqueName: \"kubernetes.io/projected/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-kube-api-access-7vbxk\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.713512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.713407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-metrics-certs\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.713512 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:09:34.713433    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-41383d-serving-cert: secret "maas-api-e2e-autores-41383d-serving-cert" not found
Sep 08 14:09:34.713512 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:09:34.713502    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls podName:9df2a8dd-2119-4c01-92e5-d83796e5bdd6 nodeName:}" failed. No retries permitted until 2026-09-08 14:09:35.213482038 +0000 UTC m=+671.127386951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls") pod "maas-api-e2e-autores-41383d-c8b76fd47-zzn6x" (UID: "9df2a8dd-2119-4c01-92e5-d83796e5bdd6") : secret "maas-api-e2e-autores-41383d-serving-cert" not found
Sep 08 14:09:34.714074 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.714055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-openshift-service-ca\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.716050 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.716032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-metrics-certs\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:34.724289 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:34.724267    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vbxk\" (UniqueName: \"kubernetes.io/projected/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-kube-api-access-7vbxk\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:35.219829 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.219775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:35.222363 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.222339    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls\") pod \"maas-api-e2e-autores-41383d-c8b76fd47-zzn6x\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:35.414361 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.414327    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:35.536688 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.536655    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"]
Sep 08 14:09:35.541218 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.541197    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:35.545524 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.545506    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-41383d\""
Sep 08 14:09:35.545642 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.545506    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-41383d-dockercfg-6q4kj\""
Sep 08 14:09:35.553405 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.553382    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"]
Sep 08 14:09:35.623084 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.623047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q27b\" (UniqueName: \"kubernetes.io/projected/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-kube-api-access-8q27b\") pod \"payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4\" (UID: \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\") " pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:35.623284 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.623102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-plugins-config-volume\") pod \"payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4\" (UID: \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\") " pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:35.706975 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.706942    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"]
Sep 08 14:09:35.711966 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:35.711940    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df2a8dd_2119_4c01_92e5_d83796e5bdd6.slice/crio-7f1546dea6791ddb14eaf1b7eb629d9053b6d95dab9de22d5e73e8bae5fc172c WatchSource:0}: Error finding container 7f1546dea6791ddb14eaf1b7eb629d9053b6d95dab9de22d5e73e8bae5fc172c: Status 404 returned error can't find the container with id 7f1546dea6791ddb14eaf1b7eb629d9053b6d95dab9de22d5e73e8bae5fc172c
Sep 08 14:09:35.723999 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.723975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q27b\" (UniqueName: \"kubernetes.io/projected/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-kube-api-access-8q27b\") pod \"payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4\" (UID: \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\") " pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:35.724110 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.724016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-plugins-config-volume\") pod \"payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4\" (UID: \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\") " pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:35.724740 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.724722    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-plugins-config-volume\") pod \"payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4\" (UID: \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\") " pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:35.737876 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.737849    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q27b\" (UniqueName: \"kubernetes.io/projected/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-kube-api-access-8q27b\") pod \"payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4\" (UID: \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\") " pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:35.775942 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.775913    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:09:35.796826 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.796731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x" event={"ID":"9df2a8dd-2119-4c01-92e5-d83796e5bdd6","Type":"ContainerStarted","Data":"7f1546dea6791ddb14eaf1b7eb629d9053b6d95dab9de22d5e73e8bae5fc172c"}
Sep 08 14:09:35.852022 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:35.851985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:36.137747 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:36.137721    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"]
Sep 08 14:09:36.139325 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:36.139297    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afe33ba_ec18_4d59_aaa6_2a2f440d97dd.slice/crio-575d1ab18404289214aca5f4300e076ca95240296e2cc8cf019cb3d5746b747b WatchSource:0}: Error finding container 575d1ab18404289214aca5f4300e076ca95240296e2cc8cf019cb3d5746b747b: Status 404 returned error can't find the container with id 575d1ab18404289214aca5f4300e076ca95240296e2cc8cf019cb3d5746b747b
Sep 08 14:09:36.761169 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:36.761107    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:36.804136 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:36.804103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4" event={"ID":"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd","Type":"ContainerStarted","Data":"23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198"}
Sep 08 14:09:36.804340 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:36.804167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4" event={"ID":"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd","Type":"ContainerStarted","Data":"575d1ab18404289214aca5f4300e076ca95240296e2cc8cf019cb3d5746b747b"}
Sep 08 14:09:36.804340 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:36.804228    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:36.825582 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:36.825524    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4" podStartSLOduration=1.825504496 podStartE2EDuration="1.825504496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:36.824078084 +0000 UTC m=+672.737983000" watchObservedRunningTime="2026-09-08 14:09:36.825504496 +0000 UTC m=+672.739409414"
Sep 08 14:09:36.853943 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:36.853907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:37.525156 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:37.525120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:37.811247 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:37.811214    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x" event={"ID":"9df2a8dd-2119-4c01-92e5-d83796e5bdd6","Type":"ContainerStarted","Data":"8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919"}
Sep 08 14:09:37.833709 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:37.833659    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x" podStartSLOduration=1.8295927010000002 podStartE2EDuration="3.833640306s" totalImagesPullingTime="2.004047605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:37.832466461 +0000 UTC m=+673.746371377" watchObservedRunningTime="2026-09-08 14:09:37.833640306 +0000 UTC m=+673.747545223"
Sep 08 14:09:38.226147 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:38.226054    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:38.816415 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:38.816378    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:40.772449 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:40.772421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:09:40.772935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:40.772490    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:09:41.152767 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:41.152735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:41.315548 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:41.315518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:41.455759 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:41.455668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:41.556869 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:41.556837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:44.245186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:44.245144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:44.827451 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:44.827425    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:09:46.056057 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:46.056012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:47.813129 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:47.813101    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:09:49.120235 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:49.120193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:50.971897 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:50.971863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:51.237292 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:51.237215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:51.591082 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:51.591048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:52.093255 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:52.093221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:55.025553 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:55.025518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:55.137765 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:55.137729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:55.766258 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:55.766223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:56.484426 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.484392    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"]
Sep 08 14:09:56.488438 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.488417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.491146 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.491125    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-94eadd-serving-cert\""
Sep 08 14:09:56.502733 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.502710    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"]
Sep 08 14:09:56.523468 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.523446    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-metrics-certs\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.523559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.523496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlqb8\" (UniqueName: \"kubernetes.io/projected/4d0e4968-6085-4819-b9b4-f0387a722e31-kube-api-access-qlqb8\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.523601 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.523564    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.523601 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.523586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0e4968-6085-4819-b9b4-f0387a722e31-openshift-service-ca\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.624092 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.624061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-metrics-certs\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.624267 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.624111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlqb8\" (UniqueName: \"kubernetes.io/projected/4d0e4968-6085-4819-b9b4-f0387a722e31-kube-api-access-qlqb8\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.624267 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.624148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.624267 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.624164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0e4968-6085-4819-b9b4-f0387a722e31-openshift-service-ca\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.624426 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:09:56.624285    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-serving-cert: secret "maas-api-e2e-inf-b-94eadd-serving-cert" not found
Sep 08 14:09:56.624426 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:09:56.624349    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls podName:4d0e4968-6085-4819-b9b4-f0387a722e31 nodeName:}" failed. No retries permitted until 2026-09-08 14:09:57.124329459 +0000 UTC m=+693.038234355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls") pod "maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl" (UID: "4d0e4968-6085-4819-b9b4-f0387a722e31") : secret "maas-api-e2e-inf-b-94eadd-serving-cert" not found
Sep 08 14:09:56.624923 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.624901    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0e4968-6085-4819-b9b4-f0387a722e31-openshift-service-ca\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.626708 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.626679    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-metrics-certs\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:56.640271 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:56.640239    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlqb8\" (UniqueName: \"kubernetes.io/projected/4d0e4968-6085-4819-b9b4-f0387a722e31-kube-api-access-qlqb8\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:57.129507 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.129475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:57.132018 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.131989    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls\") pod \"maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:57.182333 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.182309    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"]
Sep 08 14:09:57.186071 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.186053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.188599 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.188566    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-94eadd\""
Sep 08 14:09:57.188751 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.188675    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-94eadd-dockercfg-xzgl7\""
Sep 08 14:09:57.197916 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.197867    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"]
Sep 08 14:09:57.230223 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.230192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz\" (UID: \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.230367 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.230256    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6kl\" (UniqueName: \"kubernetes.io/projected/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-kube-api-access-6v6kl\") pod \"payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz\" (UID: \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.330743 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.330710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz\" (UID: \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.330897 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.330762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6kl\" (UniqueName: \"kubernetes.io/projected/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-kube-api-access-6v6kl\") pod \"payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz\" (UID: \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.331409 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.331389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz\" (UID: \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.339474 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.339452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6kl\" (UniqueName: \"kubernetes.io/projected/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-kube-api-access-6v6kl\") pod \"payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz\" (UID: \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.399382 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.399308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:57.497721 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.497510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.671395 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.671372    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"]
Sep 08 14:09:57.673423 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:57.673396    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0e4968_6085_4819_b9b4_f0387a722e31.slice/crio-eafbe1e5dd01cba821fc811975580496993137f8c534fe91541c5a5884413c5d WatchSource:0}: Error finding container eafbe1e5dd01cba821fc811975580496993137f8c534fe91541c5a5884413c5d: Status 404 returned error can't find the container with id eafbe1e5dd01cba821fc811975580496993137f8c534fe91541c5a5884413c5d
Sep 08 14:09:57.769455 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.769432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"]
Sep 08 14:09:57.771309 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:09:57.771284    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a0f87b_2cd3_483c_ad8c_c1311a3f0676.slice/crio-3662a305d7bb9f3c421922c87ac09dbd0668fb1fb6aa880a9ffe4b4bc3952a7c WatchSource:0}: Error finding container 3662a305d7bb9f3c421922c87ac09dbd0668fb1fb6aa880a9ffe4b4bc3952a7c: Status 404 returned error can't find the container with id 3662a305d7bb9f3c421922c87ac09dbd0668fb1fb6aa880a9ffe4b4bc3952a7c
Sep 08 14:09:57.922150 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.922055    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz" event={"ID":"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676","Type":"ContainerStarted","Data":"d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749"}
Sep 08 14:09:57.922150 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.922120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz" event={"ID":"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676","Type":"ContainerStarted","Data":"3662a305d7bb9f3c421922c87ac09dbd0668fb1fb6aa880a9ffe4b4bc3952a7c"}
Sep 08 14:09:57.922375 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.922202    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:09:57.923514 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.923480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl" event={"ID":"4d0e4968-6085-4819-b9b4-f0387a722e31","Type":"ContainerStarted","Data":"eafbe1e5dd01cba821fc811975580496993137f8c534fe91541c5a5884413c5d"}
Sep 08 14:09:57.940796 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:57.940753    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz" podStartSLOduration=0.940739802 podStartE2EDuration="940.739802ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:57.938954077 +0000 UTC m=+693.852858994" watchObservedRunningTime="2026-09-08 14:09:57.940739802 +0000 UTC m=+693.854644719"
Sep 08 14:09:58.040283 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:58.040260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:58.124498 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:58.124465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:58.274452 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:58.274366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:58.375295 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:58.375258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:58.933218 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:58.933187    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl" event={"ID":"4d0e4968-6085-4819-b9b4-f0387a722e31","Type":"ContainerStarted","Data":"8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23"}
Sep 08 14:09:58.933861 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:58.933835    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:09:58.951730 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:58.951687    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl" podStartSLOduration=2.6210706459999997 podStartE2EDuration="2.951668056s" totalImagesPullingTime="330.59741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:09:58.951267822 +0000 UTC m=+694.865172737" watchObservedRunningTime="2026-09-08 14:09:58.951668056 +0000 UTC m=+694.865572974"
Sep 08 14:09:59.211429 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:59.211329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:09:59.927260 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:09:59.927215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:02.973461 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:02.973422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:03.130716 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:03.130682    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:03.259302 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:03.259229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:04.944585 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:04.944558    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:10:06.726560 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:06.726519    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:08.934996 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:08.934969    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:10:10.181969 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:10.181931    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:10.282037 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:10.282004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:10.388867 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:10.388839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:10.526867 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:10.526785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:15.543214 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:15.543178    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:15.634331 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:15.634300    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:15.737215 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:15.737135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:15.840800 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:15.840713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:15.970179 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:15.970144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:16.351155 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:16.351123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:16.446270 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:16.446230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:18.027022 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:18.026967    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:18.127507 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:18.127476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:18.303327 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:18.303290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:18.405079 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:18.405043    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:19.756063 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:19.756025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:19.857787 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:19.857748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:19.958014 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:19.957983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:20.058015 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:20.057980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:20.162305 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:20.162276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:20.568995 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:20.568946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:20.669336 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:20.669305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:21.359092 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:21.359053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:22.304552 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:22.304523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:44.380154 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:44.380117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:50.619386 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:50.619343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:50.695661 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:50.695575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:50.762712 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:50.762676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:50.829959 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:50.829913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:50.910458 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:50.910379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:51.007679 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:51.007643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:51.472019 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:51.471989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:51.805631 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:51.805571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:51.950316 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:51.950278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:54.643153 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:54.643113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:54.740935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:54.740904    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:55.540972 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:55.540938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:55.643953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:55.643912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:55.938997 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:55.938914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:56.207460 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:56.207363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:10:56.547175 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:10:56.547133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:26.107912 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:26.107876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:26.254595 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:26.254562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:26.355258 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:26.355209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:26.438597 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:26.438514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:26.530743 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:26.530714    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:27.696170 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:27.696124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:28.111782 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:28.111747    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:28.625557 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:28.625524    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:28.749003 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:28.748970    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:31.123537 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:31.123498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:31.241148 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:31.241117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:32.475253 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:32.475218    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:33.108986 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:33.108954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:33.207091 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:33.207060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:37.426593 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:37.426550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:11:48.084479 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:11:48.084395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:00.754472 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:00.754430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:03.111942 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:03.111897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:03.212685 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:03.212644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:03.373399 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:03.373303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:03.452265 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:03.452230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:03.696054 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:03.695961    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:04.254817 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:04.254783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:04.356982 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:04.356941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:04.453593 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:04.453560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:05.777210 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:05.777177    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:11.306731 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:11.306696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:12.210156 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:12.210122    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:12.316995 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:12.316957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:12.416678 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:12.416649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:12.511473 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:12.511391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:12.892528 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:12.892498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:13.312363 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:13.312330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:23.632172 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.632129    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"]
Sep 08 14:12:23.632757 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.632340    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x" podUID="9df2a8dd-2119-4c01-92e5-d83796e5bdd6" containerName="maas-api" containerID="cri-o://8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919" gracePeriod=30
Sep 08 14:12:23.672498 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.672464    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:23.690107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.690079    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"]
Sep 08 14:12:23.690300 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.690277    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4" podUID="8afe33ba-ec18-4d59-aaa6-2a2f440d97dd" containerName="payload-processing" containerID="cri-o://23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198" gracePeriod=30
Sep 08 14:12:23.774992 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.774955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:23.874417 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.874386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:23.954751 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.954728    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:12:23.982698 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.982665    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:23.988858 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:23.988839    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:12:24.036360 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036325    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-metrics-certs\") pod \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") "
Sep 08 14:12:24.036528 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036373    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-openshift-service-ca\") pod \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") "
Sep 08 14:12:24.036528 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036423    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vbxk\" (UniqueName: \"kubernetes.io/projected/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-kube-api-access-7vbxk\") pod \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") "
Sep 08 14:12:24.036528 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-plugins-config-volume\") pod \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\" (UID: \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\") "
Sep 08 14:12:24.036528 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q27b\" (UniqueName: \"kubernetes.io/projected/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-kube-api-access-8q27b\") pod \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\" (UID: \"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd\") "
Sep 08 14:12:24.036771 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036627    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls\") pod \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\" (UID: \"9df2a8dd-2119-4c01-92e5-d83796e5bdd6\") "
Sep 08 14:12:24.036876 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036849    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9df2a8dd-2119-4c01-92e5-d83796e5bdd6" (UID: "9df2a8dd-2119-4c01-92e5-d83796e5bdd6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:12:24.036941 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036873    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8afe33ba-ec18-4d59-aaa6-2a2f440d97dd" (UID: "8afe33ba-ec18-4d59-aaa6-2a2f440d97dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:12:24.036998 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036966    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:12:24.036998 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.036981    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-openshift-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:12:24.038743 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.038716    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9df2a8dd-2119-4c01-92e5-d83796e5bdd6" (UID: "9df2a8dd-2119-4c01-92e5-d83796e5bdd6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:12:24.038856 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.038838    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9df2a8dd-2119-4c01-92e5-d83796e5bdd6" (UID: "9df2a8dd-2119-4c01-92e5-d83796e5bdd6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:12:24.039216 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.039195    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-kube-api-access-8q27b" (OuterVolumeSpecName: "kube-api-access-8q27b") pod "8afe33ba-ec18-4d59-aaa6-2a2f440d97dd" (UID: "8afe33ba-ec18-4d59-aaa6-2a2f440d97dd"). InnerVolumeSpecName "kube-api-access-8q27b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:12:24.039294 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.039228    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-kube-api-access-7vbxk" (OuterVolumeSpecName: "kube-api-access-7vbxk") pod "9df2a8dd-2119-4c01-92e5-d83796e5bdd6" (UID: "9df2a8dd-2119-4c01-92e5-d83796e5bdd6"). InnerVolumeSpecName "kube-api-access-7vbxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:12:24.138317 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.138288    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vbxk\" (UniqueName: \"kubernetes.io/projected/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-kube-api-access-7vbxk\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:12:24.138317 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.138315    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q27b\" (UniqueName: \"kubernetes.io/projected/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd-kube-api-access-8q27b\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:12:24.138317 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.138325    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-maas-api-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:12:24.138531 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.138333    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df2a8dd-2119-4c01-92e5-d83796e5bdd6-metrics-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:12:24.278740 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.278661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:24.688753 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.688719    2559 generic.go:356] "Generic (PLEG): container finished" podID="8afe33ba-ec18-4d59-aaa6-2a2f440d97dd" containerID="23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198" exitCode=0
Sep 08 14:12:24.689173 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.688775    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"
Sep 08 14:12:24.689173 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.688811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4" event={"ID":"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd","Type":"ContainerDied","Data":"23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198"}
Sep 08 14:12:24.689173 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.688888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4" event={"ID":"8afe33ba-ec18-4d59-aaa6-2a2f440d97dd","Type":"ContainerDied","Data":"575d1ab18404289214aca5f4300e076ca95240296e2cc8cf019cb3d5746b747b"}
Sep 08 14:12:24.689173 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.688918    2559 scope.go:117] "RemoveContainer" containerID="23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198"
Sep 08 14:12:24.690195 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.690173    2559 generic.go:356] "Generic (PLEG): container finished" podID="9df2a8dd-2119-4c01-92e5-d83796e5bdd6" containerID="8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919" exitCode=0
Sep 08 14:12:24.690290 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.690204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x" event={"ID":"9df2a8dd-2119-4c01-92e5-d83796e5bdd6","Type":"ContainerDied","Data":"8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919"}
Sep 08 14:12:24.690290 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.690235    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"
Sep 08 14:12:24.690290 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.690255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x" event={"ID":"9df2a8dd-2119-4c01-92e5-d83796e5bdd6","Type":"ContainerDied","Data":"7f1546dea6791ddb14eaf1b7eb629d9053b6d95dab9de22d5e73e8bae5fc172c"}
Sep 08 14:12:24.698028 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.698011    2559 scope.go:117] "RemoveContainer" containerID="23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198"
Sep 08 14:12:24.698296 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:12:24.698279    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198\": container with ID starting with 23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198 not found: ID does not exist" containerID="23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198"
Sep 08 14:12:24.698350 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.698303    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198"} err="failed to get container status \"23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198\": rpc error: code = NotFound desc = could not find container \"23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198\": container with ID starting with 23ce494d24f721c9c98fb3e6432283b7d6ed805f183abb93b78e0ffe0cc9f198 not found: ID does not exist"
Sep 08 14:12:24.698350 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.698318    2559 scope.go:117] "RemoveContainer" containerID="8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919"
Sep 08 14:12:24.707573 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.707552    2559 scope.go:117] "RemoveContainer" containerID="8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919"
Sep 08 14:12:24.708030 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:12:24.708002    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919\": container with ID starting with 8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919 not found: ID does not exist" containerID="8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919"
Sep 08 14:12:24.708120 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.708055    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919"} err="failed to get container status \"8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919\": rpc error: code = NotFound desc = could not find container \"8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919\": container with ID starting with 8b536436e896c75e4b81f4f361191eb77284e65b0ebc72ae9d242330fa088919 not found: ID does not exist"
Sep 08 14:12:24.710667 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.710646    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"]
Sep 08 14:12:24.719870 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.719851    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-41383d-b8bdbdf8c-xpqb4"]
Sep 08 14:12:24.729814 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.729794    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"]
Sep 08 14:12:24.733713 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:24.733689    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-41383d-c8b76fd47-zzn6x"]
Sep 08 14:12:26.581574 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:26.581543    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8afe33ba-ec18-4d59-aaa6-2a2f440d97dd" path="/var/lib/kubelet/pods/8afe33ba-ec18-4d59-aaa6-2a2f440d97dd/volumes"
Sep 08 14:12:26.582009 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:26.581993    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df2a8dd-2119-4c01-92e5-d83796e5bdd6" path="/var/lib/kubelet/pods/9df2a8dd-2119-4c01-92e5-d83796e5bdd6/volumes"
Sep 08 14:12:29.356019 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:29.355983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:29.684460 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:29.684367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:38.860476 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:38.860423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:38.989664 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:38.989629    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:43.501529 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:43.501456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:45.127221 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:45.127189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:46.453779 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:46.453741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:12:46.555709 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:12:46.555676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:00.645848 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:00.645767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:01.324109 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:01.324077    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:05.808090 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:05.808055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:06.993599 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:06.993560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:07.248138 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:07.248054    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:07.697743 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:07.697694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:08.044953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:08.044914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:08.147262 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:08.147225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:08.258444 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:08.258405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:08.401236 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:08.401149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:09.751679 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:09.751636    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:11.250145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:11.250099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:11.418039 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:11.418002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:12.374764 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.374729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:12.453114 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.453075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:12.552828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.552779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:12.865267 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.865233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:12.936341 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.936304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:12.981379 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.981340    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"]
Sep 08 14:13:12.981765 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.981752    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2a8dd-2119-4c01-92e5-d83796e5bdd6" containerName="maas-api"
Sep 08 14:13:12.981817 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.981767    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2a8dd-2119-4c01-92e5-d83796e5bdd6" containerName="maas-api"
Sep 08 14:13:12.981817 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.981787    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8afe33ba-ec18-4d59-aaa6-2a2f440d97dd" containerName="payload-processing"
Sep 08 14:13:12.981817 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.981793    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8afe33ba-ec18-4d59-aaa6-2a2f440d97dd" containerName="payload-processing"
Sep 08 14:13:12.981929 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.981861    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df2a8dd-2119-4c01-92e5-d83796e5bdd6" containerName="maas-api"
Sep 08 14:13:12.981929 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.981870    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8afe33ba-ec18-4d59-aaa6-2a2f440d97dd" containerName="payload-processing"
Sep 08 14:13:12.985082 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.985066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:12.988791 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.988762    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-3b812d\""
Sep 08 14:13:12.988914 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.988835    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-3b812d-dockercfg-74d8n\""
Sep 08 14:13:12.999734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:12.999706    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"]
Sep 08 14:13:13.002547 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.002524    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"]
Sep 08 14:13:13.007268 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.007245    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.017055 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.016767    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"]
Sep 08 14:13:13.059901 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.059873    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3b812d-b66684789-v6krc\" (UID: \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\") " pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.060057 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.059936    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a66989-013f-4884-842d-b5ed4cbc749e-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h\" (UID: \"c2a66989-013f-4884-842d-b5ed4cbc749e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:13.060057 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.060006    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6vbs\" (UniqueName: \"kubernetes.io/projected/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-kube-api-access-x6vbs\") pod \"payload-processing-e2e-explicit-3b812d-b66684789-v6krc\" (UID: \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\") " pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.060177 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.060053    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p8ph\" (UniqueName: \"kubernetes.io/projected/c2a66989-013f-4884-842d-b5ed4cbc749e-kube-api-access-4p8ph\") pod \"payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h\" (UID: \"c2a66989-013f-4884-842d-b5ed4cbc749e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:13.161493 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.161410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3b812d-b66684789-v6krc\" (UID: \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\") " pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.161493 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.161463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a66989-013f-4884-842d-b5ed4cbc749e-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h\" (UID: \"c2a66989-013f-4884-842d-b5ed4cbc749e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:13.161726 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.161501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6vbs\" (UniqueName: \"kubernetes.io/projected/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-kube-api-access-x6vbs\") pod \"payload-processing-e2e-explicit-3b812d-b66684789-v6krc\" (UID: \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\") " pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.161726 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.161526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p8ph\" (UniqueName: \"kubernetes.io/projected/c2a66989-013f-4884-842d-b5ed4cbc749e-kube-api-access-4p8ph\") pod \"payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h\" (UID: \"c2a66989-013f-4884-842d-b5ed4cbc749e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:13.162141 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.162122    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3b812d-b66684789-v6krc\" (UID: \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\") " pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.162214 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.162196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a66989-013f-4884-842d-b5ed4cbc749e-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h\" (UID: \"c2a66989-013f-4884-842d-b5ed4cbc749e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:13.170291 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.170262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p8ph\" (UniqueName: \"kubernetes.io/projected/c2a66989-013f-4884-842d-b5ed4cbc749e-kube-api-access-4p8ph\") pod \"payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h\" (UID: \"c2a66989-013f-4884-842d-b5ed4cbc749e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:13.170411 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.170344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6vbs\" (UniqueName: \"kubernetes.io/projected/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-kube-api-access-x6vbs\") pod \"payload-processing-e2e-explicit-3b812d-b66684789-v6krc\" (UID: \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\") " pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.323312 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.323267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:13.331525 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.331498    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.604139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.604113    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"]
Sep 08 14:13:13.606603 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:13:13.606570    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a66989_013f_4884_842d_b5ed4cbc749e.slice/crio-4029d4ff8b9d46366ea02a0358ee4969619968eed0d88b36f9d05159bacc3279 WatchSource:0}: Error finding container 4029d4ff8b9d46366ea02a0358ee4969619968eed0d88b36f9d05159bacc3279: Status 404 returned error can't find the container with id 4029d4ff8b9d46366ea02a0358ee4969619968eed0d88b36f9d05159bacc3279
Sep 08 14:13:13.609003 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.608983    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"]
Sep 08 14:13:13.611441 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:13:13.611411    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7dcf5e_8b05_4a12_b62b_745aabe6502d.slice/crio-9abc2d231ae96f02cfa62853424c0a7a370c33b85721c30a213d031ce1562ee7 WatchSource:0}: Error finding container 9abc2d231ae96f02cfa62853424c0a7a370c33b85721c30a213d031ce1562ee7: Status 404 returned error can't find the container with id 9abc2d231ae96f02cfa62853424c0a7a370c33b85721c30a213d031ce1562ee7
Sep 08 14:13:13.954749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.954656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc" event={"ID":"cd7dcf5e-8b05-4a12-b62b-745aabe6502d","Type":"ContainerStarted","Data":"c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf"}
Sep 08 14:13:13.954749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.954717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc" event={"ID":"cd7dcf5e-8b05-4a12-b62b-745aabe6502d","Type":"ContainerStarted","Data":"9abc2d231ae96f02cfa62853424c0a7a370c33b85721c30a213d031ce1562ee7"}
Sep 08 14:13:13.954969 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.954802    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:13.956351 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.956327    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h" event={"ID":"c2a66989-013f-4884-842d-b5ed4cbc749e","Type":"ContainerStarted","Data":"491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3"}
Sep 08 14:13:13.956465 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.956377    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:13.956465 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.956402    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h" event={"ID":"c2a66989-013f-4884-842d-b5ed4cbc749e","Type":"ContainerStarted","Data":"4029d4ff8b9d46366ea02a0358ee4969619968eed0d88b36f9d05159bacc3279"}
Sep 08 14:13:13.976061 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.976013    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc" podStartSLOduration=1.975999788 podStartE2EDuration="1.975999788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:13:13.973823449 +0000 UTC m=+889.887728366" watchObservedRunningTime="2026-09-08 14:13:13.975999788 +0000 UTC m=+889.889904746"
Sep 08 14:13:13.991106 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:13.991063    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h" podStartSLOduration=1.991049355 podStartE2EDuration="1.991049355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:13:13.990281352 +0000 UTC m=+889.904186268" watchObservedRunningTime="2026-09-08 14:13:13.991049355 +0000 UTC m=+889.904954270"
Sep 08 14:13:16.243081 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:16.242996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:18.904027 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:18.903991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:19.657554 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:19.657519    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:24.963098 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:24.963017    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:13:24.963098 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:24.963098    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:13:26.203983 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:26.203943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:26.271624 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:26.271590    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:26.383405 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:26.383372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:26.474893 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:26.474801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:27.235190 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:27.235151    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:27.460918 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:27.460887    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:28.886662 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:28.886599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:35.633660 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:35.633603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:35.734065 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:35.734030    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:36.111735 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:36.111694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:36.284507 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:36.284477    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:42.979037 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:42.979003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:43.077941 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:43.077897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:43.375161 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:43.375126    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:43.562600 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:43.562562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:43.687446 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:43.687362    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:43.952288 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:43.952206    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:46.593000 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:46.592938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:46.708426 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:46.708395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:47.777349 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:47.777314    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:47.876831 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:47.876800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:47.975537 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:47.975506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:48.333854 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.333812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:48.435461 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.435429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:13:48.613236 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.613161    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"]
Sep 08 14:13:48.617059 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.617043    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:48.621174 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.621139    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a47a1a97-dockercfg-n6wmh\""
Sep 08 14:13:48.621321 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.621274    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a47a1a97\""
Sep 08 14:13:48.631395 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.631369    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"]
Sep 08 14:13:48.677093 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.677060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d254447-ff93-4d46-b3c6-973a136d3e72-plugins-config-volume\") pod \"payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8\" (UID: \"0d254447-ff93-4d46-b3c6-973a136d3e72\") " pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:48.677282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.677250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwhpj\" (UniqueName: \"kubernetes.io/projected/0d254447-ff93-4d46-b3c6-973a136d3e72-kube-api-access-mwhpj\") pod \"payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8\" (UID: \"0d254447-ff93-4d46-b3c6-973a136d3e72\") " pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:48.777831 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.777802    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d254447-ff93-4d46-b3c6-973a136d3e72-plugins-config-volume\") pod \"payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8\" (UID: \"0d254447-ff93-4d46-b3c6-973a136d3e72\") " pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:48.778262 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.777842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwhpj\" (UniqueName: \"kubernetes.io/projected/0d254447-ff93-4d46-b3c6-973a136d3e72-kube-api-access-mwhpj\") pod \"payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8\" (UID: \"0d254447-ff93-4d46-b3c6-973a136d3e72\") " pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:48.778591 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.778567    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d254447-ff93-4d46-b3c6-973a136d3e72-plugins-config-volume\") pod \"payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8\" (UID: \"0d254447-ff93-4d46-b3c6-973a136d3e72\") " pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:48.792055 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.792025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwhpj\" (UniqueName: \"kubernetes.io/projected/0d254447-ff93-4d46-b3c6-973a136d3e72-kube-api-access-mwhpj\") pod \"payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8\" (UID: \"0d254447-ff93-4d46-b3c6-973a136d3e72\") " pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:48.931564 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:48.931500    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:49.208040 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:49.208016    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"]
Sep 08 14:13:49.210038 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:13:49.210013    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d254447_ff93_4d46_b3c6_973a136d3e72.slice/crio-7daa9649f7f6763b58fd912908d3b8c1db49aafbfbf0ae7e2cdd2930498c7812 WatchSource:0}: Error finding container 7daa9649f7f6763b58fd912908d3b8c1db49aafbfbf0ae7e2cdd2930498c7812: Status 404 returned error can't find the container with id 7daa9649f7f6763b58fd912908d3b8c1db49aafbfbf0ae7e2cdd2930498c7812
Sep 08 14:13:50.142507 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:50.142467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8" event={"ID":"0d254447-ff93-4d46-b3c6-973a136d3e72","Type":"ContainerStarted","Data":"6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126"}
Sep 08 14:13:50.142882 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:50.142526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8" event={"ID":"0d254447-ff93-4d46-b3c6-973a136d3e72","Type":"ContainerStarted","Data":"7daa9649f7f6763b58fd912908d3b8c1db49aafbfbf0ae7e2cdd2930498c7812"}
Sep 08 14:13:50.142882 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:50.142572    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:13:50.160169 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:13:50.160122    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8" podStartSLOduration=2.16010562 podStartE2EDuration="2.16010562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:13:50.159650197 +0000 UTC m=+926.073555115" watchObservedRunningTime="2026-09-08 14:13:50.16010562 +0000 UTC m=+926.074010538"
Sep 08 14:14:01.149468 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:01.149434    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:14:02.298177 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:02.298138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:02.572417 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:02.572305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:09.042731 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:09.042695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:11.504064 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:11.504027    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:12.265127 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:12.265094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:12.366872 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:12.366836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:12.611427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:12.611384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:12.716804 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:12.716772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:13.600788 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.600759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:13.669507 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.669480    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"]
Sep 08 14:14:13.669947 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.669712    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc" podUID="cd7dcf5e-8b05-4a12-b62b-745aabe6502d" containerName="payload-processing" containerID="cri-o://c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf" gracePeriod=30
Sep 08 14:14:13.677150 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.677123    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"]
Sep 08 14:14:13.677440 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.677414    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h" podUID="c2a66989-013f-4884-842d-b5ed4cbc749e" containerName="payload-pre-processing" containerID="cri-o://491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3" gracePeriod=30
Sep 08 14:14:13.709083 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.709056    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:13.823391 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.823357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:13.951316 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.951294    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:14:13.954100 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.954082    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:14:13.973715 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.973693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6vbs\" (UniqueName: \"kubernetes.io/projected/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-kube-api-access-x6vbs\") pod \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\" (UID: \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\") "
Sep 08 14:14:13.973843 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.973746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-plugins-config-volume\") pod \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\" (UID: \"cd7dcf5e-8b05-4a12-b62b-745aabe6502d\") "
Sep 08 14:14:13.974139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.974120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd7dcf5e-8b05-4a12-b62b-745aabe6502d" (UID: "cd7dcf5e-8b05-4a12-b62b-745aabe6502d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:14:13.975898 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:13.975881    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-kube-api-access-x6vbs" (OuterVolumeSpecName: "kube-api-access-x6vbs") pod "cd7dcf5e-8b05-4a12-b62b-745aabe6502d" (UID: "cd7dcf5e-8b05-4a12-b62b-745aabe6502d"). InnerVolumeSpecName "kube-api-access-x6vbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:14.075296 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.075268    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p8ph\" (UniqueName: \"kubernetes.io/projected/c2a66989-013f-4884-842d-b5ed4cbc749e-kube-api-access-4p8ph\") pod \"c2a66989-013f-4884-842d-b5ed4cbc749e\" (UID: \"c2a66989-013f-4884-842d-b5ed4cbc749e\") "
Sep 08 14:14:14.075296 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.075299    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a66989-013f-4884-842d-b5ed4cbc749e-plugins-config-volume\") pod \"c2a66989-013f-4884-842d-b5ed4cbc749e\" (UID: \"c2a66989-013f-4884-842d-b5ed4cbc749e\") "
Sep 08 14:14:14.075486 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.075473    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6vbs\" (UniqueName: \"kubernetes.io/projected/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-kube-api-access-x6vbs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:14:14.075486 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.075484    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd7dcf5e-8b05-4a12-b62b-745aabe6502d-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:14:14.075714 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.075682    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a66989-013f-4884-842d-b5ed4cbc749e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2a66989-013f-4884-842d-b5ed4cbc749e" (UID: "c2a66989-013f-4884-842d-b5ed4cbc749e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:14:14.077342 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.077323    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a66989-013f-4884-842d-b5ed4cbc749e-kube-api-access-4p8ph" (OuterVolumeSpecName: "kube-api-access-4p8ph") pod "c2a66989-013f-4884-842d-b5ed4cbc749e" (UID: "c2a66989-013f-4884-842d-b5ed4cbc749e"). InnerVolumeSpecName "kube-api-access-4p8ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:14.176290 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.176225    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p8ph\" (UniqueName: \"kubernetes.io/projected/c2a66989-013f-4884-842d-b5ed4cbc749e-kube-api-access-4p8ph\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:14:14.176290 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.176248    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a66989-013f-4884-842d-b5ed4cbc749e-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:14:14.268076 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.268045    2559 generic.go:356] "Generic (PLEG): container finished" podID="cd7dcf5e-8b05-4a12-b62b-745aabe6502d" containerID="c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf" exitCode=0
Sep 08 14:14:14.268206 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.268090    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"
Sep 08 14:14:14.268206 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.268117    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc" event={"ID":"cd7dcf5e-8b05-4a12-b62b-745aabe6502d","Type":"ContainerDied","Data":"c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf"}
Sep 08 14:14:14.268206 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.268166    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc" event={"ID":"cd7dcf5e-8b05-4a12-b62b-745aabe6502d","Type":"ContainerDied","Data":"9abc2d231ae96f02cfa62853424c0a7a370c33b85721c30a213d031ce1562ee7"}
Sep 08 14:14:14.268206 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.268196    2559 scope.go:117] "RemoveContainer" containerID="c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf"
Sep 08 14:14:14.269453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.269427    2559 generic.go:356] "Generic (PLEG): container finished" podID="c2a66989-013f-4884-842d-b5ed4cbc749e" containerID="491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3" exitCode=0
Sep 08 14:14:14.269600 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.269455    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h" event={"ID":"c2a66989-013f-4884-842d-b5ed4cbc749e","Type":"ContainerDied","Data":"491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3"}
Sep 08 14:14:14.269600 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.269469    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"
Sep 08 14:14:14.269600 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.269503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h" event={"ID":"c2a66989-013f-4884-842d-b5ed4cbc749e","Type":"ContainerDied","Data":"4029d4ff8b9d46366ea02a0358ee4969619968eed0d88b36f9d05159bacc3279"}
Sep 08 14:14:14.277794 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.277772    2559 scope.go:117] "RemoveContainer" containerID="c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf"
Sep 08 14:14:14.278112 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:14:14.278094    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf\": container with ID starting with c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf not found: ID does not exist" containerID="c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf"
Sep 08 14:14:14.278308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.278130    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf"} err="failed to get container status \"c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf\": rpc error: code = NotFound desc = could not find container \"c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf\": container with ID starting with c9abff53a91769f6bc26837f8e71783aeab95b5207c5d0df4793f0db574cecbf not found: ID does not exist"
Sep 08 14:14:14.278308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.278149    2559 scope.go:117] "RemoveContainer" containerID="491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3"
Sep 08 14:14:14.285751 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.285735    2559 scope.go:117] "RemoveContainer" containerID="491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3"
Sep 08 14:14:14.286034 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:14:14.286014    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3\": container with ID starting with 491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3 not found: ID does not exist" containerID="491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3"
Sep 08 14:14:14.286079 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.286041    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3"} err="failed to get container status \"491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3\": rpc error: code = NotFound desc = could not find container \"491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3\": container with ID starting with 491e07e31977f3c2cc39ea222c6b606b9f8eaadf2e1b899664a4b964532e9ec3 not found: ID does not exist"
Sep 08 14:14:14.308370 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.305298    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"]
Sep 08 14:14:14.311095 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.311077    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3b812d-6c9dcffc74-fg94h"]
Sep 08 14:14:14.321507 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.321479    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"]
Sep 08 14:14:14.323603 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.323578    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3b812d-b66684789-v6krc"]
Sep 08 14:14:14.584895 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.584865    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2a66989-013f-4884-842d-b5ed4cbc749e" path="/var/lib/kubelet/pods/c2a66989-013f-4884-842d-b5ed4cbc749e/volumes"
Sep 08 14:14:14.585211 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.585198    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd7dcf5e-8b05-4a12-b62b-745aabe6502d" path="/var/lib/kubelet/pods/cd7dcf5e-8b05-4a12-b62b-745aabe6502d/volumes"
Sep 08 14:14:14.670200 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.670166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:14.747716 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:14.747687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:20.787971 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:20.787933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:20.950471 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:20.950435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:21.448393 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:21.448360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:23.514689 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:23.514652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:23.633573 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:23.633534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:24.791036 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:24.791002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:24.984215 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:24.984120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:26.611313 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:26.611281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:26.719877 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:26.719848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:26.829304 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:26.829268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:31.804656 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:31.804604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:31.837494 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:31.837463    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"]
Sep 08 14:14:31.843036 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:31.842992    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8" podUID="0d254447-ff93-4d46-b3c6-973a136d3e72" containerName="payload-processing" containerID="cri-o://6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126" gracePeriod=30
Sep 08 14:14:31.914407 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:31.914372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:32.020296 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.020227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:32.098098 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.098070    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:14:32.143739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.143704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:32.239177 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.239150    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d254447-ff93-4d46-b3c6-973a136d3e72-plugins-config-volume\") pod \"0d254447-ff93-4d46-b3c6-973a136d3e72\" (UID: \"0d254447-ff93-4d46-b3c6-973a136d3e72\") "
Sep 08 14:14:32.239366 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.239200    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwhpj\" (UniqueName: \"kubernetes.io/projected/0d254447-ff93-4d46-b3c6-973a136d3e72-kube-api-access-mwhpj\") pod \"0d254447-ff93-4d46-b3c6-973a136d3e72\" (UID: \"0d254447-ff93-4d46-b3c6-973a136d3e72\") "
Sep 08 14:14:32.239563 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.239539    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d254447-ff93-4d46-b3c6-973a136d3e72-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d254447-ff93-4d46-b3c6-973a136d3e72" (UID: "0d254447-ff93-4d46-b3c6-973a136d3e72"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:14:32.241317 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.241298    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d254447-ff93-4d46-b3c6-973a136d3e72-kube-api-access-mwhpj" (OuterVolumeSpecName: "kube-api-access-mwhpj") pod "0d254447-ff93-4d46-b3c6-973a136d3e72" (UID: "0d254447-ff93-4d46-b3c6-973a136d3e72"). InnerVolumeSpecName "kube-api-access-mwhpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:14:32.340536 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.340467    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwhpj\" (UniqueName: \"kubernetes.io/projected/0d254447-ff93-4d46-b3c6-973a136d3e72-kube-api-access-mwhpj\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:14:32.340536 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.340491    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d254447-ff93-4d46-b3c6-973a136d3e72-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:14:32.361483 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.361452    2559 generic.go:356] "Generic (PLEG): container finished" podID="0d254447-ff93-4d46-b3c6-973a136d3e72" containerID="6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126" exitCode=0
Sep 08 14:14:32.361586 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.361499    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"
Sep 08 14:14:32.361586 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.361535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8" event={"ID":"0d254447-ff93-4d46-b3c6-973a136d3e72","Type":"ContainerDied","Data":"6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126"}
Sep 08 14:14:32.361698 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.361587    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8" event={"ID":"0d254447-ff93-4d46-b3c6-973a136d3e72","Type":"ContainerDied","Data":"7daa9649f7f6763b58fd912908d3b8c1db49aafbfbf0ae7e2cdd2930498c7812"}
Sep 08 14:14:32.361698 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.361622    2559 scope.go:117] "RemoveContainer" containerID="6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126"
Sep 08 14:14:32.370481 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.370453    2559 scope.go:117] "RemoveContainer" containerID="6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126"
Sep 08 14:14:32.370757 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:14:32.370739    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126\": container with ID starting with 6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126 not found: ID does not exist" containerID="6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126"
Sep 08 14:14:32.370806 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.370765    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126"} err="failed to get container status \"6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126\": rpc error: code = NotFound desc = could not find container \"6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126\": container with ID starting with 6e380dafa115c0d4e11549b197ad551405b8a74a4aeceb8c7bafc0a7b97e8126 not found: ID does not exist"
Sep 08 14:14:32.384009 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.383989    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"]
Sep 08 14:14:32.390484 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.390465    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a47a1a97-8cdc7f9d9-xxvs8"]
Sep 08 14:14:32.468100 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.468065    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:32.581085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:32.581058    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d254447-ff93-4d46-b3c6-973a136d3e72" path="/var/lib/kubelet/pods/0d254447-ff93-4d46-b3c6-973a136d3e72/volumes"
Sep 08 14:14:34.617081 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:34.617038    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:39.040220 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:39.040183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:39.202205 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:39.202166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:39.348189 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:39.348105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:39.709732 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:39.709645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:39.799457 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:39.799418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:40.103363 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:40.103317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:41.302348 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:41.302311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:41.413947 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:41.413912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:42.507096 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:42.507067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:42.607627 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:42.607586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:46.936859 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:46.936782    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:47.708895 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:47.708862    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:47.817056 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:47.817018    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:47.927564 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:47.927523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:48.111986 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:48.111944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:50.042574 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:50.042532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:55.061231 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:55.061196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:55.163422 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:55.163385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:56.025523 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:56.025487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:56.369484 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:56.369447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:56.932463 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:56.932417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:59.453473 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:59.453433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:14:59.661552 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:14:59.661517    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:00.846131 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:00.846088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:01.041641 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:01.041506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:01.541162 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:01.541121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:01.652786 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:01.652755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:07.839913 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:07.839879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:07.974594 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:07.974561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:09.162406 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:09.162373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:18.480433 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:18.480396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:20.034356 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:20.034321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:20.303598 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:20.303496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:22.232122 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:22.232079    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:23.575117 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:23.575086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:24.410737 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:24.410700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:24.511916 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:24.511876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:24.677698 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:24.677600    2559 scope.go:117] "RemoveContainer" containerID="90bb7d2dcb61b8f64f8c39d0ead581969822ac1c6c6f8c53e84d65d4b4ba0aff"
Sep 08 14:15:24.758067 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:24.758031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:25.104678 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:25.104631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:25.651283 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:25.651246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:28.126847 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:28.126812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:28.258969 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:28.258932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:29.300743 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:29.300698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:29.394209 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:29.394161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:29.495749 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:29.495699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:29.873691 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:29.873652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:29.987281 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:29.987245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:30.078604 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.078566    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"]
Sep 08 14:15:30.078967 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.078953    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd7dcf5e-8b05-4a12-b62b-745aabe6502d" containerName="payload-processing"
Sep 08 14:15:30.079021 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.078968    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd7dcf5e-8b05-4a12-b62b-745aabe6502d" containerName="payload-processing"
Sep 08 14:15:30.079021 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.078977    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d254447-ff93-4d46-b3c6-973a136d3e72" containerName="payload-processing"
Sep 08 14:15:30.079021 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.078983    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d254447-ff93-4d46-b3c6-973a136d3e72" containerName="payload-processing"
Sep 08 14:15:30.079021 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.079000    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a66989-013f-4884-842d-b5ed4cbc749e" containerName="payload-pre-processing"
Sep 08 14:15:30.079021 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.079005    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a66989-013f-4884-842d-b5ed4cbc749e" containerName="payload-pre-processing"
Sep 08 14:15:30.079199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.079080    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a66989-013f-4884-842d-b5ed4cbc749e" containerName="payload-pre-processing"
Sep 08 14:15:30.079199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.079090    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd7dcf5e-8b05-4a12-b62b-745aabe6502d" containerName="payload-processing"
Sep 08 14:15:30.079199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.079098    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d254447-ff93-4d46-b3c6-973a136d3e72" containerName="payload-processing"
Sep 08 14:15:30.083736 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.083710    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:30.086392 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.086363    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-e2a04d\""
Sep 08 14:15:30.086532 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.086451    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-e2a04d-dockercfg-nkf5m\""
Sep 08 14:15:30.091380 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.091358    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"]
Sep 08 14:15:30.137177 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.137093    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"]
Sep 08 14:15:30.140459 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.140442    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:30.155413 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.155376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j7pp\" (UniqueName: \"kubernetes.io/projected/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-kube-api-access-5j7pp\") pod \"payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x\" (UID: \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:30.155589 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.155463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"]
Sep 08 14:15:30.155589 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.155503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x\" (UID: \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:30.256707 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.256674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29zj\" (UniqueName: \"kubernetes.io/projected/b248dbcc-0bb7-473b-8c80-bc17e1ede978-kube-api-access-q29zj\") pod \"payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88\" (UID: \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:30.256707 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.256718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x\" (UID: \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:30.256989 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.256843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b248dbcc-0bb7-473b-8c80-bc17e1ede978-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88\" (UID: \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:30.256989 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.256897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j7pp\" (UniqueName: \"kubernetes.io/projected/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-kube-api-access-5j7pp\") pod \"payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x\" (UID: \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:30.257714 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.257687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x\" (UID: \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:30.271358 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.271320    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j7pp\" (UniqueName: \"kubernetes.io/projected/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-kube-api-access-5j7pp\") pod \"payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x\" (UID: \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:30.274382 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.273600    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"]
Sep 08 14:15:30.274382 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.273885    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp" podUID="7c176bc3-eaaf-4e54-8d09-139fb32c8f55" containerName="maas-api" containerID="cri-o://2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c" gracePeriod=30
Sep 08 14:15:30.359490 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.359450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b248dbcc-0bb7-473b-8c80-bc17e1ede978-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88\" (UID: \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:30.361378 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.361346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29zj\" (UniqueName: \"kubernetes.io/projected/b248dbcc-0bb7-473b-8c80-bc17e1ede978-kube-api-access-q29zj\") pod \"payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88\" (UID: \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:30.362360 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.362330    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b248dbcc-0bb7-473b-8c80-bc17e1ede978-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88\" (UID: \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:30.362499 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.362480    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"]
Sep 08 14:15:30.362918 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.362887    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn" podUID="63842712-ec37-4b69-bfdb-803d31ef6213" containerName="payload-processing" containerID="cri-o://c50e7b98426bdc3342a421ca087d751b41337cecd202c476e89e89840c939ba3" gracePeriod=30
Sep 08 14:15:30.364680 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.364655    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"]
Sep 08 14:15:30.365085 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.365058    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp" podUID="75152985-dc1a-4eb4-935c-997f7e23eb19" containerName="payload-pre-processing" containerID="cri-o://6b4aa84cc46a1aae15f68d2fac5b60abc159d3e523e32e95da31b63d1226909f" gracePeriod=30
Sep 08 14:15:30.375995 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.374681    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29zj\" (UniqueName: \"kubernetes.io/projected/b248dbcc-0bb7-473b-8c80-bc17e1ede978-kube-api-access-q29zj\") pod \"payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88\" (UID: \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:30.396634 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.396569    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:30.413331 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.413293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:30.450493 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.450401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:30.508963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.508929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:30.587839 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.587794    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:15:30.610246 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.610152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:30.652460 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.652376    2559 generic.go:356] "Generic (PLEG): container finished" podID="63842712-ec37-4b69-bfdb-803d31ef6213" containerID="c50e7b98426bdc3342a421ca087d751b41337cecd202c476e89e89840c939ba3" exitCode=0
Sep 08 14:15:30.652668 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.652453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn" event={"ID":"63842712-ec37-4b69-bfdb-803d31ef6213","Type":"ContainerDied","Data":"c50e7b98426bdc3342a421ca087d751b41337cecd202c476e89e89840c939ba3"}
Sep 08 14:15:30.654158 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.654132    2559 generic.go:356] "Generic (PLEG): container finished" podID="75152985-dc1a-4eb4-935c-997f7e23eb19" containerID="6b4aa84cc46a1aae15f68d2fac5b60abc159d3e523e32e95da31b63d1226909f" exitCode=0
Sep 08 14:15:30.654278 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.654208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp" event={"ID":"75152985-dc1a-4eb4-935c-997f7e23eb19","Type":"ContainerDied","Data":"6b4aa84cc46a1aae15f68d2fac5b60abc159d3e523e32e95da31b63d1226909f"}
Sep 08 14:15:30.655467 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.655442    2559 generic.go:356] "Generic (PLEG): container finished" podID="7c176bc3-eaaf-4e54-8d09-139fb32c8f55" containerID="2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c" exitCode=0
Sep 08 14:15:30.655563 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.655490    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"
Sep 08 14:15:30.655563 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.655497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp" event={"ID":"7c176bc3-eaaf-4e54-8d09-139fb32c8f55","Type":"ContainerDied","Data":"2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c"}
Sep 08 14:15:30.655563 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.655541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp" event={"ID":"7c176bc3-eaaf-4e54-8d09-139fb32c8f55","Type":"ContainerDied","Data":"58d61dd2490ad324d37391e804169884473a753162ec9ff00bd94e26c7065952"}
Sep 08 14:15:30.655690 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.655571    2559 scope.go:117] "RemoveContainer" containerID="2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c"
Sep 08 14:15:30.665584 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.665553    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-maas-api-tls\") pod \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") "
Sep 08 14:15:30.665826 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.665654    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-openshift-service-ca\") pod \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") "
Sep 08 14:15:30.665826 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.665689    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-metrics-certs\") pod \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") "
Sep 08 14:15:30.665826 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.665729    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc6xk\" (UniqueName: \"kubernetes.io/projected/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-kube-api-access-cc6xk\") pod \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\" (UID: \"7c176bc3-eaaf-4e54-8d09-139fb32c8f55\") "
Sep 08 14:15:30.666287 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.666257    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c176bc3-eaaf-4e54-8d09-139fb32c8f55" (UID: "7c176bc3-eaaf-4e54-8d09-139fb32c8f55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:15:30.666944 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.666925    2559 scope.go:117] "RemoveContainer" containerID="2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c"
Sep 08 14:15:30.667337 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:15:30.667312    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c\": container with ID starting with 2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c not found: ID does not exist" containerID="2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c"
Sep 08 14:15:30.667409 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.667351    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c"} err="failed to get container status \"2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c\": rpc error: code = NotFound desc = could not find container \"2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c\": container with ID starting with 2ea19a7b1bc6c386927f147a529bd5533a2a72df69858b623e590993b5a66c9c not found: ID does not exist"
Sep 08 14:15:30.669284 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.669229    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-kube-api-access-cc6xk" (OuterVolumeSpecName: "kube-api-access-cc6xk") pod "7c176bc3-eaaf-4e54-8d09-139fb32c8f55" (UID: "7c176bc3-eaaf-4e54-8d09-139fb32c8f55"). InnerVolumeSpecName "kube-api-access-cc6xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:15:30.669382 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.669300    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c176bc3-eaaf-4e54-8d09-139fb32c8f55" (UID: "7c176bc3-eaaf-4e54-8d09-139fb32c8f55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:15:30.669382 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.669319    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7c176bc3-eaaf-4e54-8d09-139fb32c8f55" (UID: "7c176bc3-eaaf-4e54-8d09-139fb32c8f55"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:15:30.682333 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.682306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"]
Sep 08 14:15:30.683536 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:15:30.683508    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b79ccb_74bc_4a42_949f_623a7d0fbbf2.slice/crio-d766206d3df7d01c451b01a996b1002163c00e5bcbc6c2fc493ee0ff5be6f16f WatchSource:0}: Error finding container d766206d3df7d01c451b01a996b1002163c00e5bcbc6c2fc493ee0ff5be6f16f: Status 404 returned error can't find the container with id d766206d3df7d01c451b01a996b1002163c00e5bcbc6c2fc493ee0ff5be6f16f
Sep 08 14:15:30.691006 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.690937    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:15:30.705378 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.705299    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:30.741680 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.741603    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:15:30.756179 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.756157    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"]
Sep 08 14:15:30.757948 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:15:30.757919    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb248dbcc_0bb7_473b_8c80_bc17e1ede978.slice/crio-ef09ebe9b333fe95d1766cbf6547a2f31dc0e87771d40947655fa122d992c228 WatchSource:0}: Error finding container ef09ebe9b333fe95d1766cbf6547a2f31dc0e87771d40947655fa122d992c228: Status 404 returned error can't find the container with id ef09ebe9b333fe95d1766cbf6547a2f31dc0e87771d40947655fa122d992c228
Sep 08 14:15:30.768217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.767758    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75152985-dc1a-4eb4-935c-997f7e23eb19-plugins-config-volume\") pod \"75152985-dc1a-4eb4-935c-997f7e23eb19\" (UID: \"75152985-dc1a-4eb4-935c-997f7e23eb19\") "
Sep 08 14:15:30.768217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.767805    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlpvf\" (UniqueName: \"kubernetes.io/projected/75152985-dc1a-4eb4-935c-997f7e23eb19-kube-api-access-hlpvf\") pod \"75152985-dc1a-4eb4-935c-997f7e23eb19\" (UID: \"75152985-dc1a-4eb4-935c-997f7e23eb19\") "
Sep 08 14:15:30.768217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.768131    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-openshift-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:30.768217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.768152    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-metrics-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:30.768217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.768167    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc6xk\" (UniqueName: \"kubernetes.io/projected/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-kube-api-access-cc6xk\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:30.768217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.768182    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c176bc3-eaaf-4e54-8d09-139fb32c8f55-maas-api-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:30.768217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.768180    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75152985-dc1a-4eb4-935c-997f7e23eb19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75152985-dc1a-4eb4-935c-997f7e23eb19" (UID: "75152985-dc1a-4eb4-935c-997f7e23eb19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:15:30.770263 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.770233    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75152985-dc1a-4eb4-935c-997f7e23eb19-kube-api-access-hlpvf" (OuterVolumeSpecName: "kube-api-access-hlpvf") pod "75152985-dc1a-4eb4-935c-997f7e23eb19" (UID: "75152985-dc1a-4eb4-935c-997f7e23eb19"). InnerVolumeSpecName "kube-api-access-hlpvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:15:30.868482 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.868451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63842712-ec37-4b69-bfdb-803d31ef6213-plugins-config-volume\") pod \"63842712-ec37-4b69-bfdb-803d31ef6213\" (UID: \"63842712-ec37-4b69-bfdb-803d31ef6213\") "
Sep 08 14:15:30.868663 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.868600    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nghz\" (UniqueName: \"kubernetes.io/projected/63842712-ec37-4b69-bfdb-803d31ef6213-kube-api-access-5nghz\") pod \"63842712-ec37-4b69-bfdb-803d31ef6213\" (UID: \"63842712-ec37-4b69-bfdb-803d31ef6213\") "
Sep 08 14:15:30.868785 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.868770    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75152985-dc1a-4eb4-935c-997f7e23eb19-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:30.868871 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.868790    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlpvf\" (UniqueName: \"kubernetes.io/projected/75152985-dc1a-4eb4-935c-997f7e23eb19-kube-api-access-hlpvf\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:30.868871 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.868826    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63842712-ec37-4b69-bfdb-803d31ef6213-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63842712-ec37-4b69-bfdb-803d31ef6213" (UID: "63842712-ec37-4b69-bfdb-803d31ef6213"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:15:30.870840 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.870818    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63842712-ec37-4b69-bfdb-803d31ef6213-kube-api-access-5nghz" (OuterVolumeSpecName: "kube-api-access-5nghz") pod "63842712-ec37-4b69-bfdb-803d31ef6213" (UID: "63842712-ec37-4b69-bfdb-803d31ef6213"). InnerVolumeSpecName "kube-api-access-5nghz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:15:30.969496 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.969469    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nghz\" (UniqueName: \"kubernetes.io/projected/63842712-ec37-4b69-bfdb-803d31ef6213-kube-api-access-5nghz\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:30.969496 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.969495    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63842712-ec37-4b69-bfdb-803d31ef6213-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:30.978265 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.978235    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"]
Sep 08 14:15:30.987155 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:30.987124    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cb068d-7876f465cc-h9bkp"]
Sep 08 14:15:31.180355 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.180310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:31.663559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.663465    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x" event={"ID":"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2","Type":"ContainerStarted","Data":"020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5"}
Sep 08 14:15:31.663559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.663531    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:31.663559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.663557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x" event={"ID":"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2","Type":"ContainerStarted","Data":"d766206d3df7d01c451b01a996b1002163c00e5bcbc6c2fc493ee0ff5be6f16f"}
Sep 08 14:15:31.664767 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.664749    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"
Sep 08 14:15:31.664870 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.664780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn" event={"ID":"63842712-ec37-4b69-bfdb-803d31ef6213","Type":"ContainerDied","Data":"71fa52b98768aa7668ef2abb90f196c303e61c06a85c19c0b4ad256a6619fd30"}
Sep 08 14:15:31.664870 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.664823    2559 scope.go:117] "RemoveContainer" containerID="c50e7b98426bdc3342a421ca087d751b41337cecd202c476e89e89840c939ba3"
Sep 08 14:15:31.666142 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.666086    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"
Sep 08 14:15:31.666142 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.666096    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp" event={"ID":"75152985-dc1a-4eb4-935c-997f7e23eb19","Type":"ContainerDied","Data":"4608ec5c27362531097d6c8054e51673a859ff772beb5be7083e07a17f96424e"}
Sep 08 14:15:31.667875 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.667854    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88" event={"ID":"b248dbcc-0bb7-473b-8c80-bc17e1ede978","Type":"ContainerStarted","Data":"e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73"}
Sep 08 14:15:31.668000 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.667904    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:31.668000 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.667928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88" event={"ID":"b248dbcc-0bb7-473b-8c80-bc17e1ede978","Type":"ContainerStarted","Data":"ef09ebe9b333fe95d1766cbf6547a2f31dc0e87771d40947655fa122d992c228"}
Sep 08 14:15:31.675179 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.675152    2559 scope.go:117] "RemoveContainer" containerID="6b4aa84cc46a1aae15f68d2fac5b60abc159d3e523e32e95da31b63d1226909f"
Sep 08 14:15:31.693080 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.693018    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x" podStartSLOduration=1.6930003980000001 podStartE2EDuration="1.693000398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:15:31.691705293 +0000 UTC m=+1027.605610208" watchObservedRunningTime="2026-09-08 14:15:31.693000398 +0000 UTC m=+1027.606905313"
Sep 08 14:15:31.734833 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.734771    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88" podStartSLOduration=1.7347575389999998 podStartE2EDuration="1.734757539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:15:31.730389157 +0000 UTC m=+1027.644294073" watchObservedRunningTime="2026-09-08 14:15:31.734757539 +0000 UTC m=+1027.648662455"
Sep 08 14:15:31.756998 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.756964    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"]
Sep 08 14:15:31.771650 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.771600    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cb068d-7d8794d778-2qczp"]
Sep 08 14:15:31.795086 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.795049    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"]
Sep 08 14:15:31.802325 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:31.802294    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cb068d-5b8d687c6c-c6szn"]
Sep 08 14:15:32.581677 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:32.581643    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63842712-ec37-4b69-bfdb-803d31ef6213" path="/var/lib/kubelet/pods/63842712-ec37-4b69-bfdb-803d31ef6213/volumes"
Sep 08 14:15:32.582016 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:32.582002    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75152985-dc1a-4eb4-935c-997f7e23eb19" path="/var/lib/kubelet/pods/75152985-dc1a-4eb4-935c-997f7e23eb19/volumes"
Sep 08 14:15:32.582333 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:32.582322    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c176bc3-eaaf-4e54-8d09-139fb32c8f55" path="/var/lib/kubelet/pods/7c176bc3-eaaf-4e54-8d09-139fb32c8f55/volumes"
Sep 08 14:15:37.720178 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:37.720144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:37.820574 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:37.820524    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:38.045834 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:38.045799    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:38.435259 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:38.435184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:42.678652 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:42.678594    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:15:42.679044 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:42.678779    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:15:49.071216 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.071180    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"]
Sep 08 14:15:49.071706 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.071434    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl" podUID="4d0e4968-6085-4819-b9b4-f0387a722e31" containerName="maas-api" containerID="cri-o://8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23" gracePeriod=30
Sep 08 14:15:49.151137 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.151102    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"]
Sep 08 14:15:49.151363 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.151323    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz" podUID="f4a0f87b-2cd3-483c-ad8c-c1311a3f0676" containerName="payload-pre-processing" containerID="cri-o://d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749" gracePeriod=30
Sep 08 14:15:49.286689 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.286643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:49.413004 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.412965    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:15:49.432185 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.432161    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls\") pod \"4d0e4968-6085-4819-b9b4-f0387a722e31\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") "
Sep 08 14:15:49.432351 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.432225    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-metrics-certs\") pod \"4d0e4968-6085-4819-b9b4-f0387a722e31\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") "
Sep 08 14:15:49.432351 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.432263    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlqb8\" (UniqueName: \"kubernetes.io/projected/4d0e4968-6085-4819-b9b4-f0387a722e31-kube-api-access-qlqb8\") pod \"4d0e4968-6085-4819-b9b4-f0387a722e31\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") "
Sep 08 14:15:49.432351 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.432320    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0e4968-6085-4819-b9b4-f0387a722e31-openshift-service-ca\") pod \"4d0e4968-6085-4819-b9b4-f0387a722e31\" (UID: \"4d0e4968-6085-4819-b9b4-f0387a722e31\") "
Sep 08 14:15:49.432876 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.432804    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0e4968-6085-4819-b9b4-f0387a722e31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d0e4968-6085-4819-b9b4-f0387a722e31" (UID: "4d0e4968-6085-4819-b9b4-f0387a722e31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:15:49.434600 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.434574    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d0e4968-6085-4819-b9b4-f0387a722e31" (UID: "4d0e4968-6085-4819-b9b4-f0387a722e31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:15:49.435035 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.435011    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4d0e4968-6085-4819-b9b4-f0387a722e31" (UID: "4d0e4968-6085-4819-b9b4-f0387a722e31"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:15:49.435200 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.435172    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0e4968-6085-4819-b9b4-f0387a722e31-kube-api-access-qlqb8" (OuterVolumeSpecName: "kube-api-access-qlqb8") pod "4d0e4968-6085-4819-b9b4-f0387a722e31" (UID: "4d0e4968-6085-4819-b9b4-f0387a722e31"). InnerVolumeSpecName "kube-api-access-qlqb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:15:49.438180 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.437921    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:15:49.484426 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.484388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:49.533559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.533516    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v6kl\" (UniqueName: \"kubernetes.io/projected/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-kube-api-access-6v6kl\") pod \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\" (UID: \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\") "
Sep 08 14:15:49.533559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.533565    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-plugins-config-volume\") pod \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\" (UID: \"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676\") "
Sep 08 14:15:49.533927 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.533906    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-metrics-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:49.533996 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.533931    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlqb8\" (UniqueName: \"kubernetes.io/projected/4d0e4968-6085-4819-b9b4-f0387a722e31-kube-api-access-qlqb8\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:49.533996 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.533945    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0e4968-6085-4819-b9b4-f0387a722e31-openshift-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:49.533996 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.533958    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0e4968-6085-4819-b9b4-f0387a722e31-maas-api-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:49.534094 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.534040    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f4a0f87b-2cd3-483c-ad8c-c1311a3f0676" (UID: "f4a0f87b-2cd3-483c-ad8c-c1311a3f0676"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:15:49.535981 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.535954    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-kube-api-access-6v6kl" (OuterVolumeSpecName: "kube-api-access-6v6kl") pod "f4a0f87b-2cd3-483c-ad8c-c1311a3f0676" (UID: "f4a0f87b-2cd3-483c-ad8c-c1311a3f0676"). InnerVolumeSpecName "kube-api-access-6v6kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:15:49.571984 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.571942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:49.634479 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.634379    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v6kl\" (UniqueName: \"kubernetes.io/projected/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-kube-api-access-6v6kl\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:49.634479 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.634411    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:49.769283 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.769245    2559 generic.go:356] "Generic (PLEG): container finished" podID="f4a0f87b-2cd3-483c-ad8c-c1311a3f0676" containerID="d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749" exitCode=0
Sep 08 14:15:49.769490 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.769293    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"
Sep 08 14:15:49.769490 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.769334    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz" event={"ID":"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676","Type":"ContainerDied","Data":"d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749"}
Sep 08 14:15:49.769490 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.769394    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz" event={"ID":"f4a0f87b-2cd3-483c-ad8c-c1311a3f0676","Type":"ContainerDied","Data":"3662a305d7bb9f3c421922c87ac09dbd0668fb1fb6aa880a9ffe4b4bc3952a7c"}
Sep 08 14:15:49.769490 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.769426    2559 scope.go:117] "RemoveContainer" containerID="d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749"
Sep 08 14:15:49.770841 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.770817    2559 generic.go:356] "Generic (PLEG): container finished" podID="4d0e4968-6085-4819-b9b4-f0387a722e31" containerID="8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23" exitCode=0
Sep 08 14:15:49.770941 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.770854    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl" event={"ID":"4d0e4968-6085-4819-b9b4-f0387a722e31","Type":"ContainerDied","Data":"8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23"}
Sep 08 14:15:49.770941 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.770877    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"
Sep 08 14:15:49.770941 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.770903    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl" event={"ID":"4d0e4968-6085-4819-b9b4-f0387a722e31","Type":"ContainerDied","Data":"eafbe1e5dd01cba821fc811975580496993137f8c534fe91541c5a5884413c5d"}
Sep 08 14:15:49.782633 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.782553    2559 scope.go:117] "RemoveContainer" containerID="d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749"
Sep 08 14:15:49.783182 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:15:49.783152    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749\": container with ID starting with d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749 not found: ID does not exist" containerID="d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749"
Sep 08 14:15:49.783310 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.783194    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749"} err="failed to get container status \"d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749\": rpc error: code = NotFound desc = could not find container \"d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749\": container with ID starting with d2347b27b4a15f068c8ae9f422830ea164a7f76fcc2530170c787f9a97a37749 not found: ID does not exist"
Sep 08 14:15:49.783310 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.783228    2559 scope.go:117] "RemoveContainer" containerID="8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23"
Sep 08 14:15:49.792653 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.792599    2559 scope.go:117] "RemoveContainer" containerID="8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23"
Sep 08 14:15:49.793022 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:15:49.792996    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23\": container with ID starting with 8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23 not found: ID does not exist" containerID="8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23"
Sep 08 14:15:49.793089 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.793034    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23"} err="failed to get container status \"8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23\": rpc error: code = NotFound desc = could not find container \"8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23\": container with ID starting with 8344cb00278012040d413a1daf83fa592eed08801eb33f4d739f55839a658b23 not found: ID does not exist"
Sep 08 14:15:49.810732 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.810694    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"]
Sep 08 14:15:49.826281 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.826247    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-94eadd-84dbc978cd-zj2nz"]
Sep 08 14:15:49.859357 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.859319    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"]
Sep 08 14:15:49.865926 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.865872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:49.867220 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:49.867199    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-94eadd-7599f994b8-tpcbl"]
Sep 08 14:15:50.422429 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:50.422328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:50.588724 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:50.588689    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d0e4968-6085-4819-b9b4-f0387a722e31" path="/var/lib/kubelet/pods/4d0e4968-6085-4819-b9b4-f0387a722e31/volumes"
Sep 08 14:15:50.589062 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:50.589049    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4a0f87b-2cd3-483c-ad8c-c1311a3f0676" path="/var/lib/kubelet/pods/f4a0f87b-2cd3-483c-ad8c-c1311a3f0676/volumes"
Sep 08 14:15:53.595398 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:53.595348    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:54.434745 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.434709    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:15:54.435069 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435057    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75152985-dc1a-4eb4-935c-997f7e23eb19" containerName="payload-pre-processing"
Sep 08 14:15:54.435111 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435071    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="75152985-dc1a-4eb4-935c-997f7e23eb19" containerName="payload-pre-processing"
Sep 08 14:15:54.435111 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435085    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c176bc3-eaaf-4e54-8d09-139fb32c8f55" containerName="maas-api"
Sep 08 14:15:54.435111 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435091    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c176bc3-eaaf-4e54-8d09-139fb32c8f55" containerName="maas-api"
Sep 08 14:15:54.435111 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435104    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63842712-ec37-4b69-bfdb-803d31ef6213" containerName="payload-processing"
Sep 08 14:15:54.435111 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435110    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63842712-ec37-4b69-bfdb-803d31ef6213" containerName="payload-processing"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435118    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0e4968-6085-4819-b9b4-f0387a722e31" containerName="maas-api"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435123    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0e4968-6085-4819-b9b4-f0387a722e31" containerName="maas-api"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435131    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a0f87b-2cd3-483c-ad8c-c1311a3f0676" containerName="payload-pre-processing"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435136    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a0f87b-2cd3-483c-ad8c-c1311a3f0676" containerName="payload-pre-processing"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435188    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a0f87b-2cd3-483c-ad8c-c1311a3f0676" containerName="payload-pre-processing"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435196    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="75152985-dc1a-4eb4-935c-997f7e23eb19" containerName="payload-pre-processing"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435202    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0e4968-6085-4819-b9b4-f0387a722e31" containerName="maas-api"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435210    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c176bc3-eaaf-4e54-8d09-139fb32c8f55" containerName="maas-api"
Sep 08 14:15:54.435256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.435215    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63842712-ec37-4b69-bfdb-803d31ef6213" containerName="payload-processing"
Sep 08 14:15:54.438290 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.438271    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:54.440990 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.440967    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6shtd\""
Sep 08 14:15:54.446022 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.445721    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:15:54.470236 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.470190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcrsg\" (UniqueName: \"kubernetes.io/projected/55cd2e60-22a4-43aa-b0ad-1613c42fe89c-kube-api-access-wcrsg\") pod \"test-curl-5862-140681079665552\" (UID: \"55cd2e60-22a4-43aa-b0ad-1613c42fe89c\") " pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:54.571199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.571154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcrsg\" (UniqueName: \"kubernetes.io/projected/55cd2e60-22a4-43aa-b0ad-1613c42fe89c-kube-api-access-wcrsg\") pod \"test-curl-5862-140681079665552\" (UID: \"55cd2e60-22a4-43aa-b0ad-1613c42fe89c\") " pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:54.583567 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.583478    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcrsg\" (UniqueName: \"kubernetes.io/projected/55cd2e60-22a4-43aa-b0ad-1613c42fe89c-kube-api-access-wcrsg\") pod \"test-curl-5862-140681079665552\" (UID: \"55cd2e60-22a4-43aa-b0ad-1613c42fe89c\") " pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:54.749299 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:54.749205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:55.024029 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:55.023996    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:15:55.025875 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:15:55.025848    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55cd2e60_22a4_43aa_b0ad_1613c42fe89c.slice/crio-5b4baf87e1ee27a1c7821ceee7bc1ab632d519e96083df3e366c1b1e4e53a657 WatchSource:0}: Error finding container 5b4baf87e1ee27a1c7821ceee7bc1ab632d519e96083df3e366c1b1e4e53a657: Status 404 returned error can't find the container with id 5b4baf87e1ee27a1c7821ceee7bc1ab632d519e96083df3e366c1b1e4e53a657
Sep 08 14:15:55.027308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:55.027290    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:15:55.806192 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:55.806155    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5862-140681079665552" event={"ID":"55cd2e60-22a4-43aa-b0ad-1613c42fe89c","Type":"ContainerStarted","Data":"5b4baf87e1ee27a1c7821ceee7bc1ab632d519e96083df3e366c1b1e4e53a657"}
Sep 08 14:15:56.186219 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:56.186181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:56.318295 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:56.318256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:56.517161 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:56.517073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:15:56.812308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:56.812269    2559 generic.go:356] "Generic (PLEG): container finished" podID="55cd2e60-22a4-43aa-b0ad-1613c42fe89c" containerID="79cf837f8757232f73af22dab661639f34ea043ad354c90f7098ca8825ad47c6" exitCode=0
Sep 08 14:15:56.812753 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:56.812360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5862-140681079665552" event={"ID":"55cd2e60-22a4-43aa-b0ad-1613c42fe89c","Type":"ContainerDied","Data":"79cf837f8757232f73af22dab661639f34ea043ad354c90f7098ca8825ad47c6"}
Sep 08 14:15:57.965968 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:57.965937    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:57.988263 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:57.988229    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-5862-140681079665552_55cd2e60-22a4-43aa-b0ad-1613c42fe89c/test-curl-5862-140681079665552/0.log"
Sep 08 14:15:58.000589 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.000559    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcrsg\" (UniqueName: \"kubernetes.io/projected/55cd2e60-22a4-43aa-b0ad-1613c42fe89c-kube-api-access-wcrsg\") pod \"55cd2e60-22a4-43aa-b0ad-1613c42fe89c\" (UID: \"55cd2e60-22a4-43aa-b0ad-1613c42fe89c\") "
Sep 08 14:15:58.003598 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.003569    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55cd2e60-22a4-43aa-b0ad-1613c42fe89c-kube-api-access-wcrsg" (OuterVolumeSpecName: "kube-api-access-wcrsg") pod "55cd2e60-22a4-43aa-b0ad-1613c42fe89c" (UID: "55cd2e60-22a4-43aa-b0ad-1613c42fe89c"). InnerVolumeSpecName "kube-api-access-wcrsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:15:58.021478 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.021439    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:15:58.027128 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.027098    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:15:58.102180 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.102091    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcrsg\" (UniqueName: \"kubernetes.io/projected/55cd2e60-22a4-43aa-b0ad-1613c42fe89c-kube-api-access-wcrsg\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:15:58.213720 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.213681    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:15:58.214052 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.214039    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55cd2e60-22a4-43aa-b0ad-1613c42fe89c" containerName="test-curl-5862-140681079665552"
Sep 08 14:15:58.214101 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.214055    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cd2e60-22a4-43aa-b0ad-1613c42fe89c" containerName="test-curl-5862-140681079665552"
Sep 08 14:15:58.214150 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.214141    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="55cd2e60-22a4-43aa-b0ad-1613c42fe89c" containerName="test-curl-5862-140681079665552"
Sep 08 14:15:58.217000 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.216980    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:58.224374 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.224349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:15:58.303324 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.303271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6dgc\" (UniqueName: \"kubernetes.io/projected/afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88-kube-api-access-g6dgc\") pod \"test-curl-5862-140681079665552\" (UID: \"afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88\") " pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:58.404853 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.404756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6dgc\" (UniqueName: \"kubernetes.io/projected/afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88-kube-api-access-g6dgc\") pod \"test-curl-5862-140681079665552\" (UID: \"afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88\") " pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:58.413870 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.413840    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6dgc\" (UniqueName: \"kubernetes.io/projected/afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88-kube-api-access-g6dgc\") pod \"test-curl-5862-140681079665552\" (UID: \"afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88\") " pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:58.527322 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.527282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:58.584344 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.583885    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55cd2e60-22a4-43aa-b0ad-1613c42fe89c" path="/var/lib/kubelet/pods/55cd2e60-22a4-43aa-b0ad-1613c42fe89c/volumes"
Sep 08 14:15:58.797734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.797707    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:15:58.800385 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:15:58.800358    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafd3398d_bf6a_4bb9_8a56_f5a9f5e29c88.slice/crio-bb608a58614e8dc87fb69ff104b3df64ab3181e9dc98f3883b5201a6de52dcbe WatchSource:0}: Error finding container bb608a58614e8dc87fb69ff104b3df64ab3181e9dc98f3883b5201a6de52dcbe: Status 404 returned error can't find the container with id bb608a58614e8dc87fb69ff104b3df64ab3181e9dc98f3883b5201a6de52dcbe
Sep 08 14:15:58.823442 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.823416    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:15:58.823637 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.823418    2559 scope.go:117] "RemoveContainer" containerID="79cf837f8757232f73af22dab661639f34ea043ad354c90f7098ca8825ad47c6"
Sep 08 14:15:58.824981 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:58.824724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5862-140681079665552" event={"ID":"afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88","Type":"ContainerStarted","Data":"bb608a58614e8dc87fb69ff104b3df64ab3181e9dc98f3883b5201a6de52dcbe"}
Sep 08 14:15:59.832852 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:59.832810    2559 generic.go:356] "Generic (PLEG): container finished" podID="afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88" containerID="e0fbdb66a285b28de7a151537a3698e633403a1e4cdcdb25589bbf1e566d5e48" exitCode=0
Sep 08 14:15:59.833338 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:15:59.832864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5862-140681079665552" event={"ID":"afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88","Type":"ContainerDied","Data":"e0fbdb66a285b28de7a151537a3698e633403a1e4cdcdb25589bbf1e566d5e48"}
Sep 08 14:16:00.979107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:00.979077    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:16:01.001815 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.001783    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-5862-140681079665552_afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88/test-curl-5862-140681079665552/0.log"
Sep 08 14:16:01.026284 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.026253    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:16:01.026542 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.026520    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6dgc\" (UniqueName: \"kubernetes.io/projected/afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88-kube-api-access-g6dgc\") pod \"afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88\" (UID: \"afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88\") "
Sep 08 14:16:01.028221 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.028194    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-5862-140681079665552"]
Sep 08 14:16:01.028837 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.028794    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88-kube-api-access-g6dgc" (OuterVolumeSpecName: "kube-api-access-g6dgc") pod "afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88" (UID: "afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88"). InnerVolumeSpecName "kube-api-access-g6dgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:16:01.127373 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.127281    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6dgc\" (UniqueName: \"kubernetes.io/projected/afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88-kube-api-access-g6dgc\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:16:01.148037 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.148000    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:01.148376 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.148362    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88" containerName="test-curl-5862-140681079665552"
Sep 08 14:16:01.148420 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.148378    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88" containerName="test-curl-5862-140681079665552"
Sep 08 14:16:01.148455 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.148443    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88" containerName="test-curl-5862-140681079665552"
Sep 08 14:16:01.151542 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.151525    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:01.156571 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.156543    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:01.228226 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.228184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkxrf\" (UniqueName: \"kubernetes.io/projected/a7190e6a-e916-4fdf-bde4-4f1c33e63a14-kube-api-access-dkxrf\") pod \"test-curl-5862-140681079666128\" (UID: \"a7190e6a-e916-4fdf-bde4-4f1c33e63a14\") " pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:01.329775 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.329734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxrf\" (UniqueName: \"kubernetes.io/projected/a7190e6a-e916-4fdf-bde4-4f1c33e63a14-kube-api-access-dkxrf\") pod \"test-curl-5862-140681079666128\" (UID: \"a7190e6a-e916-4fdf-bde4-4f1c33e63a14\") " pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:01.338954 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.338919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkxrf\" (UniqueName: \"kubernetes.io/projected/a7190e6a-e916-4fdf-bde4-4f1c33e63a14-kube-api-access-dkxrf\") pod \"test-curl-5862-140681079666128\" (UID: \"a7190e6a-e916-4fdf-bde4-4f1c33e63a14\") " pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:01.462317 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.462228    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:01.743763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.743727    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:01.746999 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:16:01.746957    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7190e6a_e916_4fdf_bde4_4f1c33e63a14.slice/crio-6af7c3cd501bbf676aef8bbf08e68ce2b99a38a25887f9ad667fb1ebebf02a01 WatchSource:0}: Error finding container 6af7c3cd501bbf676aef8bbf08e68ce2b99a38a25887f9ad667fb1ebebf02a01: Status 404 returned error can't find the container with id 6af7c3cd501bbf676aef8bbf08e68ce2b99a38a25887f9ad667fb1ebebf02a01
Sep 08 14:16:01.844927 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.844892    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb608a58614e8dc87fb69ff104b3df64ab3181e9dc98f3883b5201a6de52dcbe"
Sep 08 14:16:01.844927 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.844893    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:16:01.846189 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:01.846155    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5862-140681079666128" event={"ID":"a7190e6a-e916-4fdf-bde4-4f1c33e63a14","Type":"ContainerStarted","Data":"6af7c3cd501bbf676aef8bbf08e68ce2b99a38a25887f9ad667fb1ebebf02a01"}
Sep 08 14:16:01.855373 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:16:01.855346    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-5862-140681079665552\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" podUID="afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88" pod="opendatahub/test-curl-5862-140681079665552"
Sep 08 14:16:02.582277 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:02.582244    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88" path="/var/lib/kubelet/pods/afd3398d-bf6a-4bb9-8a56-f5a9f5e29c88/volumes"
Sep 08 14:16:02.853463 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:02.853380    2559 generic.go:356] "Generic (PLEG): container finished" podID="a7190e6a-e916-4fdf-bde4-4f1c33e63a14" containerID="431f47720e36af2ece5285982a0802b6be45d044620e636aeb056c8b1c42ac74" exitCode=0
Sep 08 14:16:02.853463 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:02.853426    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5862-140681079666128" event={"ID":"a7190e6a-e916-4fdf-bde4-4f1c33e63a14","Type":"ContainerDied","Data":"431f47720e36af2ece5285982a0802b6be45d044620e636aeb056c8b1c42ac74"}
Sep 08 14:16:03.990864 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:03.990839    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:04.013761 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.013721    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-5862-140681079666128_a7190e6a-e916-4fdf-bde4-4f1c33e63a14/test-curl-5862-140681079666128/0.log"
Sep 08 14:16:04.036958 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.036923    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:04.042059 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.042029    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:04.055338 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.055304    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkxrf\" (UniqueName: \"kubernetes.io/projected/a7190e6a-e916-4fdf-bde4-4f1c33e63a14-kube-api-access-dkxrf\") pod \"a7190e6a-e916-4fdf-bde4-4f1c33e63a14\" (UID: \"a7190e6a-e916-4fdf-bde4-4f1c33e63a14\") "
Sep 08 14:16:04.057686 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.057659    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7190e6a-e916-4fdf-bde4-4f1c33e63a14-kube-api-access-dkxrf" (OuterVolumeSpecName: "kube-api-access-dkxrf") pod "a7190e6a-e916-4fdf-bde4-4f1c33e63a14" (UID: "a7190e6a-e916-4fdf-bde4-4f1c33e63a14"). InnerVolumeSpecName "kube-api-access-dkxrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:16:04.156217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.156126    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkxrf\" (UniqueName: \"kubernetes.io/projected/a7190e6a-e916-4fdf-bde4-4f1c33e63a14-kube-api-access-dkxrf\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:16:04.176844 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.176801    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:04.177216 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.177201    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7190e6a-e916-4fdf-bde4-4f1c33e63a14" containerName="test-curl-5862-140681079666128"
Sep 08 14:16:04.177278 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.177217    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7190e6a-e916-4fdf-bde4-4f1c33e63a14" containerName="test-curl-5862-140681079666128"
Sep 08 14:16:04.177278 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.177276    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7190e6a-e916-4fdf-bde4-4f1c33e63a14" containerName="test-curl-5862-140681079666128"
Sep 08 14:16:04.180233 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.180214    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:04.186115 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.186076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:04.257515 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.257464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9m9k\" (UniqueName: \"kubernetes.io/projected/ff2f18a0-8b2a-4542-becc-ff92b5f0f903-kube-api-access-j9m9k\") pod \"test-curl-5862-140681079666128\" (UID: \"ff2f18a0-8b2a-4542-becc-ff92b5f0f903\") " pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:04.358437 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.358395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9m9k\" (UniqueName: \"kubernetes.io/projected/ff2f18a0-8b2a-4542-becc-ff92b5f0f903-kube-api-access-j9m9k\") pod \"test-curl-5862-140681079666128\" (UID: \"ff2f18a0-8b2a-4542-becc-ff92b5f0f903\") " pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:04.367807 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.367782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9m9k\" (UniqueName: \"kubernetes.io/projected/ff2f18a0-8b2a-4542-becc-ff92b5f0f903-kube-api-access-j9m9k\") pod \"test-curl-5862-140681079666128\" (UID: \"ff2f18a0-8b2a-4542-becc-ff92b5f0f903\") " pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:04.491223 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.491196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:04.582170 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.582138    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7190e6a-e916-4fdf-bde4-4f1c33e63a14" path="/var/lib/kubelet/pods/a7190e6a-e916-4fdf-bde4-4f1c33e63a14/volumes"
Sep 08 14:16:04.766169 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.766068    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:04.768196 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:16:04.768170    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff2f18a0_8b2a_4542_becc_ff92b5f0f903.slice/crio-053bdccc9141b9fccee3de749e9973316fe0c1c94f90d905e898d86c63889a94 WatchSource:0}: Error finding container 053bdccc9141b9fccee3de749e9973316fe0c1c94f90d905e898d86c63889a94: Status 404 returned error can't find the container with id 053bdccc9141b9fccee3de749e9973316fe0c1c94f90d905e898d86c63889a94
Sep 08 14:16:04.864359 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.864330    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:04.864550 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.864369    2559 scope.go:117] "RemoveContainer" containerID="431f47720e36af2ece5285982a0802b6be45d044620e636aeb056c8b1c42ac74"
Sep 08 14:16:04.865802 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:04.865779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5862-140681079666128" event={"ID":"ff2f18a0-8b2a-4542-becc-ff92b5f0f903","Type":"ContainerStarted","Data":"053bdccc9141b9fccee3de749e9973316fe0c1c94f90d905e898d86c63889a94"}
Sep 08 14:16:05.872590 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:05.872556    2559 generic.go:356] "Generic (PLEG): container finished" podID="ff2f18a0-8b2a-4542-becc-ff92b5f0f903" containerID="639f8aa904ab06806146626b54913f2af251f2d1d1dfddd3b719087f04ba7833" exitCode=0
Sep 08 14:16:05.873115 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:05.872683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-5862-140681079666128" event={"ID":"ff2f18a0-8b2a-4542-becc-ff92b5f0f903","Type":"ContainerDied","Data":"639f8aa904ab06806146626b54913f2af251f2d1d1dfddd3b719087f04ba7833"}
Sep 08 14:16:07.020278 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.020251    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:07.043857 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.043825    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-5862-140681079666128_ff2f18a0-8b2a-4542-becc-ff92b5f0f903/test-curl-5862-140681079666128/0.log"
Sep 08 14:16:07.082217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.082178    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9m9k\" (UniqueName: \"kubernetes.io/projected/ff2f18a0-8b2a-4542-becc-ff92b5f0f903-kube-api-access-j9m9k\") pod \"ff2f18a0-8b2a-4542-becc-ff92b5f0f903\" (UID: \"ff2f18a0-8b2a-4542-becc-ff92b5f0f903\") "
Sep 08 14:16:07.084432 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.084399    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2f18a0-8b2a-4542-becc-ff92b5f0f903-kube-api-access-j9m9k" (OuterVolumeSpecName: "kube-api-access-j9m9k") pod "ff2f18a0-8b2a-4542-becc-ff92b5f0f903" (UID: "ff2f18a0-8b2a-4542-becc-ff92b5f0f903"). InnerVolumeSpecName "kube-api-access-j9m9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:16:07.111757 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.111721    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:07.115829 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.115799    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-5862-140681079666128"]
Sep 08 14:16:07.183744 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.183650    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9m9k\" (UniqueName: \"kubernetes.io/projected/ff2f18a0-8b2a-4542-becc-ff92b5f0f903-kube-api-access-j9m9k\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:16:07.887453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.887426    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:07.887453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:07.887435    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="053bdccc9141b9fccee3de749e9973316fe0c1c94f90d905e898d86c63889a94"
Sep 08 14:16:07.898052 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:16:07.898014    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-5862-140681079666128\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" podUID="ff2f18a0-8b2a-4542-becc-ff92b5f0f903" pod="opendatahub/test-curl-5862-140681079666128"
Sep 08 14:16:08.168152 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:08.168058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:08.509005 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:08.508914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:08.583709 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:08.583666    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff2f18a0-8b2a-4542-becc-ff92b5f0f903" path="/var/lib/kubelet/pods/ff2f18a0-8b2a-4542-becc-ff92b5f0f903/volumes"
Sep 08 14:16:09.222639 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:09.222578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:11.470304 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:11.470268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:11.603425 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:11.603387    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:12.600664 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.600629    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"]
Sep 08 14:16:12.601203 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.601185    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2f18a0-8b2a-4542-becc-ff92b5f0f903" containerName="test-curl-5862-140681079666128"
Sep 08 14:16:12.601271 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.601205    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2f18a0-8b2a-4542-becc-ff92b5f0f903" containerName="test-curl-5862-140681079666128"
Sep 08 14:16:12.601328 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.601284    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2f18a0-8b2a-4542-becc-ff92b5f0f903" containerName="test-curl-5862-140681079666128"
Sep 08 14:16:12.604820 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.604799    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.608199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.608167    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2nwq2\""
Sep 08 14:16:12.608953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.608922    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ec7c379e-serving-cert\""
Sep 08 14:16:12.608953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.608953    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:16:12.609143 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.608933    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:16:12.609143 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.608928    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:16:12.629653 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.625731    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"]
Sep 08 14:16:12.650200 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.650165    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:12.737434 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.737401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.737666 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.737479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhpw9\" (UniqueName: \"kubernetes.io/projected/c217aa11-2fa2-4dc6-9f84-32f73f385410-kube-api-access-bhpw9\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.737666 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.737508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-metrics-certs\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.737666 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.737535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c217aa11-2fa2-4dc6-9f84-32f73f385410-openshift-service-ca\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.747125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.747099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:12.838415 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.838369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhpw9\" (UniqueName: \"kubernetes.io/projected/c217aa11-2fa2-4dc6-9f84-32f73f385410-kube-api-access-bhpw9\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.838415 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.838417    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-metrics-certs\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.838689 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.838449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c217aa11-2fa2-4dc6-9f84-32f73f385410-openshift-service-ca\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.838689 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.838474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.838689 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:16:12.838575    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-serving-cert: secret "maas-api-e2e-mt-ec7c379e-serving-cert" not found
Sep 08 14:16:12.838689 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:16:12.838671    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls podName:c217aa11-2fa2-4dc6-9f84-32f73f385410 nodeName:}" failed. No retries permitted until 2026-09-08 14:16:13.338649698 +0000 UTC m=+1069.252554591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls") pod "maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g" (UID: "c217aa11-2fa2-4dc6-9f84-32f73f385410") : secret "maas-api-e2e-mt-ec7c379e-serving-cert" not found
Sep 08 14:16:12.839174 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.839144    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c217aa11-2fa2-4dc6-9f84-32f73f385410-openshift-service-ca\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.841149 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.841124    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-metrics-certs\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.848253 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.848217    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhpw9\" (UniqueName: \"kubernetes.io/projected/c217aa11-2fa2-4dc6-9f84-32f73f385410-kube-api-access-bhpw9\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:12.959119 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:12.959011    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:13.269029 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.268939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:13.342004 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.341967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:13.344536 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.344504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls\") pod \"maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:13.360698 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.360664    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:13.410524 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.410488    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"]
Sep 08 14:16:13.413805 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.413781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:13.416217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.416199    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ec7c379e-dockercfg-4stf9\""
Sep 08 14:16:13.416472 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.416455    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ec7c379e\""
Sep 08 14:16:13.427824 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.427793    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"]
Sep 08 14:16:13.460480 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.460442    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"]
Sep 08 14:16:13.464047 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.464028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:13.476144 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.476114    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"]
Sep 08 14:16:13.518226 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.518191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:13.544804 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.544771    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-plugins-config-volume\") pod \"payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk\" (UID: \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\") " pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:13.544970 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.544825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn\" (UID: \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:13.544970 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.544857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq7m9\" (UniqueName: \"kubernetes.io/projected/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-kube-api-access-nq7m9\") pod \"payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn\" (UID: \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:13.544970 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.544880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7d6m\" (UniqueName: \"kubernetes.io/projected/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-kube-api-access-g7d6m\") pod \"payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk\" (UID: \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\") " pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:13.646358 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.646313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7d6m\" (UniqueName: \"kubernetes.io/projected/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-kube-api-access-g7d6m\") pod \"payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk\" (UID: \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\") " pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:13.646801 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.646386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-plugins-config-volume\") pod \"payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk\" (UID: \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\") " pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:13.646801 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.646418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn\" (UID: \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:13.646801 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.646444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7m9\" (UniqueName: \"kubernetes.io/projected/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-kube-api-access-nq7m9\") pod \"payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn\" (UID: \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:13.647195 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.647175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn\" (UID: \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:13.647237 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.647206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-plugins-config-volume\") pod \"payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk\" (UID: \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\") " pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:13.655108 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.655080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq7m9\" (UniqueName: \"kubernetes.io/projected/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-kube-api-access-nq7m9\") pod \"payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn\" (UID: \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:13.655248 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.655082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7d6m\" (UniqueName: \"kubernetes.io/projected/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-kube-api-access-g7d6m\") pod \"payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk\" (UID: \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\") " pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:13.723875 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.723830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:13.774757 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.774636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:13.803864 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.803825    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"]
Sep 08 14:16:13.805624 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:16:13.805574    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc217aa11_2fa2_4dc6_9f84_32f73f385410.slice/crio-e0cb87c134b5abd325eabed27301e72269531d2ca26593fc36d20e8b314a3d8b WatchSource:0}: Error finding container e0cb87c134b5abd325eabed27301e72269531d2ca26593fc36d20e8b314a3d8b: Status 404 returned error can't find the container with id e0cb87c134b5abd325eabed27301e72269531d2ca26593fc36d20e8b314a3d8b
Sep 08 14:16:13.921700 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:13.921668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g" event={"ID":"c217aa11-2fa2-4dc6-9f84-32f73f385410","Type":"ContainerStarted","Data":"e0cb87c134b5abd325eabed27301e72269531d2ca26593fc36d20e8b314a3d8b"}
Sep 08 14:16:14.006159 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.006120    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"]
Sep 08 14:16:14.008413 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:16:14.008376    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9720197_ee0e_41cd_ae13_2be4a2dff6ca.slice/crio-38d6f6d172f2482b0f5ffe54ad446e8b6d9ae9e0eccf40744204691f4c51500a WatchSource:0}: Error finding container 38d6f6d172f2482b0f5ffe54ad446e8b6d9ae9e0eccf40744204691f4c51500a: Status 404 returned error can't find the container with id 38d6f6d172f2482b0f5ffe54ad446e8b6d9ae9e0eccf40744204691f4c51500a
Sep 08 14:16:14.065841 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.065817    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"]
Sep 08 14:16:14.080891 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:16:14.080863    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c542bda_6c4e_4958_b9b9_52b3d7309fe5.slice/crio-db853c68f673ad01a8cc14e88f931c12bd6cefc8f74185421a08292f7549e43c WatchSource:0}: Error finding container db853c68f673ad01a8cc14e88f931c12bd6cefc8f74185421a08292f7549e43c: Status 404 returned error can't find the container with id db853c68f673ad01a8cc14e88f931c12bd6cefc8f74185421a08292f7549e43c
Sep 08 14:16:14.929593 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.929548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn" event={"ID":"4c542bda-6c4e-4958-b9b9-52b3d7309fe5","Type":"ContainerStarted","Data":"4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f"}
Sep 08 14:16:14.930135 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.929641    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn" event={"ID":"4c542bda-6c4e-4958-b9b9-52b3d7309fe5","Type":"ContainerStarted","Data":"db853c68f673ad01a8cc14e88f931c12bd6cefc8f74185421a08292f7549e43c"}
Sep 08 14:16:14.930135 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.929673    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:14.931368 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.931343    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk" event={"ID":"c9720197-ee0e-41cd-ae13-2be4a2dff6ca","Type":"ContainerStarted","Data":"511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860"}
Sep 08 14:16:14.931508 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.931389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk" event={"ID":"c9720197-ee0e-41cd-ae13-2be4a2dff6ca","Type":"ContainerStarted","Data":"38d6f6d172f2482b0f5ffe54ad446e8b6d9ae9e0eccf40744204691f4c51500a"}
Sep 08 14:16:14.931508 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.931439    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:14.932962 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.932935    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g" event={"ID":"c217aa11-2fa2-4dc6-9f84-32f73f385410","Type":"ContainerStarted","Data":"5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b"}
Sep 08 14:16:14.933083 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.933070    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:14.947473 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.947421    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn" podStartSLOduration=1.947400305 podStartE2EDuration="1.947400305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:16:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:16:14.945865142 +0000 UTC m=+1070.859770063" watchObservedRunningTime="2026-09-08 14:16:14.947400305 +0000 UTC m=+1070.861305223"
Sep 08 14:16:14.962830 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.962765    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk" podStartSLOduration=1.962742885 podStartE2EDuration="1.962742885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:16:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:16:14.962559625 +0000 UTC m=+1070.876464543" watchObservedRunningTime="2026-09-08 14:16:14.962742885 +0000 UTC m=+1070.876647803"
Sep 08 14:16:14.987293 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:14.987219    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g" podStartSLOduration=2.580365483 podStartE2EDuration="2.987194924s" totalImagesPullingTime="406.829441ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:16:14.982316563 +0000 UTC m=+1070.896221480" watchObservedRunningTime="2026-09-08 14:16:14.987194924 +0000 UTC m=+1070.901099841"
Sep 08 14:16:20.951863 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:20.951778    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:16:24.702165 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:24.702134    2559 scope.go:117] "RemoveContainer" containerID="1e10cc2240576a0b9c17629b9718ea8b17b714e735fc89e5f33bb949138bbfd4"
Sep 08 14:16:25.948552 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:25.948513    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:16:25.948960 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:25.948659    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:16:36.903754 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:36.903716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:16:43.511205 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:16:43.511170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:17:38.594181 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:17:38.594137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:18:00.230296 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:18:00.230215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:18:00.330833 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:18:00.330796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:18:20.925414 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:18:20.925378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:19:53.386435 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:19:53.386395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:00.910711 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:00.910671    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:01.010515 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:01.010468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:03.642426 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.642385    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"]
Sep 08 14:20:03.642848 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.642627    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g" podUID="c217aa11-2fa2-4dc6-9f84-32f73f385410" containerName="maas-api" containerID="cri-o://5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b" gracePeriod=30
Sep 08 14:20:03.675098 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.675060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:03.710071 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.710030    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"]
Sep 08 14:20:03.710320 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.710289    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk" podUID="c9720197-ee0e-41cd-ae13-2be4a2dff6ca" containerName="payload-processing" containerID="cri-o://511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860" gracePeriod=30
Sep 08 14:20:03.723841 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.723807    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"]
Sep 08 14:20:03.724090 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.724060    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn" podUID="4c542bda-6c4e-4958-b9b9-52b3d7309fe5" containerName="payload-pre-processing" containerID="cri-o://4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f" gracePeriod=30
Sep 08 14:20:03.762962 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.762926    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:03.868151 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.868115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:03.950648 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:03.950602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:04.019113 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.019085    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:20:04.037181 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.037152    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:20:04.040047 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.040020    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:20:04.101523 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.101486    2559 generic.go:356] "Generic (PLEG): container finished" podID="c9720197-ee0e-41cd-ae13-2be4a2dff6ca" containerID="511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860" exitCode=0
Sep 08 14:20:04.101734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.101535    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"
Sep 08 14:20:04.101734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.101574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk" event={"ID":"c9720197-ee0e-41cd-ae13-2be4a2dff6ca","Type":"ContainerDied","Data":"511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860"}
Sep 08 14:20:04.101734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.101648    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk" event={"ID":"c9720197-ee0e-41cd-ae13-2be4a2dff6ca","Type":"ContainerDied","Data":"38d6f6d172f2482b0f5ffe54ad446e8b6d9ae9e0eccf40744204691f4c51500a"}
Sep 08 14:20:04.101734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.101679    2559 scope.go:117] "RemoveContainer" containerID="511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860"
Sep 08 14:20:04.103141 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.103120    2559 generic.go:356] "Generic (PLEG): container finished" podID="c217aa11-2fa2-4dc6-9f84-32f73f385410" containerID="5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b" exitCode=0
Sep 08 14:20:04.103428 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.103167    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"
Sep 08 14:20:04.103428 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.103222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g" event={"ID":"c217aa11-2fa2-4dc6-9f84-32f73f385410","Type":"ContainerDied","Data":"5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b"}
Sep 08 14:20:04.103428 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.103265    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g" event={"ID":"c217aa11-2fa2-4dc6-9f84-32f73f385410","Type":"ContainerDied","Data":"e0cb87c134b5abd325eabed27301e72269531d2ca26593fc36d20e8b314a3d8b"}
Sep 08 14:20:04.104651 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.104630    2559 generic.go:356] "Generic (PLEG): container finished" podID="4c542bda-6c4e-4958-b9b9-52b3d7309fe5" containerID="4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f" exitCode=0
Sep 08 14:20:04.104790 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.104660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn" event={"ID":"4c542bda-6c4e-4958-b9b9-52b3d7309fe5","Type":"ContainerDied","Data":"4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f"}
Sep 08 14:20:04.104790 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.104685    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"
Sep 08 14:20:04.104790 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.104688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn" event={"ID":"4c542bda-6c4e-4958-b9b9-52b3d7309fe5","Type":"ContainerDied","Data":"db853c68f673ad01a8cc14e88f931c12bd6cefc8f74185421a08292f7549e43c"}
Sep 08 14:20:04.112122 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.112103    2559 scope.go:117] "RemoveContainer" containerID="511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860"
Sep 08 14:20:04.112443 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:20:04.112423    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860\": container with ID starting with 511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860 not found: ID does not exist" containerID="511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860"
Sep 08 14:20:04.112556 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.112450    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860"} err="failed to get container status \"511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860\": rpc error: code = NotFound desc = could not find container \"511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860\": container with ID starting with 511d172a695926f3dbe8bf64f1246eedcf7c8665526a328c6589ad28be620860 not found: ID does not exist"
Sep 08 14:20:04.112556 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.112468    2559 scope.go:117] "RemoveContainer" containerID="5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b"
Sep 08 14:20:04.121143 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.121119    2559 scope.go:117] "RemoveContainer" containerID="5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b"
Sep 08 14:20:04.121485 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:20:04.121464    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b\": container with ID starting with 5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b not found: ID does not exist" containerID="5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b"
Sep 08 14:20:04.121530 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.121497    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b"} err="failed to get container status \"5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b\": rpc error: code = NotFound desc = could not find container \"5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b\": container with ID starting with 5cc5f73ef1ce08004ca034cdc3dbb3d275ba7f1bf2d8b2c9b19e3f9fff15061b not found: ID does not exist"
Sep 08 14:20:04.121530 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.121515    2559 scope.go:117] "RemoveContainer" containerID="4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f"
Sep 08 14:20:04.129784 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.129765    2559 scope.go:117] "RemoveContainer" containerID="4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f"
Sep 08 14:20:04.130118 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:20:04.130096    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f\": container with ID starting with 4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f not found: ID does not exist" containerID="4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f"
Sep 08 14:20:04.130168 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.130126    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f"} err="failed to get container status \"4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f\": rpc error: code = NotFound desc = could not find container \"4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f\": container with ID starting with 4f807db7b83f90a42fd76b3de59f9dd84bba2daa032ee554f5497285bb1d9a2f not found: ID does not exist"
Sep 08 14:20:04.171706 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.171630    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhpw9\" (UniqueName: \"kubernetes.io/projected/c217aa11-2fa2-4dc6-9f84-32f73f385410-kube-api-access-bhpw9\") pod \"c217aa11-2fa2-4dc6-9f84-32f73f385410\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") "
Sep 08 14:20:04.171706 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.171683    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7d6m\" (UniqueName: \"kubernetes.io/projected/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-kube-api-access-g7d6m\") pod \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\" (UID: \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\") "
Sep 08 14:20:04.171926 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.171727    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-metrics-certs\") pod \"c217aa11-2fa2-4dc6-9f84-32f73f385410\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") "
Sep 08 14:20:04.171926 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.171746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-plugins-config-volume\") pod \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\" (UID: \"c9720197-ee0e-41cd-ae13-2be4a2dff6ca\") "
Sep 08 14:20:04.171926 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.171791    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls\") pod \"c217aa11-2fa2-4dc6-9f84-32f73f385410\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") "
Sep 08 14:20:04.171926 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.171821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-plugins-config-volume\") pod \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\" (UID: \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\") "
Sep 08 14:20:04.171926 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.171850    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c217aa11-2fa2-4dc6-9f84-32f73f385410-openshift-service-ca\") pod \"c217aa11-2fa2-4dc6-9f84-32f73f385410\" (UID: \"c217aa11-2fa2-4dc6-9f84-32f73f385410\") "
Sep 08 14:20:04.172294 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.172237    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c217aa11-2fa2-4dc6-9f84-32f73f385410-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c217aa11-2fa2-4dc6-9f84-32f73f385410" (UID: "c217aa11-2fa2-4dc6-9f84-32f73f385410"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:20:04.172294 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.172263    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4c542bda-6c4e-4958-b9b9-52b3d7309fe5" (UID: "4c542bda-6c4e-4958-b9b9-52b3d7309fe5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:20:04.172485 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.172259    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9720197-ee0e-41cd-ae13-2be4a2dff6ca" (UID: "c9720197-ee0e-41cd-ae13-2be4a2dff6ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:20:04.172485 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.172368    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq7m9\" (UniqueName: \"kubernetes.io/projected/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-kube-api-access-nq7m9\") pod \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\" (UID: \"4c542bda-6c4e-4958-b9b9-52b3d7309fe5\") "
Sep 08 14:20:04.172878 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.172853    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:20:04.172990 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.172880    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:20:04.172990 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.172896    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c217aa11-2fa2-4dc6-9f84-32f73f385410-openshift-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:20:04.174106 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.174074    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-kube-api-access-g7d6m" (OuterVolumeSpecName: "kube-api-access-g7d6m") pod "c9720197-ee0e-41cd-ae13-2be4a2dff6ca" (UID: "c9720197-ee0e-41cd-ae13-2be4a2dff6ca"). InnerVolumeSpecName "kube-api-access-g7d6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:20:04.174106 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.174088    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c217aa11-2fa2-4dc6-9f84-32f73f385410-kube-api-access-bhpw9" (OuterVolumeSpecName: "kube-api-access-bhpw9") pod "c217aa11-2fa2-4dc6-9f84-32f73f385410" (UID: "c217aa11-2fa2-4dc6-9f84-32f73f385410"). InnerVolumeSpecName "kube-api-access-bhpw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:20:04.174298 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.174275    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c217aa11-2fa2-4dc6-9f84-32f73f385410" (UID: "c217aa11-2fa2-4dc6-9f84-32f73f385410"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:20:04.174554 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.174534    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c217aa11-2fa2-4dc6-9f84-32f73f385410" (UID: "c217aa11-2fa2-4dc6-9f84-32f73f385410"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:20:04.174815 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.174795    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-kube-api-access-nq7m9" (OuterVolumeSpecName: "kube-api-access-nq7m9") pod "4c542bda-6c4e-4958-b9b9-52b3d7309fe5" (UID: "4c542bda-6c4e-4958-b9b9-52b3d7309fe5"). InnerVolumeSpecName "kube-api-access-nq7m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:20:04.273957 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.273918    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7d6m\" (UniqueName: \"kubernetes.io/projected/c9720197-ee0e-41cd-ae13-2be4a2dff6ca-kube-api-access-g7d6m\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:20:04.273957 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.273950    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-metrics-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:20:04.273957 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.273958    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c217aa11-2fa2-4dc6-9f84-32f73f385410-maas-api-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:20:04.273957 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.273969    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq7m9\" (UniqueName: \"kubernetes.io/projected/4c542bda-6c4e-4958-b9b9-52b3d7309fe5-kube-api-access-nq7m9\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:20:04.274241 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.273979    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhpw9\" (UniqueName: \"kubernetes.io/projected/c217aa11-2fa2-4dc6-9f84-32f73f385410-kube-api-access-bhpw9\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:20:04.334444 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.334411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:04.426576 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.426497    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"]
Sep 08 14:20:04.432322 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.432294    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ec7c379e-5cdfc5bf8f-l89fk"]
Sep 08 14:20:04.449128 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.449092    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"]
Sep 08 14:20:04.453388 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.453358    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec7c379e-65c5c48bc8-w5c8g"]
Sep 08 14:20:04.468041 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.468000    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"]
Sep 08 14:20:04.476127 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.476096    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ec7c379e-5c95f6ff5d-8v9rn"]
Sep 08 14:20:04.584971 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.584550    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c542bda-6c4e-4958-b9b9-52b3d7309fe5" path="/var/lib/kubelet/pods/4c542bda-6c4e-4958-b9b9-52b3d7309fe5/volumes"
Sep 08 14:20:04.586157 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.585215    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c217aa11-2fa2-4dc6-9f84-32f73f385410" path="/var/lib/kubelet/pods/c217aa11-2fa2-4dc6-9f84-32f73f385410/volumes"
Sep 08 14:20:04.586157 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:04.585773    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9720197-ee0e-41cd-ae13-2be4a2dff6ca" path="/var/lib/kubelet/pods/c9720197-ee0e-41cd-ae13-2be4a2dff6ca/volumes"
Sep 08 14:20:09.401638 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:09.401578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:23.282311 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:23.282276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:24.542355 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:24.542323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:46.162905 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:46.162829    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:46.916595 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:46.916551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:51.314100 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:51.314068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:53.032557 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:53.032524    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:53.135323 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:53.135257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:53.319831 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:53.319751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:54.676521 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:54.676481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:54.779211 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:54.779175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:54.879286 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:54.879260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:55.499475 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:55.499446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:55.592564 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:55.592532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:55.700260 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:55.700225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:20:56.987109 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:20:56.987075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:03.145318 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:03.145290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:03.210284 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:03.210251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:03.807514 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:03.807480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:09.885806 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:09.885777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:09.997007 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:09.996974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:10.098421 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:10.098384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:20.696032 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:20.695998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:20.931480 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:20.931445    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:39.571990 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:39.571950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:42.012816 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:42.012783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:47.608604 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:47.608573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:48.379168 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:48.379142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:48.454744 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:48.454696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:48.880353 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:48.880321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:49.254784 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:49.254710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:49.420923 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:49.420889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:52.458857 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:52.458821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:52.573321 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:52.573290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:53.583298 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583269    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"]
Sep 08 14:21:53.583704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583597    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c217aa11-2fa2-4dc6-9f84-32f73f385410" containerName="maas-api"
Sep 08 14:21:53.583704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583625    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c217aa11-2fa2-4dc6-9f84-32f73f385410" containerName="maas-api"
Sep 08 14:21:53.583704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583640    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9720197-ee0e-41cd-ae13-2be4a2dff6ca" containerName="payload-processing"
Sep 08 14:21:53.583704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583646    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9720197-ee0e-41cd-ae13-2be4a2dff6ca" containerName="payload-processing"
Sep 08 14:21:53.583704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583661    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c542bda-6c4e-4958-b9b9-52b3d7309fe5" containerName="payload-pre-processing"
Sep 08 14:21:53.583704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583667    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c542bda-6c4e-4958-b9b9-52b3d7309fe5" containerName="payload-pre-processing"
Sep 08 14:21:53.583900 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583724    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c217aa11-2fa2-4dc6-9f84-32f73f385410" containerName="maas-api"
Sep 08 14:21:53.583900 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583732    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c542bda-6c4e-4958-b9b9-52b3d7309fe5" containerName="payload-pre-processing"
Sep 08 14:21:53.583900 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.583737    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9720197-ee0e-41cd-ae13-2be4a2dff6ca" containerName="payload-processing"
Sep 08 14:21:53.586554 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.586537    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.591217 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.591191    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a8b757-serving-cert\""
Sep 08 14:21:53.591335 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.591200    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:21:53.591335 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.591288    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:21:53.591543 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.591530    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2nwq2\""
Sep 08 14:21:53.591963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.591940    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:21:53.611602 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.611574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"]
Sep 08 14:21:53.643553 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.643523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:53.736082 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.736054    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:53.738675 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.738657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-metrics-certs\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.738794 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.738701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.738794 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.738743    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24gh\" (UniqueName: \"kubernetes.io/projected/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-kube-api-access-q24gh\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.738906 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.738800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-openshift-service-ca\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.839427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.839349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.839427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.839388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q24gh\" (UniqueName: \"kubernetes.io/projected/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-kube-api-access-q24gh\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.839427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.839411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-openshift-service-ca\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.839739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.839465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-metrics-certs\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.839739 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:21:53.839511    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-serving-cert: secret "maas-api-e2e-api-a-a8b757-serving-cert" not found
Sep 08 14:21:53.839739 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:21:53.839584    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls podName:9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd nodeName:}" failed. No retries permitted until 2026-09-08 14:21:54.339564454 +0000 UTC m=+1410.253469360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls") pod "maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v" (UID: "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd") : secret "maas-api-e2e-api-a-a8b757-serving-cert" not found
Sep 08 14:21:53.840082 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.840062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-openshift-service-ca\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.841795 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.841775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-metrics-certs\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.848961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.848939    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24gh\" (UniqueName: \"kubernetes.io/projected/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-kube-api-access-q24gh\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:53.965811 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:53.965776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:54.342784 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.342755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:54.343878 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.343850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:54.346326 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.346310    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls\") pod \"maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:54.436882 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.436842    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:21:54.461948 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.461923    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"]
Sep 08 14:21:54.465521 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.465504    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:54.468434 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:21:54.468408    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" podUID="d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:54.468865 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:21:54.468832    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-api-a-a8b757\" is forbidden: User \"system:node:ip-10-0-142-105.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-105.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a8b757\"" type="*v1.ConfigMap"
Sep 08 14:21:54.478044 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.478023    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"]
Sep 08 14:21:54.496908 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.496882    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:54.604014 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.603934    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"]
Sep 08 14:21:54.607812 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.607788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:54.610408 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.610387    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a8b757-dockercfg-rpsg8\""
Sep 08 14:21:54.620434 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.620406    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"]
Sep 08 14:21:54.647409 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.647384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt\" (UID: \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:54.647541 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.647423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wndqp\" (UniqueName: \"kubernetes.io/projected/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-kube-api-access-wndqp\") pod \"payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt\" (UID: \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:54.748584 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.748554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wndqp\" (UniqueName: \"kubernetes.io/projected/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-kube-api-access-wndqp\") pod \"payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt\" (UID: \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:54.748766 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.748652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q275p\" (UniqueName: \"kubernetes.io/projected/a3292e57-8957-46e2-b084-53cb4cfa712d-kube-api-access-q275p\") pod \"payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj\" (UID: \"a3292e57-8957-46e2-b084-53cb4cfa712d\") " pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:54.748766 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.748691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3292e57-8957-46e2-b084-53cb4cfa712d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj\" (UID: \"a3292e57-8957-46e2-b084-53cb4cfa712d\") " pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:54.748766 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.748707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt\" (UID: \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:54.763246 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.763220    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wndqp\" (UniqueName: \"kubernetes.io/projected/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-kube-api-access-wndqp\") pod \"payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt\" (UID: \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:54.779453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.779429    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"]
Sep 08 14:21:54.782362 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:21:54.782340    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b93e07d_d1f8_4fd0_a1da_b737a2fe3bfd.slice/crio-c9653f28f1bb4d5a02d791eea875ac7ed78281cce4c25dbc4442b1c410a19003 WatchSource:0}: Error finding container c9653f28f1bb4d5a02d791eea875ac7ed78281cce4c25dbc4442b1c410a19003: Status 404 returned error can't find the container with id c9653f28f1bb4d5a02d791eea875ac7ed78281cce4c25dbc4442b1c410a19003
Sep 08 14:21:54.783703 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.783685    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:21:54.849673 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.849646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3292e57-8957-46e2-b084-53cb4cfa712d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj\" (UID: \"a3292e57-8957-46e2-b084-53cb4cfa712d\") " pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:54.849815 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.849763    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q275p\" (UniqueName: \"kubernetes.io/projected/a3292e57-8957-46e2-b084-53cb4cfa712d-kube-api-access-q275p\") pod \"payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj\" (UID: \"a3292e57-8957-46e2-b084-53cb4cfa712d\") " pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:54.859107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:54.859052    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q275p\" (UniqueName: \"kubernetes.io/projected/a3292e57-8957-46e2-b084-53cb4cfa712d-kube-api-access-q275p\") pod \"payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj\" (UID: \"a3292e57-8957-46e2-b084-53cb4cfa712d\") " pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:55.643046 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:55.643018    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a8b757\""
Sep 08 14:21:55.650129 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:55.650104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt\" (UID: \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:55.650572 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:55.650557    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3292e57-8957-46e2-b084-53cb4cfa712d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj\" (UID: \"a3292e57-8957-46e2-b084-53cb4cfa712d\") " pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:55.665186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:55.665154    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v" event={"ID":"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd","Type":"ContainerStarted","Data":"c9653f28f1bb4d5a02d791eea875ac7ed78281cce4c25dbc4442b1c410a19003"}
Sep 08 14:21:55.676421 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:55.676396    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:55.818593 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:55.818560    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:55.953126 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:55.953099    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"]
Sep 08 14:21:55.954195 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:21:55.954161    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ed5baf_ba7e_4ab4_86d2_66c1277d5fd4.slice/crio-d564b7462fc85763ed76c27a6c5e4d8b96eb81ea39033bc29194bd00ba28f66f WatchSource:0}: Error finding container d564b7462fc85763ed76c27a6c5e4d8b96eb81ea39033bc29194bd00ba28f66f: Status 404 returned error can't find the container with id d564b7462fc85763ed76c27a6c5e4d8b96eb81ea39033bc29194bd00ba28f66f
Sep 08 14:21:56.098839 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.098801    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"]
Sep 08 14:21:56.100895 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:21:56.100870    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3292e57_8957_46e2_b084_53cb4cfa712d.slice/crio-e61c83d09db8a44b35aca256a011661d2a2191f301a8e96864ccd692139531c9 WatchSource:0}: Error finding container e61c83d09db8a44b35aca256a011661d2a2191f301a8e96864ccd692139531c9: Status 404 returned error can't find the container with id e61c83d09db8a44b35aca256a011661d2a2191f301a8e96864ccd692139531c9
Sep 08 14:21:56.678622 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.678583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj" event={"ID":"a3292e57-8957-46e2-b084-53cb4cfa712d","Type":"ContainerStarted","Data":"2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e"}
Sep 08 14:21:56.679102 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.678697    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:21:56.679102 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.678724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj" event={"ID":"a3292e57-8957-46e2-b084-53cb4cfa712d","Type":"ContainerStarted","Data":"e61c83d09db8a44b35aca256a011661d2a2191f301a8e96864ccd692139531c9"}
Sep 08 14:21:56.680223 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.680196    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt" event={"ID":"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4","Type":"ContainerStarted","Data":"d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f"}
Sep 08 14:21:56.680333 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.680244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt" event={"ID":"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4","Type":"ContainerStarted","Data":"d564b7462fc85763ed76c27a6c5e4d8b96eb81ea39033bc29194bd00ba28f66f"}
Sep 08 14:21:56.680333 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.680299    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:21:56.701797 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.701747    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj" podStartSLOduration=2.70172941 podStartE2EDuration="2.70172941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:21:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:21:56.698739268 +0000 UTC m=+1412.612644202" watchObservedRunningTime="2026-09-08 14:21:56.70172941 +0000 UTC m=+1412.615634328"
Sep 08 14:21:56.719125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:56.719074    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt" podStartSLOduration=2.719057362 podStartE2EDuration="2.719057362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:21:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:21:56.716987308 +0000 UTC m=+1412.630892225" watchObservedRunningTime="2026-09-08 14:21:56.719057362 +0000 UTC m=+1412.632962279"
Sep 08 14:21:57.686193 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:57.686156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v" event={"ID":"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd","Type":"ContainerStarted","Data":"579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437"}
Sep 08 14:21:57.686700 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:57.686529    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:21:57.707837 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:21:57.707784    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v" podStartSLOduration=2.718908912 podStartE2EDuration="4.707769544s" totalImagesPullingTime="1.988860632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:21:57.70543207 +0000 UTC m=+1413.619336987" watchObservedRunningTime="2026-09-08 14:21:57.707769544 +0000 UTC m=+1413.621674460"
Sep 08 14:22:04.703255 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:04.703220    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:22:07.688133 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:07.688094    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:22:07.688556 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:07.688167    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:22:17.353483 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:17.353404    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:17.806486 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:17.806445    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:18.131038 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:18.130963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:18.316235 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:18.316198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:21.499466 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:21.499425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:21.609825 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:21.609793    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:22.563700 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.563665    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"]
Sep 08 14:22:22.567781 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.567761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.570966 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.570944    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2310c4-serving-cert\""
Sep 08 14:22:22.583839 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.583815    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"]
Sep 08 14:22:22.611655 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.611633    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:22.672938 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.672914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06945c4-f5f0-4801-8ada-53cb5f0967c8-openshift-service-ca\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.673043 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.672955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.673043 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.672977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-metrics-certs\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.673043 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.672994    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42rpt\" (UniqueName: \"kubernetes.io/projected/e06945c4-f5f0-4801-8ada-53cb5f0967c8-kube-api-access-42rpt\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.710264 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.710217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:22.773884 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.773846    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06945c4-f5f0-4801-8ada-53cb5f0967c8-openshift-service-ca\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.774031 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.773903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.774031 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.773924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-metrics-certs\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.774031 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.773941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42rpt\" (UniqueName: \"kubernetes.io/projected/e06945c4-f5f0-4801-8ada-53cb5f0967c8-kube-api-access-42rpt\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.774223 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:22:22.774066    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-serving-cert: secret "maas-api-e2e-api-b-2310c4-serving-cert" not found
Sep 08 14:22:22.774223 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:22:22.774137    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls podName:e06945c4-f5f0-4801-8ada-53cb5f0967c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:22:23.274117892 +0000 UTC m=+1439.188022792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls") pod "maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2" (UID: "e06945c4-f5f0-4801-8ada-53cb5f0967c8") : secret "maas-api-e2e-api-b-2310c4-serving-cert" not found
Sep 08 14:22:22.774544 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.774521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06945c4-f5f0-4801-8ada-53cb5f0967c8-openshift-service-ca\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.776478 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.776451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-metrics-certs\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.783333 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.783304    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42rpt\" (UniqueName: \"kubernetes.io/projected/e06945c4-f5f0-4801-8ada-53cb5f0967c8-kube-api-access-42rpt\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:22.889295 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:22.889228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:23.139146 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.139115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:23.224520 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.224433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:23.279866 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.279837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:23.282681 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.282657    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls\") pod \"maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:23.317184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.317152    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"]
Sep 08 14:22:23.320624 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.320586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:23.323142 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.323121    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-2310c4-dockercfg-wwvk8\""
Sep 08 14:22:23.323378 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.323360    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-2310c4\""
Sep 08 14:22:23.331868 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.331849    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"]
Sep 08 14:22:23.381434 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.381402    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lqzm\" (UniqueName: \"kubernetes.io/projected/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-kube-api-access-9lqzm\") pod \"payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k\" (UID: \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:23.381641 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.381454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k\" (UID: \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:23.480148 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.480065    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:23.482398 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.482375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lqzm\" (UniqueName: \"kubernetes.io/projected/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-kube-api-access-9lqzm\") pod \"payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k\" (UID: \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:23.482478 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.482419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k\" (UID: \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:23.483130 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.483109    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k\" (UID: \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:23.491990 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.491967    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lqzm\" (UniqueName: \"kubernetes.io/projected/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-kube-api-access-9lqzm\") pod \"payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k\" (UID: \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:23.632200 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.632168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:23.754586 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.754563    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"]
Sep 08 14:22:23.756694 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:22:23.756669    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06945c4_f5f0_4801_8ada_53cb5f0967c8.slice/crio-f26e76274bf07f04c7d8922f24c2835de7354da3f9e8b0b676e7612b9d93dc43 WatchSource:0}: Error finding container f26e76274bf07f04c7d8922f24c2835de7354da3f9e8b0b676e7612b9d93dc43: Status 404 returned error can't find the container with id f26e76274bf07f04c7d8922f24c2835de7354da3f9e8b0b676e7612b9d93dc43
Sep 08 14:22:23.818999 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.818972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2" event={"ID":"e06945c4-f5f0-4801-8ada-53cb5f0967c8","Type":"ContainerStarted","Data":"f26e76274bf07f04c7d8922f24c2835de7354da3f9e8b0b676e7612b9d93dc43"}
Sep 08 14:22:23.905416 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:23.905387    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"]
Sep 08 14:22:23.908775 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:22:23.908749    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3defca_b853_4a58_ac46_7f64e3a9c0e8.slice/crio-40c05c9bdc12f14337c9d40f6290c6a71cc5f79f444a9056f2ed5d3ff99ff3df WatchSource:0}: Error finding container 40c05c9bdc12f14337c9d40f6290c6a71cc5f79f444a9056f2ed5d3ff99ff3df: Status 404 returned error can't find the container with id 40c05c9bdc12f14337c9d40f6290c6a71cc5f79f444a9056f2ed5d3ff99ff3df
Sep 08 14:22:24.798537 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.798511    2559 scope.go:117] "RemoveContainer" containerID="639f8aa904ab06806146626b54913f2af251f2d1d1dfddd3b719087f04ba7833"
Sep 08 14:22:24.806837 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.806819    2559 scope.go:117] "RemoveContainer" containerID="e0fbdb66a285b28de7a151537a3698e633403a1e4cdcdb25589bbf1e566d5e48"
Sep 08 14:22:24.825130 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.825101    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k" event={"ID":"6b3defca-b853-4a58-ac46-7f64e3a9c0e8","Type":"ContainerStarted","Data":"3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7"}
Sep 08 14:22:24.825252 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.825173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k" event={"ID":"6b3defca-b853-4a58-ac46-7f64e3a9c0e8","Type":"ContainerStarted","Data":"40c05c9bdc12f14337c9d40f6290c6a71cc5f79f444a9056f2ed5d3ff99ff3df"}
Sep 08 14:22:24.825252 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.825204    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:24.827773 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.827744    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2" event={"ID":"e06945c4-f5f0-4801-8ada-53cb5f0967c8","Type":"ContainerStarted","Data":"aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c"}
Sep 08 14:22:24.827895 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.827876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:24.846689 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.846639    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k" podStartSLOduration=1.8466043509999999 podStartE2EDuration="1.846604351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:24.845044937 +0000 UTC m=+1440.758949853" watchObservedRunningTime="2026-09-08 14:22:24.846604351 +0000 UTC m=+1440.760509296"
Sep 08 14:22:24.865384 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:24.865342    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2" podStartSLOduration=2.415771819 podStartE2EDuration="2.865330517s" totalImagesPullingTime="449.558698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:24.863156254 +0000 UTC m=+1440.777061171" watchObservedRunningTime="2026-09-08 14:22:24.865330517 +0000 UTC m=+1440.779235434"
Sep 08 14:22:30.838855 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:30.838827    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:22:35.835345 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:35.835313    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:22:45.199028 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:45.198990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:47.629188 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:47.629144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:22:49.741078 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:22:49.741031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:05.175303 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.175271    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"]
Sep 08 14:23:05.175807 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.175497    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v" podUID="9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" containerName="maas-api" containerID="cri-o://579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437" gracePeriod=30
Sep 08 14:23:05.203768 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.203716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:05.227664 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.227634    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"]
Sep 08 14:23:05.227894 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.227872    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj" podUID="a3292e57-8957-46e2-b084-53cb4cfa712d" containerName="payload-processing" containerID="cri-o://2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e" gracePeriod=30
Sep 08 14:23:05.233253 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.233225    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"]
Sep 08 14:23:05.233519 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.233471    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt" podUID="d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" containerName="payload-pre-processing" containerID="cri-o://d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f" gracePeriod=30
Sep 08 14:23:05.304414 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.304358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:05.409850 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.409745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:05.518125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.518106    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:23:05.521360 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.521340    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:23:05.540357 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.540335    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:23:05.567688 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.567659    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q24gh\" (UniqueName: \"kubernetes.io/projected/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-kube-api-access-q24gh\") pod \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") "
Sep 08 14:23:05.567825 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.567696    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wndqp\" (UniqueName: \"kubernetes.io/projected/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-kube-api-access-wndqp\") pod \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\" (UID: \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\") "
Sep 08 14:23:05.567825 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.567737    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3292e57-8957-46e2-b084-53cb4cfa712d-plugins-config-volume\") pod \"a3292e57-8957-46e2-b084-53cb4cfa712d\" (UID: \"a3292e57-8957-46e2-b084-53cb4cfa712d\") "
Sep 08 14:23:05.567825 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.567769    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-openshift-service-ca\") pod \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") "
Sep 08 14:23:05.567825 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.567803    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-plugins-config-volume\") pod \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\" (UID: \"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4\") "
Sep 08 14:23:05.568046 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.567872    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls\") pod \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") "
Sep 08 14:23:05.568046 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.567922    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-metrics-certs\") pod \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\" (UID: \"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd\") "
Sep 08 14:23:05.568046 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.567946    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q275p\" (UniqueName: \"kubernetes.io/projected/a3292e57-8957-46e2-b084-53cb4cfa712d-kube-api-access-q275p\") pod \"a3292e57-8957-46e2-b084-53cb4cfa712d\" (UID: \"a3292e57-8957-46e2-b084-53cb4cfa712d\") "
Sep 08 14:23:05.568184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.568139    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" (UID: "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:23:05.568184 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.568156    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3292e57-8957-46e2-b084-53cb4cfa712d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3292e57-8957-46e2-b084-53cb4cfa712d" (UID: "a3292e57-8957-46e2-b084-53cb4cfa712d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:23:05.568294 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.568235    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" (UID: "d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:23:05.568354 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.568294    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3292e57-8957-46e2-b084-53cb4cfa712d-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:05.568354 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.568314    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-openshift-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:05.570049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.570027    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-kube-api-access-q24gh" (OuterVolumeSpecName: "kube-api-access-q24gh") pod "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" (UID: "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd"). InnerVolumeSpecName "kube-api-access-q24gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:23:05.570144 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.570045    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-kube-api-access-wndqp" (OuterVolumeSpecName: "kube-api-access-wndqp") pod "d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" (UID: "d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4"). InnerVolumeSpecName "kube-api-access-wndqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:23:05.570218 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.570204    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3292e57-8957-46e2-b084-53cb4cfa712d-kube-api-access-q275p" (OuterVolumeSpecName: "kube-api-access-q275p") pod "a3292e57-8957-46e2-b084-53cb4cfa712d" (UID: "a3292e57-8957-46e2-b084-53cb4cfa712d"). InnerVolumeSpecName "kube-api-access-q275p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:23:05.570812 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.570782    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" (UID: "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:23:05.570812 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.570793    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" (UID: "9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:23:05.578350 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.578325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:05.669252 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.669220    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q24gh\" (UniqueName: \"kubernetes.io/projected/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-kube-api-access-q24gh\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:05.669252 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.669251    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wndqp\" (UniqueName: \"kubernetes.io/projected/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-kube-api-access-wndqp\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:05.669465 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.669265    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:05.669465 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.669280    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-maas-api-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:05.669465 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.669292    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd-metrics-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:05.669465 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:05.669303    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q275p\" (UniqueName: \"kubernetes.io/projected/a3292e57-8957-46e2-b084-53cb4cfa712d-kube-api-access-q275p\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:06.051733 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.051697    2559 generic.go:356] "Generic (PLEG): container finished" podID="a3292e57-8957-46e2-b084-53cb4cfa712d" containerID="2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e" exitCode=0
Sep 08 14:23:06.051932 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.051753    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"
Sep 08 14:23:06.051932 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.051776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj" event={"ID":"a3292e57-8957-46e2-b084-53cb4cfa712d","Type":"ContainerDied","Data":"2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e"}
Sep 08 14:23:06.051932 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.051829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj" event={"ID":"a3292e57-8957-46e2-b084-53cb4cfa712d","Type":"ContainerDied","Data":"e61c83d09db8a44b35aca256a011661d2a2191f301a8e96864ccd692139531c9"}
Sep 08 14:23:06.051932 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.051861    2559 scope.go:117] "RemoveContainer" containerID="2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e"
Sep 08 14:23:06.053318 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.053296    2559 generic.go:356] "Generic (PLEG): container finished" podID="9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" containerID="579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437" exitCode=0
Sep 08 14:23:06.053430 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.053348    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"
Sep 08 14:23:06.053430 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.053412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v" event={"ID":"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd","Type":"ContainerDied","Data":"579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437"}
Sep 08 14:23:06.053518 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.053468    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v" event={"ID":"9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd","Type":"ContainerDied","Data":"c9653f28f1bb4d5a02d791eea875ac7ed78281cce4c25dbc4442b1c410a19003"}
Sep 08 14:23:06.055094 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.055070    2559 generic.go:356] "Generic (PLEG): container finished" podID="d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" containerID="d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f" exitCode=0
Sep 08 14:23:06.055199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.055128    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"
Sep 08 14:23:06.055199 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.055150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt" event={"ID":"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4","Type":"ContainerDied","Data":"d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f"}
Sep 08 14:23:06.055294 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.055209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt" event={"ID":"d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4","Type":"ContainerDied","Data":"d564b7462fc85763ed76c27a6c5e4d8b96eb81ea39033bc29194bd00ba28f66f"}
Sep 08 14:23:06.063029 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.062877    2559 scope.go:117] "RemoveContainer" containerID="2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e"
Sep 08 14:23:06.063267 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:23:06.063240    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e\": container with ID starting with 2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e not found: ID does not exist" containerID="2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e"
Sep 08 14:23:06.063319 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.063280    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e"} err="failed to get container status \"2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e\": rpc error: code = NotFound desc = could not find container \"2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e\": container with ID starting with 2f54f5018ec8ac3406facc48c71e45915dbfa37de80fbd739c8546ed8c6ac93e not found: ID does not exist"
Sep 08 14:23:06.063319 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.063306    2559 scope.go:117] "RemoveContainer" containerID="579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437"
Sep 08 14:23:06.071851 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.071832    2559 scope.go:117] "RemoveContainer" containerID="579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437"
Sep 08 14:23:06.072155 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:23:06.072134    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437\": container with ID starting with 579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437 not found: ID does not exist" containerID="579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437"
Sep 08 14:23:06.072222 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.072165    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437"} err="failed to get container status \"579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437\": rpc error: code = NotFound desc = could not find container \"579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437\": container with ID starting with 579a4f81258f2fed2b21c61004ea8ac6750bd3207ca879e3333ff61ee191f437 not found: ID does not exist"
Sep 08 14:23:06.072222 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.072185    2559 scope.go:117] "RemoveContainer" containerID="d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f"
Sep 08 14:23:06.079957 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.079941    2559 scope.go:117] "RemoveContainer" containerID="d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f"
Sep 08 14:23:06.080220 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:23:06.080202    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f\": container with ID starting with d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f not found: ID does not exist" containerID="d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f"
Sep 08 14:23:06.080278 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.080227    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f"} err="failed to get container status \"d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f\": rpc error: code = NotFound desc = could not find container \"d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f\": container with ID starting with d3bba85544c2a65cec828ad63d2378a41ac9c2132cd29235c70e249ebf00971f not found: ID does not exist"
Sep 08 14:23:06.093565 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.093538    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"]
Sep 08 14:23:06.099270 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.099246    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a8b757-6d4db5c7dc-zxwqj"]
Sep 08 14:23:06.110224 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.110200    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"]
Sep 08 14:23:06.111953 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.111934    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a8b757-85b84896cd-lmzmt"]
Sep 08 14:23:06.122302 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.122274    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"]
Sep 08 14:23:06.128977 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.128955    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a8b757-c8d7795df-rbn8v"]
Sep 08 14:23:06.581072 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.581043    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" path="/var/lib/kubelet/pods/9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd/volumes"
Sep 08 14:23:06.581411 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.581361    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3292e57-8957-46e2-b084-53cb4cfa712d" path="/var/lib/kubelet/pods/a3292e57-8957-46e2-b084-53cb4cfa712d/volumes"
Sep 08 14:23:06.581688 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:06.581676    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" path="/var/lib/kubelet/pods/d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4/volumes"
Sep 08 14:23:07.258280 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:07.258245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:12.226669 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:12.226636    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:12.334787 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:12.334757    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:12.525841 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:12.525763    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:13.043125 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:13.043092    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:28.345525 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.345472    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"]
Sep 08 14:23:28.346025 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.345765    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2" podUID="e06945c4-f5f0-4801-8ada-53cb5f0967c8" containerName="maas-api" containerID="cri-o://aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c" gracePeriod=30
Sep 08 14:23:28.377901 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.377859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:28.419256 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.419219    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"]
Sep 08 14:23:28.419521 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.419487    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k" podUID="6b3defca-b853-4a58-ac46-7f64e3a9c0e8" containerName="payload-pre-processing" containerID="cri-o://3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7" gracePeriod=30
Sep 08 14:23:28.478164 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.478133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:28.583318 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.582987    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:28.668105 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.668064    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:23:28.676572 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.676549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:28.700173 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.700150    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:23:28.776239 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.776202    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42rpt\" (UniqueName: \"kubernetes.io/projected/e06945c4-f5f0-4801-8ada-53cb5f0967c8-kube-api-access-42rpt\") pod \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") "
Sep 08 14:23:28.776433 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.776269    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-metrics-certs\") pod \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") "
Sep 08 14:23:28.776433 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.776313    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06945c4-f5f0-4801-8ada-53cb5f0967c8-openshift-service-ca\") pod \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") "
Sep 08 14:23:28.776433 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.776359    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lqzm\" (UniqueName: \"kubernetes.io/projected/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-kube-api-access-9lqzm\") pod \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\" (UID: \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\") "
Sep 08 14:23:28.776433 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.776397    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls\") pod \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\" (UID: \"e06945c4-f5f0-4801-8ada-53cb5f0967c8\") "
Sep 08 14:23:28.776683 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.776455    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-plugins-config-volume\") pod \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\" (UID: \"6b3defca-b853-4a58-ac46-7f64e3a9c0e8\") "
Sep 08 14:23:28.776896 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.776769    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06945c4-f5f0-4801-8ada-53cb5f0967c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e06945c4-f5f0-4801-8ada-53cb5f0967c8" (UID: "e06945c4-f5f0-4801-8ada-53cb5f0967c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:23:28.777073 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.776944    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b3defca-b853-4a58-ac46-7f64e3a9c0e8" (UID: "6b3defca-b853-4a58-ac46-7f64e3a9c0e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:23:28.778666 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.778639    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06945c4-f5f0-4801-8ada-53cb5f0967c8-kube-api-access-42rpt" (OuterVolumeSpecName: "kube-api-access-42rpt") pod "e06945c4-f5f0-4801-8ada-53cb5f0967c8" (UID: "e06945c4-f5f0-4801-8ada-53cb5f0967c8"). InnerVolumeSpecName "kube-api-access-42rpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:23:28.778954 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.778930    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e06945c4-f5f0-4801-8ada-53cb5f0967c8" (UID: "e06945c4-f5f0-4801-8ada-53cb5f0967c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:23:28.779194 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.779168    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e06945c4-f5f0-4801-8ada-53cb5f0967c8" (UID: "e06945c4-f5f0-4801-8ada-53cb5f0967c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:23:28.779194 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.779178    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-kube-api-access-9lqzm" (OuterVolumeSpecName: "kube-api-access-9lqzm") pod "6b3defca-b853-4a58-ac46-7f64e3a9c0e8" (UID: "6b3defca-b853-4a58-ac46-7f64e3a9c0e8"). InnerVolumeSpecName "kube-api-access-9lqzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:23:28.877462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.877364    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lqzm\" (UniqueName: \"kubernetes.io/projected/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-kube-api-access-9lqzm\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:28.877462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.877401    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-maas-api-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:28.877462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.877413    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b3defca-b853-4a58-ac46-7f64e3a9c0e8-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:28.877462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.877425    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42rpt\" (UniqueName: \"kubernetes.io/projected/e06945c4-f5f0-4801-8ada-53cb5f0967c8-kube-api-access-42rpt\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:28.877462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.877438    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06945c4-f5f0-4801-8ada-53cb5f0967c8-metrics-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:28.877462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:28.877450    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06945c4-f5f0-4801-8ada-53cb5f0967c8-openshift-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:29.047398 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.047355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:29.172858 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.172778    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b3defca-b853-4a58-ac46-7f64e3a9c0e8" containerID="3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7" exitCode=0
Sep 08 14:23:29.172858 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.172825    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"
Sep 08 14:23:29.173099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.172867    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k" event={"ID":"6b3defca-b853-4a58-ac46-7f64e3a9c0e8","Type":"ContainerDied","Data":"3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7"}
Sep 08 14:23:29.173099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.172919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k" event={"ID":"6b3defca-b853-4a58-ac46-7f64e3a9c0e8","Type":"ContainerDied","Data":"40c05c9bdc12f14337c9d40f6290c6a71cc5f79f444a9056f2ed5d3ff99ff3df"}
Sep 08 14:23:29.173099 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.172951    2559 scope.go:117] "RemoveContainer" containerID="3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7"
Sep 08 14:23:29.174468 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.174439    2559 generic.go:356] "Generic (PLEG): container finished" podID="e06945c4-f5f0-4801-8ada-53cb5f0967c8" containerID="aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c" exitCode=0
Sep 08 14:23:29.174581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.174506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2" event={"ID":"e06945c4-f5f0-4801-8ada-53cb5f0967c8","Type":"ContainerDied","Data":"aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c"}
Sep 08 14:23:29.174581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.174515    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"
Sep 08 14:23:29.174581 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.174546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2" event={"ID":"e06945c4-f5f0-4801-8ada-53cb5f0967c8","Type":"ContainerDied","Data":"f26e76274bf07f04c7d8922f24c2835de7354da3f9e8b0b676e7612b9d93dc43"}
Sep 08 14:23:29.183069 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.183052    2559 scope.go:117] "RemoveContainer" containerID="3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7"
Sep 08 14:23:29.183359 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:23:29.183340    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7\": container with ID starting with 3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7 not found: ID does not exist" containerID="3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7"
Sep 08 14:23:29.183422 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.183370    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7"} err="failed to get container status \"3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7\": rpc error: code = NotFound desc = could not find container \"3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7\": container with ID starting with 3dbf4e1d80f73b562b9ae894b17806adcb87310d3902545688e4ed636b8254a7 not found: ID does not exist"
Sep 08 14:23:29.183422 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.183394    2559 scope.go:117] "RemoveContainer" containerID="aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c"
Sep 08 14:23:29.191539 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.191517    2559 scope.go:117] "RemoveContainer" containerID="aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c"
Sep 08 14:23:29.191936 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:23:29.191910    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c\": container with ID starting with aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c not found: ID does not exist" containerID="aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c"
Sep 08 14:23:29.192037 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.191944    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c"} err="failed to get container status \"aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c\": rpc error: code = NotFound desc = could not find container \"aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c\": container with ID starting with aa32d40ca9123990fda69efd5b5b76ecb82b929f90332d249b8fc1f354a7ca6c not found: ID does not exist"
Sep 08 14:23:29.198461 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.198436    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"]
Sep 08 14:23:29.206241 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.206216    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2310c4-545b56b4c4-cs28k"]
Sep 08 14:23:29.219185 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.219156    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"]
Sep 08 14:23:29.223071 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:29.223042    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2310c4-694c9b46d5-m9pt2"]
Sep 08 14:23:30.584314 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:30.584271    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3defca-b853-4a58-ac46-7f64e3a9c0e8" path="/var/lib/kubelet/pods/6b3defca-b853-4a58-ac46-7f64e3a9c0e8/volumes"
Sep 08 14:23:30.584873 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:30.584852    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e06945c4-f5f0-4801-8ada-53cb5f0967c8" path="/var/lib/kubelet/pods/e06945c4-f5f0-4801-8ada-53cb5f0967c8/volumes"
Sep 08 14:23:35.508895 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:35.508861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:35.673176 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:35.673120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:35.915412 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:35.915385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:36.217448 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217368    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"]
Sep 08 14:23:36.217775 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217758    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3292e57-8957-46e2-b084-53cb4cfa712d" containerName="payload-processing"
Sep 08 14:23:36.217828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217777    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3292e57-8957-46e2-b084-53cb4cfa712d" containerName="payload-processing"
Sep 08 14:23:36.217828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217788    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" containerName="maas-api"
Sep 08 14:23:36.217828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217793    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" containerName="maas-api"
Sep 08 14:23:36.217828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217804    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" containerName="payload-pre-processing"
Sep 08 14:23:36.217828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217809    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" containerName="payload-pre-processing"
Sep 08 14:23:36.217828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217818    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3defca-b853-4a58-ac46-7f64e3a9c0e8" containerName="payload-pre-processing"
Sep 08 14:23:36.217828 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217823    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3defca-b853-4a58-ac46-7f64e3a9c0e8" containerName="payload-pre-processing"
Sep 08 14:23:36.218049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217835    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06945c4-f5f0-4801-8ada-53cb5f0967c8" containerName="maas-api"
Sep 08 14:23:36.218049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217841    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06945c4-f5f0-4801-8ada-53cb5f0967c8" containerName="maas-api"
Sep 08 14:23:36.218049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217896    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b93e07d-d1f8-4fd0-a1da-b737a2fe3bfd" containerName="maas-api"
Sep 08 14:23:36.218049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217904    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e06945c4-f5f0-4801-8ada-53cb5f0967c8" containerName="maas-api"
Sep 08 14:23:36.218049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217912    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3defca-b853-4a58-ac46-7f64e3a9c0e8" containerName="payload-pre-processing"
Sep 08 14:23:36.218049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217919    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ed5baf-ba7e-4ab4-86d2-66c1277d5fd4" containerName="payload-pre-processing"
Sep 08 14:23:36.218049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.217925    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3292e57-8957-46e2-b084-53cb4cfa712d" containerName="payload-processing"
Sep 08 14:23:36.222493 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.222471    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"
Sep 08 14:23:36.225447 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.225416    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d2tr9\""
Sep 08 14:23:36.225935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.225914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"]
Sep 08 14:23:36.226318 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.226287    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:23:36.333850 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.333796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:36.346529 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.346494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972e743a-8cff-48ab-9570-cad431c8eccc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6\" (UID: \"972e743a-8cff-48ab-9570-cad431c8eccc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"
Sep 08 14:23:36.447789 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.447752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972e743a-8cff-48ab-9570-cad431c8eccc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6\" (UID: \"972e743a-8cff-48ab-9570-cad431c8eccc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"
Sep 08 14:23:36.448409 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.448387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972e743a-8cff-48ab-9570-cad431c8eccc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6\" (UID: \"972e743a-8cff-48ab-9570-cad431c8eccc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"
Sep 08 14:23:36.534681 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.534656    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"
Sep 08 14:23:36.813352 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:36.813322    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"]
Sep 08 14:23:36.814625 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:23:36.814584    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972e743a_8cff_48ab_9570_cad431c8eccc.slice/crio-4bd7b9b154085a9af897b0f6371f3c20a744c57790fda2c0ca1cf907c1517352 WatchSource:0}: Error finding container 4bd7b9b154085a9af897b0f6371f3c20a744c57790fda2c0ca1cf907c1517352: Status 404 returned error can't find the container with id 4bd7b9b154085a9af897b0f6371f3c20a744c57790fda2c0ca1cf907c1517352
Sep 08 14:23:37.223185 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:37.223088    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6" event={"ID":"972e743a-8cff-48ab-9570-cad431c8eccc","Type":"ContainerStarted","Data":"4bd7b9b154085a9af897b0f6371f3c20a744c57790fda2c0ca1cf907c1517352"}
Sep 08 14:23:40.241505 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:40.241411    2559 generic.go:356] "Generic (PLEG): container finished" podID="972e743a-8cff-48ab-9570-cad431c8eccc" containerID="fb3aa39b4d5b8c8ed9d96837f9141fcaae6b3c0528b164bca779a8d7f3815727" exitCode=0
Sep 08 14:23:40.241913 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:40.241500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6" event={"ID":"972e743a-8cff-48ab-9570-cad431c8eccc","Type":"ContainerDied","Data":"fb3aa39b4d5b8c8ed9d96837f9141fcaae6b3c0528b164bca779a8d7f3815727"}
Sep 08 14:23:41.372648 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:41.372603    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"
Sep 08 14:23:41.490229 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:41.490197    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972e743a-8cff-48ab-9570-cad431c8eccc-maas-api-service-ca\") pod \"972e743a-8cff-48ab-9570-cad431c8eccc\" (UID: \"972e743a-8cff-48ab-9570-cad431c8eccc\") "
Sep 08 14:23:41.490567 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:41.490543    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/972e743a-8cff-48ab-9570-cad431c8eccc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "972e743a-8cff-48ab-9570-cad431c8eccc" (UID: "972e743a-8cff-48ab-9570-cad431c8eccc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:23:41.591436 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:41.591395    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972e743a-8cff-48ab-9570-cad431c8eccc-maas-api-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:23:42.252241 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:42.252209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6" event={"ID":"972e743a-8cff-48ab-9570-cad431c8eccc","Type":"ContainerDied","Data":"4bd7b9b154085a9af897b0f6371f3c20a744c57790fda2c0ca1cf907c1517352"}
Sep 08 14:23:42.252241 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:42.252235    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"
Sep 08 14:23:42.252463 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:42.252287    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bd7b9b154085a9af897b0f6371f3c20a744c57790fda2c0ca1cf907c1517352"
Sep 08 14:23:46.772375 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:46.772296    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:46.848559 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:46.848528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:46.934482 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:46.934447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:47.022550 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:47.022476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:47.056670 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:47.056628    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"]
Sep 08 14:23:47.058263 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:47.058244    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bcb20-w2mh6"]
Sep 08 14:23:47.428689 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:47.428660    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:48.581549 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:48.581518    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="972e743a-8cff-48ab-9570-cad431c8eccc" path="/var/lib/kubelet/pods/972e743a-8cff-48ab-9570-cad431c8eccc/volumes"
Sep 08 14:23:54.301914 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:54.301882    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:54.407339 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:54.407306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:23:54.507789 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:23:54.507758    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:24:04.887885 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:04.887845    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"]
Sep 08 14:24:04.888367 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:04.888113    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88" podUID="b248dbcc-0bb7-473b-8c80-bc17e1ede978" containerName="payload-processing" containerID="cri-o://e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73" gracePeriod=30
Sep 08 14:24:04.894667 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:04.894640    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"]
Sep 08 14:24:04.894875 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:04.894855    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x" podUID="f3b79ccb-74bc-4a42-949f-623a7d0fbbf2" containerName="payload-pre-processing" containerID="cri-o://020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5" gracePeriod=30
Sep 08 14:24:05.167338 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.167314    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:24:05.170077 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.170058    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:24:05.290673 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.290646    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b248dbcc-0bb7-473b-8c80-bc17e1ede978-plugins-config-volume\") pod \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\" (UID: \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\") "
Sep 08 14:24:05.290868 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.290704    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-plugins-config-volume\") pod \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\" (UID: \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\") "
Sep 08 14:24:05.290868 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.290722    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q29zj\" (UniqueName: \"kubernetes.io/projected/b248dbcc-0bb7-473b-8c80-bc17e1ede978-kube-api-access-q29zj\") pod \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\" (UID: \"b248dbcc-0bb7-473b-8c80-bc17e1ede978\") "
Sep 08 14:24:05.290868 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.290769    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j7pp\" (UniqueName: \"kubernetes.io/projected/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-kube-api-access-5j7pp\") pod \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\" (UID: \"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2\") "
Sep 08 14:24:05.291107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.291032    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f3b79ccb-74bc-4a42-949f-623a7d0fbbf2" (UID: "f3b79ccb-74bc-4a42-949f-623a7d0fbbf2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:24:05.291107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.291073    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b248dbcc-0bb7-473b-8c80-bc17e1ede978-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b248dbcc-0bb7-473b-8c80-bc17e1ede978" (UID: "b248dbcc-0bb7-473b-8c80-bc17e1ede978"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:24:05.293016 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.292987    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b248dbcc-0bb7-473b-8c80-bc17e1ede978-kube-api-access-q29zj" (OuterVolumeSpecName: "kube-api-access-q29zj") pod "b248dbcc-0bb7-473b-8c80-bc17e1ede978" (UID: "b248dbcc-0bb7-473b-8c80-bc17e1ede978"). InnerVolumeSpecName "kube-api-access-q29zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:24:05.293303 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.293287    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-kube-api-access-5j7pp" (OuterVolumeSpecName: "kube-api-access-5j7pp") pod "f3b79ccb-74bc-4a42-949f-623a7d0fbbf2" (UID: "f3b79ccb-74bc-4a42-949f-623a7d0fbbf2"). InnerVolumeSpecName "kube-api-access-5j7pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:24:05.359334 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.359303    2559 generic.go:356] "Generic (PLEG): container finished" podID="f3b79ccb-74bc-4a42-949f-623a7d0fbbf2" containerID="020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5" exitCode=0
Sep 08 14:24:05.359476 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.359349    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"
Sep 08 14:24:05.359476 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.359392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x" event={"ID":"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2","Type":"ContainerDied","Data":"020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5"}
Sep 08 14:24:05.359476 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.359452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x" event={"ID":"f3b79ccb-74bc-4a42-949f-623a7d0fbbf2","Type":"ContainerDied","Data":"d766206d3df7d01c451b01a996b1002163c00e5bcbc6c2fc493ee0ff5be6f16f"}
Sep 08 14:24:05.359667 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.359481    2559 scope.go:117] "RemoveContainer" containerID="020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5"
Sep 08 14:24:05.360767 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.360748    2559 generic.go:356] "Generic (PLEG): container finished" podID="b248dbcc-0bb7-473b-8c80-bc17e1ede978" containerID="e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73" exitCode=0
Sep 08 14:24:05.360877 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.360819    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88" event={"ID":"b248dbcc-0bb7-473b-8c80-bc17e1ede978","Type":"ContainerDied","Data":"e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73"}
Sep 08 14:24:05.360877 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.360852    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88" event={"ID":"b248dbcc-0bb7-473b-8c80-bc17e1ede978","Type":"ContainerDied","Data":"ef09ebe9b333fe95d1766cbf6547a2f31dc0e87771d40947655fa122d992c228"}
Sep 08 14:24:05.360877 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.360859    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"
Sep 08 14:24:05.368464 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.368443    2559 scope.go:117] "RemoveContainer" containerID="020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5"
Sep 08 14:24:05.368754 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:24:05.368734    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5\": container with ID starting with 020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5 not found: ID does not exist" containerID="020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5"
Sep 08 14:24:05.368837 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.368759    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5"} err="failed to get container status \"020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5\": rpc error: code = NotFound desc = could not find container \"020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5\": container with ID starting with 020404fe0a15c14f45a0db47a1010a6ba11a2ddf4a2e38c33e7575ccfc0046a5 not found: ID does not exist"
Sep 08 14:24:05.368837 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.368777    2559 scope.go:117] "RemoveContainer" containerID="e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73"
Sep 08 14:24:05.376650 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.376634    2559 scope.go:117] "RemoveContainer" containerID="e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73"
Sep 08 14:24:05.376887 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:24:05.376868    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73\": container with ID starting with e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73 not found: ID does not exist" containerID="e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73"
Sep 08 14:24:05.376932 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.376897    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73"} err="failed to get container status \"e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73\": rpc error: code = NotFound desc = could not find container \"e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73\": container with ID starting with e64b8d2cdb9f7eb30d5e8503cb4b0d4b139a3d1fde59d4a3980a8cbc61035b73 not found: ID does not exist"
Sep 08 14:24:05.384225 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.384204    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"]
Sep 08 14:24:05.389162 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.389143    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e2a04d-78d8997fc4-mxt2x"]
Sep 08 14:24:05.391294 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.391279    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b248dbcc-0bb7-473b-8c80-bc17e1ede978-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:24:05.391355 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.391298    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-plugins-config-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:24:05.391355 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.391307    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q29zj\" (UniqueName: \"kubernetes.io/projected/b248dbcc-0bb7-473b-8c80-bc17e1ede978-kube-api-access-q29zj\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:24:05.391355 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.391317    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j7pp\" (UniqueName: \"kubernetes.io/projected/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2-kube-api-access-5j7pp\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:24:05.401041 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.400992    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"]
Sep 08 14:24:05.406905 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:05.406884    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-e2a04d-5ffb68bf6c-znz88"]
Sep 08 14:24:06.493154 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:06.493118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:24:06.582320 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:06.582286    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b248dbcc-0bb7-473b-8c80-bc17e1ede978" path="/var/lib/kubelet/pods/b248dbcc-0bb7-473b-8c80-bc17e1ede978/volumes"
Sep 08 14:24:06.582669 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:06.582654    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b79ccb-74bc-4a42-949f-623a7d0fbbf2" path="/var/lib/kubelet/pods/f3b79ccb-74bc-4a42-949f-623a7d0fbbf2/volumes"
Sep 08 14:24:06.594465 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:06.594442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:24:11.519776 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:11.519716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:24:11.623862 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:11.623832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:24:11.818665 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:11.818605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:24:59.425899 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:24:59.425866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:25:07.325149 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:25:07.325114    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:25:36.353066 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:25:36.352964    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:25:37.735599 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:25:37.735566    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:25:39.215151 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:25:39.215110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:27:06.462100 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:06.462017    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:27:36.190242 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:36.190204    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"]
Sep 08 14:27:36.190706 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:36.190427    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt" podUID="0175d028-274b-4831-a5e4-7dba33bac42c" containerName="manager" containerID="cri-o://be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0" gracePeriod=10
Sep 08 14:27:37.351970 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.351941    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:27:37.379903 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.379806    2559 generic.go:356] "Generic (PLEG): container finished" podID="0175d028-274b-4831-a5e4-7dba33bac42c" containerID="be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0" exitCode=0
Sep 08 14:27:37.379903 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.379852    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"
Sep 08 14:27:37.380107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.379895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt" event={"ID":"0175d028-274b-4831-a5e4-7dba33bac42c","Type":"ContainerDied","Data":"be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0"}
Sep 08 14:27:37.380107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.379949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt" event={"ID":"0175d028-274b-4831-a5e4-7dba33bac42c","Type":"ContainerDied","Data":"ccefc4c9e034dbba1bd1e753f86a3d693b04998bf4d44cc50ba3aa28b4964f9f"}
Sep 08 14:27:37.380107 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.379972    2559 scope.go:117] "RemoveContainer" containerID="be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0"
Sep 08 14:27:37.390632 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.390592    2559 scope.go:117] "RemoveContainer" containerID="be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0"
Sep 08 14:27:37.390962 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:27:37.390942    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0\": container with ID starting with be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0 not found: ID does not exist" containerID="be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0"
Sep 08 14:27:37.391034 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.390979    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0"} err="failed to get container status \"be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0\": rpc error: code = NotFound desc = could not find container \"be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0\": container with ID starting with be168f00d70e0f587a2fabc599c052415f4f032f24a60a5560b31bf21f66e4c0 not found: ID does not exist"
Sep 08 14:27:37.457291 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.457251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm5fk\" (UniqueName: \"kubernetes.io/projected/0175d028-274b-4831-a5e4-7dba33bac42c-kube-api-access-zm5fk\") pod \"0175d028-274b-4831-a5e4-7dba33bac42c\" (UID: \"0175d028-274b-4831-a5e4-7dba33bac42c\") "
Sep 08 14:27:37.457539 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.457370    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0175d028-274b-4831-a5e4-7dba33bac42c-extensions-socket-volume\") pod \"0175d028-274b-4831-a5e4-7dba33bac42c\" (UID: \"0175d028-274b-4831-a5e4-7dba33bac42c\") "
Sep 08 14:27:37.457783 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.457759    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0175d028-274b-4831-a5e4-7dba33bac42c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0175d028-274b-4831-a5e4-7dba33bac42c" (UID: "0175d028-274b-4831-a5e4-7dba33bac42c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:27:37.459599 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.459569    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0175d028-274b-4831-a5e4-7dba33bac42c-kube-api-access-zm5fk" (OuterVolumeSpecName: "kube-api-access-zm5fk") pod "0175d028-274b-4831-a5e4-7dba33bac42c" (UID: "0175d028-274b-4831-a5e4-7dba33bac42c"). InnerVolumeSpecName "kube-api-access-zm5fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:27:37.558492 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.558448    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0175d028-274b-4831-a5e4-7dba33bac42c-extensions-socket-volume\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:27:37.558492 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.558481    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm5fk\" (UniqueName: \"kubernetes.io/projected/0175d028-274b-4831-a5e4-7dba33bac42c-kube-api-access-zm5fk\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:27:37.702516 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.702478    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"]
Sep 08 14:27:37.706325 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:37.706294    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-74jxt"]
Sep 08 14:27:38.581661 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:27:38.581626    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0175d028-274b-4831-a5e4-7dba33bac42c" path="/var/lib/kubelet/pods/0175d028-274b-4831-a5e4-7dba33bac42c/volumes"
Sep 08 14:28:36.870070 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870028    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"]
Sep 08 14:28:36.870580 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870549    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0175d028-274b-4831-a5e4-7dba33bac42c" containerName="manager"
Sep 08 14:28:36.870580 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870568    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0175d028-274b-4831-a5e4-7dba33bac42c" containerName="manager"
Sep 08 14:28:36.870739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870586    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b248dbcc-0bb7-473b-8c80-bc17e1ede978" containerName="payload-processing"
Sep 08 14:28:36.870739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870595    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b248dbcc-0bb7-473b-8c80-bc17e1ede978" containerName="payload-processing"
Sep 08 14:28:36.870739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870643    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b79ccb-74bc-4a42-949f-623a7d0fbbf2" containerName="payload-pre-processing"
Sep 08 14:28:36.870739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870653    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b79ccb-74bc-4a42-949f-623a7d0fbbf2" containerName="payload-pre-processing"
Sep 08 14:28:36.870739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870669    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="972e743a-8cff-48ab-9570-cad431c8eccc" containerName="revoke-keys"
Sep 08 14:28:36.870739 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870677    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="972e743a-8cff-48ab-9570-cad431c8eccc" containerName="revoke-keys"
Sep 08 14:28:36.871020 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870769    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0175d028-274b-4831-a5e4-7dba33bac42c" containerName="manager"
Sep 08 14:28:36.871020 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870783    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b79ccb-74bc-4a42-949f-623a7d0fbbf2" containerName="payload-pre-processing"
Sep 08 14:28:36.871020 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870795    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="972e743a-8cff-48ab-9570-cad431c8eccc" containerName="revoke-keys"
Sep 08 14:28:36.871020 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.870805    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b248dbcc-0bb7-473b-8c80-bc17e1ede978" containerName="payload-processing"
Sep 08 14:28:36.873966 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.873946    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:36.876560 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.876539    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 14:28:36.876704 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.876686    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 14:28:36.876790 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.876774    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pp4z7\""
Sep 08 14:28:36.889447 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.889422    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"]
Sep 08 14:28:36.979116 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.979084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f83a8ee-3112-447a-986e-0fa3251d5370-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-4p2w2\" (UID: \"5f83a8ee-3112-447a-986e-0fa3251d5370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:36.979116 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:36.979121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qptfv\" (UniqueName: \"kubernetes.io/projected/5f83a8ee-3112-447a-986e-0fa3251d5370-kube-api-access-qptfv\") pod \"kuadrant-operator-controller-manager-7456d9997c-4p2w2\" (UID: \"5f83a8ee-3112-447a-986e-0fa3251d5370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:37.080463 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.080421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f83a8ee-3112-447a-986e-0fa3251d5370-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-4p2w2\" (UID: \"5f83a8ee-3112-447a-986e-0fa3251d5370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:37.080696 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.080472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptfv\" (UniqueName: \"kubernetes.io/projected/5f83a8ee-3112-447a-986e-0fa3251d5370-kube-api-access-qptfv\") pod \"kuadrant-operator-controller-manager-7456d9997c-4p2w2\" (UID: \"5f83a8ee-3112-447a-986e-0fa3251d5370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:37.080842 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.080818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f83a8ee-3112-447a-986e-0fa3251d5370-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-4p2w2\" (UID: \"5f83a8ee-3112-447a-986e-0fa3251d5370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:37.090145 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.090114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qptfv\" (UniqueName: \"kubernetes.io/projected/5f83a8ee-3112-447a-986e-0fa3251d5370-kube-api-access-qptfv\") pod \"kuadrant-operator-controller-manager-7456d9997c-4p2w2\" (UID: \"5f83a8ee-3112-447a-986e-0fa3251d5370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:37.184011 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.183918    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:37.462061 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.461818    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"]
Sep 08 14:28:37.465077 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:28:37.465052    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f83a8ee_3112_447a_986e_0fa3251d5370.slice/crio-af7eadd93fcb5ffa553a6ea138049c7a6d5976cb15e13992400ef89c2556d36c WatchSource:0}: Error finding container af7eadd93fcb5ffa553a6ea138049c7a6d5976cb15e13992400ef89c2556d36c: Status 404 returned error can't find the container with id af7eadd93fcb5ffa553a6ea138049c7a6d5976cb15e13992400ef89c2556d36c
Sep 08 14:28:37.675347 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.675315    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2" event={"ID":"5f83a8ee-3112-447a-986e-0fa3251d5370","Type":"ContainerStarted","Data":"ba2445fd03f550d294f5df72b2cec27d6be9bbe8125a6733cad19fccbe141aca"}
Sep 08 14:28:37.675530 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.675372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2" event={"ID":"5f83a8ee-3112-447a-986e-0fa3251d5370","Type":"ContainerStarted","Data":"af7eadd93fcb5ffa553a6ea138049c7a6d5976cb15e13992400ef89c2556d36c"}
Sep 08 14:28:37.675530 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.675406    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:28:37.698371 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.698311    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2" podStartSLOduration=1.69829054 podStartE2EDuration="1.69829054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:28:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:28:37.69600142 +0000 UTC m=+1813.609906337" watchObservedRunningTime="2026-09-08 14:28:37.69829054 +0000 UTC m=+1813.612195457"
Sep 08 14:28:37.944335 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:37.944285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:28:38.027363 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:38.027303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:28:48.682079 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:28:48.682050    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-4p2w2"
Sep 08 14:29:40.793402 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.793356    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"]
Sep 08 14:29:40.796839 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.796814    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:40.799542 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.799509    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-53815519-kserve-self-signed-certs\""
Sep 08 14:29:40.805448 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.805425    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"]
Sep 08 14:29:40.923121 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.923087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-dshm\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:40.923308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.923136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b346b2-e395-4f34-a6f5-28abb70fc75c-tls-certs\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:40.923308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.923159    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72zsb\" (UniqueName: \"kubernetes.io/projected/95b346b2-e395-4f34-a6f5-28abb70fc75c-kube-api-access-72zsb\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:40.923308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.923207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-home\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:40.923308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.923224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-model-cache\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:40.923308 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.923276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-tmp-dir\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:40.977558 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:40.977525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:29:41.023879 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.023837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-home\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.023879 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.023877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-model-cache\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.024120 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.024007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-tmp-dir\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.024120 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.024059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-dshm\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.024229 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.024120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b346b2-e395-4f34-a6f5-28abb70fc75c-tls-certs\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.024229 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.024156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72zsb\" (UniqueName: \"kubernetes.io/projected/95b346b2-e395-4f34-a6f5-28abb70fc75c-kube-api-access-72zsb\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.024229 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.024217    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-home\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.024385 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.024277    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-model-cache\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.024385 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.024342    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-tmp-dir\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.026405 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.026381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-dshm\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.026688 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.026669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b346b2-e395-4f34-a6f5-28abb70fc75c-tls-certs\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.033209 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.033186    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72zsb\" (UniqueName: \"kubernetes.io/projected/95b346b2-e395-4f34-a6f5-28abb70fc75c-kube-api-access-72zsb\") pod \"e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") " pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.107734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.107645    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:41.380378 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.380353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"]
Sep 08 14:29:41.382273 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:29:41.382246    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95b346b2_e395_4f34_a6f5_28abb70fc75c.slice/crio-373e59b20978c2008b8a3ad630c169e7ac10453829ba3b044e098f95aecd920d WatchSource:0}: Error finding container 373e59b20978c2008b8a3ad630c169e7ac10453829ba3b044e098f95aecd920d: Status 404 returned error can't find the container with id 373e59b20978c2008b8a3ad630c169e7ac10453829ba3b044e098f95aecd920d
Sep 08 14:29:41.988512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.988477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8" event={"ID":"95b346b2-e395-4f34-a6f5-28abb70fc75c","Type":"ContainerStarted","Data":"f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f"}
Sep 08 14:29:41.988512 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:41.988521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8" event={"ID":"95b346b2-e395-4f34-a6f5-28abb70fc75c","Type":"ContainerStarted","Data":"373e59b20978c2008b8a3ad630c169e7ac10453829ba3b044e098f95aecd920d"}
Sep 08 14:29:42.007078 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:42.007025    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8" podStartSLOduration=2.007008677 podStartE2EDuration="2.007008677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:29:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:29:42.005573599 +0000 UTC m=+1877.919478510" watchObservedRunningTime="2026-09-08 14:29:42.007008677 +0000 UTC m=+1877.920913592"
Sep 08 14:29:42.107871 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:42.107826    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:45.975707 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:45.975606    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:29:51.108670 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:51.108631    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:51.121297 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:51.121272    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:52.049368 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:52.049339    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:29:54.803235 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:29:54.803202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:30:18.674796 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:18.674759    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"]
Sep 08 14:30:18.686226 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:18.686178    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:30:22.013763 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:22.013724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:30:24.914299 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:24.914268    2559 scope.go:117] "RemoveContainer" containerID="fb3aa39b4d5b8c8ed9d96837f9141fcaae6b3c0528b164bca779a8d7f3815727"
Sep 08 14:30:33.694800 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:33.694744    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8" podUID="95b346b2-e395-4f34-a6f5-28abb70fc75c" containerName="main" containerID="cri-o://f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f" gracePeriod=45
Sep 08 14:30:33.944106 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:33.944083    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:30:34.085529 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085501    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-model-cache\") pod \"95b346b2-e395-4f34-a6f5-28abb70fc75c\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") "
Sep 08 14:30:34.085724 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085542    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b346b2-e395-4f34-a6f5-28abb70fc75c-tls-certs\") pod \"95b346b2-e395-4f34-a6f5-28abb70fc75c\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") "
Sep 08 14:30:34.085724 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085566    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72zsb\" (UniqueName: \"kubernetes.io/projected/95b346b2-e395-4f34-a6f5-28abb70fc75c-kube-api-access-72zsb\") pod \"95b346b2-e395-4f34-a6f5-28abb70fc75c\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") "
Sep 08 14:30:34.085724 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085601    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-dshm\") pod \"95b346b2-e395-4f34-a6f5-28abb70fc75c\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") "
Sep 08 14:30:34.085724 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085645    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-home\") pod \"95b346b2-e395-4f34-a6f5-28abb70fc75c\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") "
Sep 08 14:30:34.085724 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085661    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-tmp-dir\") pod \"95b346b2-e395-4f34-a6f5-28abb70fc75c\" (UID: \"95b346b2-e395-4f34-a6f5-28abb70fc75c\") "
Sep 08 14:30:34.085988 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085819    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-model-cache" (OuterVolumeSpecName: "model-cache") pod "95b346b2-e395-4f34-a6f5-28abb70fc75c" (UID: "95b346b2-e395-4f34-a6f5-28abb70fc75c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:34.085988 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085934    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-model-cache\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:34.085988 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-home" (OuterVolumeSpecName: "home") pod "95b346b2-e395-4f34-a6f5-28abb70fc75c" (UID: "95b346b2-e395-4f34-a6f5-28abb70fc75c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:34.086106 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.085978    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95b346b2-e395-4f34-a6f5-28abb70fc75c" (UID: "95b346b2-e395-4f34-a6f5-28abb70fc75c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:34.087963 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.087941    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b346b2-e395-4f34-a6f5-28abb70fc75c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95b346b2-e395-4f34-a6f5-28abb70fc75c" (UID: "95b346b2-e395-4f34-a6f5-28abb70fc75c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:30:34.088035 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.088012    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b346b2-e395-4f34-a6f5-28abb70fc75c-kube-api-access-72zsb" (OuterVolumeSpecName: "kube-api-access-72zsb") pod "95b346b2-e395-4f34-a6f5-28abb70fc75c" (UID: "95b346b2-e395-4f34-a6f5-28abb70fc75c"). InnerVolumeSpecName "kube-api-access-72zsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:30:34.088087 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.088034    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-dshm" (OuterVolumeSpecName: "dshm") pod "95b346b2-e395-4f34-a6f5-28abb70fc75c" (UID: "95b346b2-e395-4f34-a6f5-28abb70fc75c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:34.186422 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.186402    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b346b2-e395-4f34-a6f5-28abb70fc75c-tls-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:34.186422 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.186423    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72zsb\" (UniqueName: \"kubernetes.io/projected/95b346b2-e395-4f34-a6f5-28abb70fc75c-kube-api-access-72zsb\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:34.186557 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.186433    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-dshm\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:34.186557 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.186442    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-home\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:34.186557 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.186449    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b346b2-e395-4f34-a6f5-28abb70fc75c-tmp-dir\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:34.235666 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.235598    2559 generic.go:356] "Generic (PLEG): container finished" podID="95b346b2-e395-4f34-a6f5-28abb70fc75c" containerID="f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f" exitCode=0
Sep 08 14:30:34.235666 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.235660    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"
Sep 08 14:30:34.235847 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.235702    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8" event={"ID":"95b346b2-e395-4f34-a6f5-28abb70fc75c","Type":"ContainerDied","Data":"f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f"}
Sep 08 14:30:34.235847 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.235742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8" event={"ID":"95b346b2-e395-4f34-a6f5-28abb70fc75c","Type":"ContainerDied","Data":"373e59b20978c2008b8a3ad630c169e7ac10453829ba3b044e098f95aecd920d"}
Sep 08 14:30:34.235847 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.235760    2559 scope.go:117] "RemoveContainer" containerID="f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f"
Sep 08 14:30:34.244822 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.244804    2559 scope.go:117] "RemoveContainer" containerID="f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f"
Sep 08 14:30:34.245112 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:30:34.245093    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f\": container with ID starting with f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f not found: ID does not exist" containerID="f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f"
Sep 08 14:30:34.245168 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.245121    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f"} err="failed to get container status \"f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f\": rpc error: code = NotFound desc = could not find container \"f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f\": container with ID starting with f4eeb4aaa94026a60b8d5fdc0f9dc9efac57ee7c42a3c505e33ffdfa2725bb1f not found: ID does not exist"
Sep 08 14:30:34.256590 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.256566    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"]
Sep 08 14:30:34.260276 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.260244    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-53815519-kserve-77bbf79ffb-vf6l8"]
Sep 08 14:30:34.581098 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:34.581067    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b346b2-e395-4f34-a6f5-28abb70fc75c" path="/var/lib/kubelet/pods/95b346b2-e395-4f34-a6f5-28abb70fc75c/volumes"
Sep 08 14:30:49.495379 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.495344    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"]
Sep 08 14:30:49.495883 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.495866    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b346b2-e395-4f34-a6f5-28abb70fc75c" containerName="main"
Sep 08 14:30:49.495927 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.495887    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b346b2-e395-4f34-a6f5-28abb70fc75c" containerName="main"
Sep 08 14:30:49.495980 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.495969    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b346b2-e395-4f34-a6f5-28abb70fc75c" containerName="main"
Sep 08 14:30:49.500437 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.500417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.504178 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.504156    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 14:30:49.504323 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.504155    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:30:49.504323 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.504270    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:30:49.504323 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.504155    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2nwq2\""
Sep 08 14:30:49.504674 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.504658    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:30:49.509877 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.509842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-maas-api-tls\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.509981 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.509912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xdx4\" (UniqueName: \"kubernetes.io/projected/48ea3396-a01e-4cf4-812e-1884b2b08e60-kube-api-access-9xdx4\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.509981 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.509964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-metrics-certs\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.510105 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.510024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ea3396-a01e-4cf4-812e-1884b2b08e60-openshift-service-ca\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.512579 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.512555    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"]
Sep 08 14:30:49.514774 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.514754    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"]
Sep 08 14:30:49.518380 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.518365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.528774 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.528753    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"]
Sep 08 14:30:49.611237 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.611204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c4d22a3-2e16-4935-a255-985748b8b670-openshift-service-ca\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.611427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.611244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ch92\" (UniqueName: \"kubernetes.io/projected/1c4d22a3-2e16-4935-a255-985748b8b670-kube-api-access-8ch92\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.611427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.611268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-maas-api-tls\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.611427 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.611380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xdx4\" (UniqueName: \"kubernetes.io/projected/48ea3396-a01e-4cf4-812e-1884b2b08e60-kube-api-access-9xdx4\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.611603 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.611431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4d22a3-2e16-4935-a255-985748b8b670-metrics-certs\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.611603 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.611474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-metrics-certs\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.611603 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.611511    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c4d22a3-2e16-4935-a255-985748b8b670-maas-api-tls\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.611603 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.611559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ea3396-a01e-4cf4-812e-1884b2b08e60-openshift-service-ca\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.612244 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.612219    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ea3396-a01e-4cf4-812e-1884b2b08e60-openshift-service-ca\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.613904 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.613878    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-maas-api-tls\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.613984 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.613877    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-metrics-certs\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.619282 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.619260    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xdx4\" (UniqueName: \"kubernetes.io/projected/48ea3396-a01e-4cf4-812e-1884b2b08e60-kube-api-access-9xdx4\") pod \"maas-api-55f6cffdd8-qmvgw\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") " pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.712880 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.712858    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4d22a3-2e16-4935-a255-985748b8b670-metrics-certs\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.712978 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.712898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c4d22a3-2e16-4935-a255-985748b8b670-maas-api-tls\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.712978 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.712939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c4d22a3-2e16-4935-a255-985748b8b670-openshift-service-ca\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.713083 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.712976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ch92\" (UniqueName: \"kubernetes.io/projected/1c4d22a3-2e16-4935-a255-985748b8b670-kube-api-access-8ch92\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.713570 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.713546    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c4d22a3-2e16-4935-a255-985748b8b670-openshift-service-ca\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.715188 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.715165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4d22a3-2e16-4935-a255-985748b8b670-metrics-certs\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.715319 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.715301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c4d22a3-2e16-4935-a255-985748b8b670-maas-api-tls\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.720562 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.720545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ch92\" (UniqueName: \"kubernetes.io/projected/1c4d22a3-2e16-4935-a255-985748b8b670-kube-api-access-8ch92\") pod \"maas-api-7959b4d688-2trbp\" (UID: \"1c4d22a3-2e16-4935-a255-985748b8b670\") " pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:49.812142 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.812121    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:49.829366 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:49.829340    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:50.087374 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:50.087348    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"]
Sep 08 14:30:50.089336 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:30:50.089307    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ea3396_a01e_4cf4_812e_1884b2b08e60.slice/crio-3b4c44c96e2c9ca08027c7590697f8a330e03c22d98d57da3bb117790cf73f27 WatchSource:0}: Error finding container 3b4c44c96e2c9ca08027c7590697f8a330e03c22d98d57da3bb117790cf73f27: Status 404 returned error can't find the container with id 3b4c44c96e2c9ca08027c7590697f8a330e03c22d98d57da3bb117790cf73f27
Sep 08 14:30:50.090706 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:50.090689    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:30:50.105811 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:50.105788    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"]
Sep 08 14:30:50.107292 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:30:50.107265    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4d22a3_2e16_4935_a255_985748b8b670.slice/crio-b80026eb186e6545f79e43d47fb4bd3375db8429f8225cbc5295884c7415141f WatchSource:0}: Error finding container b80026eb186e6545f79e43d47fb4bd3375db8429f8225cbc5295884c7415141f: Status 404 returned error can't find the container with id b80026eb186e6545f79e43d47fb4bd3375db8429f8225cbc5295884c7415141f
Sep 08 14:30:50.316191 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:50.316152    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw" event={"ID":"48ea3396-a01e-4cf4-812e-1884b2b08e60","Type":"ContainerStarted","Data":"3b4c44c96e2c9ca08027c7590697f8a330e03c22d98d57da3bb117790cf73f27"}
Sep 08 14:30:50.317371 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:50.317337    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp" event={"ID":"1c4d22a3-2e16-4935-a255-985748b8b670","Type":"ContainerStarted","Data":"b80026eb186e6545f79e43d47fb4bd3375db8429f8225cbc5295884c7415141f"}
Sep 08 14:30:51.323535 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:51.323497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp" event={"ID":"1c4d22a3-2e16-4935-a255-985748b8b670","Type":"ContainerStarted","Data":"f405f413bf58d6dcf7e5e3c7a67d6bb069c507fe565259194b794c8e0e1bccb3"}
Sep 08 14:30:51.324023 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:51.323564    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:51.325109 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:51.325088    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw" event={"ID":"48ea3396-a01e-4cf4-812e-1884b2b08e60","Type":"ContainerStarted","Data":"c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67"}
Sep 08 14:30:51.325227 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:51.325214    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:51.339562 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:51.339510    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp" podStartSLOduration=1.8274235760000002 podStartE2EDuration="2.339491338s" totalImagesPullingTime="512.067762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:51.338585284 +0000 UTC m=+1947.252490198" watchObservedRunningTime="2026-09-08 14:30:51.339491338 +0000 UTC m=+1947.253396256"
Sep 08 14:30:51.356883 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:51.356842    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw" podStartSLOduration=1.796874562 podStartE2EDuration="2.356828914s" totalImagesPullingTime="559.954352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:51.354961001 +0000 UTC m=+1947.268865927" watchObservedRunningTime="2026-09-08 14:30:51.356828914 +0000 UTC m=+1947.270733828"
Sep 08 14:30:57.334226 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.334196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:57.334702 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.334572    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7959b4d688-2trbp"
Sep 08 14:30:57.405510 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.405473    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"]
Sep 08 14:30:57.405711 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.405685    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw" podUID="48ea3396-a01e-4cf4-812e-1884b2b08e60" containerName="maas-api" containerID="cri-o://c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67" gracePeriod=30
Sep 08 14:30:57.645149 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.645126    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:57.682837 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.682810    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ea3396-a01e-4cf4-812e-1884b2b08e60-openshift-service-ca\") pod \"48ea3396-a01e-4cf4-812e-1884b2b08e60\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") "
Sep 08 14:30:57.682961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.682847    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xdx4\" (UniqueName: \"kubernetes.io/projected/48ea3396-a01e-4cf4-812e-1884b2b08e60-kube-api-access-9xdx4\") pod \"48ea3396-a01e-4cf4-812e-1884b2b08e60\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") "
Sep 08 14:30:57.682961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.682874    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-maas-api-tls\") pod \"48ea3396-a01e-4cf4-812e-1884b2b08e60\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") "
Sep 08 14:30:57.682961 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.682900    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-metrics-certs\") pod \"48ea3396-a01e-4cf4-812e-1884b2b08e60\" (UID: \"48ea3396-a01e-4cf4-812e-1884b2b08e60\") "
Sep 08 14:30:57.683226 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.683200    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48ea3396-a01e-4cf4-812e-1884b2b08e60-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48ea3396-a01e-4cf4-812e-1884b2b08e60" (UID: "48ea3396-a01e-4cf4-812e-1884b2b08e60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:30:57.685175 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.685152    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "48ea3396-a01e-4cf4-812e-1884b2b08e60" (UID: "48ea3396-a01e-4cf4-812e-1884b2b08e60"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:30:57.685269 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.685201    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48ea3396-a01e-4cf4-812e-1884b2b08e60" (UID: "48ea3396-a01e-4cf4-812e-1884b2b08e60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:30:57.685269 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.685213    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ea3396-a01e-4cf4-812e-1884b2b08e60-kube-api-access-9xdx4" (OuterVolumeSpecName: "kube-api-access-9xdx4") pod "48ea3396-a01e-4cf4-812e-1884b2b08e60" (UID: "48ea3396-a01e-4cf4-812e-1884b2b08e60"). InnerVolumeSpecName "kube-api-access-9xdx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:30:57.783764 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.783742    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ea3396-a01e-4cf4-812e-1884b2b08e60-openshift-service-ca\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.783764 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.783765    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xdx4\" (UniqueName: \"kubernetes.io/projected/48ea3396-a01e-4cf4-812e-1884b2b08e60-kube-api-access-9xdx4\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.783904 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.783775    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-maas-api-tls\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.783904 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:57.783783    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48ea3396-a01e-4cf4-812e-1884b2b08e60-metrics-certs\") on node \"ip-10-0-142-105.ec2.internal\" DevicePath \"\""
Sep 08 14:30:58.357952 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.357918    2559 generic.go:356] "Generic (PLEG): container finished" podID="48ea3396-a01e-4cf4-812e-1884b2b08e60" containerID="c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67" exitCode=0
Sep 08 14:30:58.358358 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.357972    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"
Sep 08 14:30:58.358358 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.358013    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw" event={"ID":"48ea3396-a01e-4cf4-812e-1884b2b08e60","Type":"ContainerDied","Data":"c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67"}
Sep 08 14:30:58.358358 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.358073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw" event={"ID":"48ea3396-a01e-4cf4-812e-1884b2b08e60","Type":"ContainerDied","Data":"3b4c44c96e2c9ca08027c7590697f8a330e03c22d98d57da3bb117790cf73f27"}
Sep 08 14:30:58.358358 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.358103    2559 scope.go:117] "RemoveContainer" containerID="c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67"
Sep 08 14:30:58.371227 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.371207    2559 scope.go:117] "RemoveContainer" containerID="c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67"
Sep 08 14:30:58.371508 ip-10-0-142-105 kubenswrapper[2559]: E0908 14:30:58.371488    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67\": container with ID starting with c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67 not found: ID does not exist" containerID="c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67"
Sep 08 14:30:58.371567 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.371518    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67"} err="failed to get container status \"c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67\": rpc error: code = NotFound desc = could not find container \"c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67\": container with ID starting with c769812288410658142d548b38ce694311888f588d18b09c42546086f74d4a67 not found: ID does not exist"
Sep 08 14:30:58.380408 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.380386    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"]
Sep 08 14:30:58.384940 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.384921    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f6cffdd8-qmvgw"]
Sep 08 14:30:58.581480 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:30:58.581446    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ea3396-a01e-4cf4-812e-1884b2b08e60" path="/var/lib/kubelet/pods/48ea3396-a01e-4cf4-812e-1884b2b08e60/volumes"
Sep 08 14:31:46.405898 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:46.405866    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-85d49875c6-5wzjs_be69ab76-074d-4184-ba89-f833c5a6e662/manager/0.log"
Sep 08 14:31:47.379038 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:47.379002    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7959b4d688-2trbp_1c4d22a3-2e16-4935-a255-985748b8b670/maas-api/0.log"
Sep 08 14:31:49.081417 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:49.077120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-4p2w2_5f83a8ee-3112-447a-986e-0fa3251d5370/manager/0.log"
Sep 08 14:31:49.801056 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:49.801008    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mb4nq_dc9cc562-5361-44c7-9774-c75feb686e82/discovery/0.log"
Sep 08 14:31:49.910509 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:49.910480    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f4c5d6b6-r2k46_9322718d-a262-44db-b787-0f8bf738e5e4/kube-auth-proxy/0.log"
Sep 08 14:31:50.370960 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:50.370929    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-q4wm8_f56937cf-5625-422c-8796-28f1bd14a51d/payload-pre-processing/0.log"
Sep 08 14:31:50.486231 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:50.486196    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d6cdq_6b9662d3-1390-4eca-a3c3-82eb841865d9/payload-processing/0.log"
Sep 08 14:31:50.938937 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:50.938903    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-5fc5ddd44f-76m6r_1fe8e3e3-326a-4b0c-92d4-9416418f7e35/main/0.log"
Sep 08 14:31:51.052481 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:51.052448    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5d57fc946d-wfsq2_985cef9a-f9c1-4309-8804-bb8f22d9fc68/main/0.log"
Sep 08 14:31:51.519935 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:51.519908    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-89945f574-dpjbr_d69788ba-04fb-4eae-a341-0e58bb9e6111/main/0.log"
Sep 08 14:31:56.759804 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:56.759771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:31:56.823810 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:31:56.823767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:32:00.035734 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:00.035699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log" limit=1024
Sep 08 14:32:02.338229 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:02.338198    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2snxg_53951034-ca2a-4a8a-ab31-d0482394d753/global-pull-secret-syncer/0.log"
Sep 08 14:32:02.473103 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:02.473056    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8jbvv_cbb5e87d-8673-467a-a0ac-fa90af58301d/konnectivity-agent/0.log"
Sep 08 14:32:02.620035 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:02.619954    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-105.ec2.internal_f270c6c3850f7c0822b29062a2b39783/haproxy/0.log"
Sep 08 14:32:06.973730 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:06.973696    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-4p2w2_5f83a8ee-3112-447a-986e-0fa3251d5370/manager/0.log"
Sep 08 14:32:08.634689 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.634659    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62f0df48-c611-467d-aef1-41232d4049ad/alertmanager/0.log"
Sep 08 14:32:08.662437 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.662411    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62f0df48-c611-467d-aef1-41232d4049ad/config-reloader/0.log"
Sep 08 14:32:08.683842 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.683814    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62f0df48-c611-467d-aef1-41232d4049ad/kube-rbac-proxy-web/0.log"
Sep 08 14:32:08.706158 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.706123    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62f0df48-c611-467d-aef1-41232d4049ad/kube-rbac-proxy/0.log"
Sep 08 14:32:08.727278 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.727246    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62f0df48-c611-467d-aef1-41232d4049ad/kube-rbac-proxy-metric/0.log"
Sep 08 14:32:08.747657 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.747626    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62f0df48-c611-467d-aef1-41232d4049ad/prom-label-proxy/0.log"
Sep 08 14:32:08.772848 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.772817    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62f0df48-c611-467d-aef1-41232d4049ad/init-config-reloader/0.log"
Sep 08 14:32:08.810823 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.810784    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-bpvbn_395a59cc-68b7-4a12-9c80-a489d5f964d0/cluster-monitoring-operator/0.log"
Sep 08 14:32:08.981041 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:08.980965    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lrz2_e3c88e9b-0fe2-44c7-a3da-dbc598cedf11/node-exporter/0.log"
Sep 08 14:32:09.000957 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:09.000929    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lrz2_e3c88e9b-0fe2-44c7-a3da-dbc598cedf11/kube-rbac-proxy/0.log"
Sep 08 14:32:09.025778 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:09.025749    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lrz2_e3c88e9b-0fe2-44c7-a3da-dbc598cedf11/init-textfile/0.log"
Sep 08 14:32:09.642416 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:09.642380    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-h9t75_3806c820-469a-4d2f-b628-3c088fb47d10/prometheus-operator/0.log"
Sep 08 14:32:09.674445 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:09.674421    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-h9t75_3806c820-469a-4d2f-b628-3c088fb47d10/kube-rbac-proxy/0.log"
Sep 08 14:32:09.706872 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:09.706790    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-8m2jg_144c38ef-23cb-42de-97f3-a3bb329352e1/prometheus-operator-admission-webhook/0.log"
Sep 08 14:32:11.565524 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:11.565490    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-fxpzw_d9fe0057-5561-4448-85d6-700f357da9c8/networking-console-plugin/0.log"
Sep 08 14:32:12.784782 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:12.784750    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-xjcd6_c2996f25-3a2a-45ba-bc6e-08bba47a26ac/download-server/0.log"
Sep 08 14:32:14.594537 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.594498    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lnq9g_9b9c0f03-800a-418b-8588-72068e616bda/dns/0.log"
Sep 08 14:32:14.616258 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.616225    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lnq9g_9b9c0f03-800a-418b-8588-72068e616bda/kube-rbac-proxy/0.log"
Sep 08 14:32:14.694448 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.694417    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xb8x4_48d6c68d-5696-488b-8c0d-851fe59be022/dns-node-resolver/0.log"
Sep 08 14:32:14.916753 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.916664    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"]
Sep 08 14:32:14.917195 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.917164    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ea3396-a01e-4cf4-812e-1884b2b08e60" containerName="maas-api"
Sep 08 14:32:14.917195 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.917183    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ea3396-a01e-4cf4-812e-1884b2b08e60" containerName="maas-api"
Sep 08 14:32:14.917390 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.917299    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ea3396-a01e-4cf4-812e-1884b2b08e60" containerName="maas-api"
Sep 08 14:32:14.920490 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.920470    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:14.922906 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.922887    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjr46\"/\"kube-root-ca.crt\""
Sep 08 14:32:14.923798 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.923782    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jjr46\"/\"default-dockercfg-trvv4\""
Sep 08 14:32:14.923798 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.923791    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjr46\"/\"openshift-service-ca.crt\""
Sep 08 14:32:14.929066 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:14.929045    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"]
Sep 08 14:32:15.062014 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.061971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-sys\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.062194 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.062021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-podres\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.062194 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.062080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdh8p\" (UniqueName: \"kubernetes.io/projected/ac650ee0-9b54-4db0-b236-28f19443cf41-kube-api-access-qdh8p\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.062194 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.062137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-proc\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.062194 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.062178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-lib-modules\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163414 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-podres\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163414 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdh8p\" (UniqueName: \"kubernetes.io/projected/ac650ee0-9b54-4db0-b236-28f19443cf41-kube-api-access-qdh8p\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163770 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-proc\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163770 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-lib-modules\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163770 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-sys\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163770 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163569    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-podres\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163770 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-proc\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163770 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163602    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-sys\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.163770 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.163677    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac650ee0-9b54-4db0-b236-28f19443cf41-lib-modules\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.172409 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.172347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdh8p\" (UniqueName: \"kubernetes.io/projected/ac650ee0-9b54-4db0-b236-28f19443cf41-kube-api-access-qdh8p\") pod \"perf-node-gather-daemonset-k465l\" (UID: \"ac650ee0-9b54-4db0-b236-28f19443cf41\") " pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.231574 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.231527    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.386114 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.386077    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-scgr5_0b3b317c-8b92-4736-b169-694d75599ef1/node-ca/0.log"
Sep 08 14:32:15.506328 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.506287    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"]
Sep 08 14:32:15.507476 ip-10-0-142-105 kubenswrapper[2559]: W0908 14:32:15.507443    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac650ee0_9b54_4db0_b236_28f19443cf41.slice/crio-550c59b39852822d8b094bff1fd32437328ae3647e97780ed3ef69dcaa0064b2 WatchSource:0}: Error finding container 550c59b39852822d8b094bff1fd32437328ae3647e97780ed3ef69dcaa0064b2: Status 404 returned error can't find the container with id 550c59b39852822d8b094bff1fd32437328ae3647e97780ed3ef69dcaa0064b2
Sep 08 14:32:15.721360 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.721326    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l" event={"ID":"ac650ee0-9b54-4db0-b236-28f19443cf41","Type":"ContainerStarted","Data":"552e14e7599c727ac5bc23d40d5c99abd1ecab0ba1a9d254ec2e24396ed63c7a"}
Sep 08 14:32:15.721892 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.721386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l" event={"ID":"ac650ee0-9b54-4db0-b236-28f19443cf41","Type":"ContainerStarted","Data":"550c59b39852822d8b094bff1fd32437328ae3647e97780ed3ef69dcaa0064b2"}
Sep 08 14:32:15.721892 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.721457    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:15.738049 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:15.737987    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l" podStartSLOduration=1.7379713350000001 podStartE2EDuration="1.737971335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:32:15.736741726 +0000 UTC m=+2031.650646643" watchObservedRunningTime="2026-09-08 14:32:15.737971335 +0000 UTC m=+2031.651876251"
Sep 08 14:32:16.612592 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:16.612559    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mb4nq_dc9cc562-5361-44c7-9774-c75feb686e82/discovery/0.log"
Sep 08 14:32:16.635822 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:16.635793    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f4c5d6b6-r2k46_9322718d-a262-44db-b787-0f8bf738e5e4/kube-auth-proxy/0.log"
Sep 08 14:32:16.781919 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:16.781890    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-q4wm8_f56937cf-5625-422c-8796-28f1bd14a51d/payload-pre-processing/0.log"
Sep 08 14:32:16.818945 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:16.818912    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d6cdq_6b9662d3-1390-4eca-a3c3-82eb841865d9/payload-processing/0.log"
Sep 08 14:32:17.775645 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:17.775601    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tzjbr_d2138ffc-17e7-4b73-9337-8b844458af2e/serve-healthcheck-canary/0.log"
Sep 08 14:32:18.268438 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:18.268411    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cqnp_940f9c24-0d73-4050-862a-328786759de3/kube-rbac-proxy/0.log"
Sep 08 14:32:18.290437 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:18.290406    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cqnp_940f9c24-0d73-4050-862a-328786759de3/exporter/0.log"
Sep 08 14:32:18.311186 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:18.311153    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cqnp_940f9c24-0d73-4050-862a-328786759de3/extractor/0.log"
Sep 08 14:32:20.834967 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:20.834927    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-77cd5f6c85-v4q6w_faab413e-b811-4c81-b1e8-2f1d14efe60f/manager/0.log"
Sep 08 14:32:20.850174 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:20.850144    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-77cd5f6c85-v4q6w_faab413e-b811-4c81-b1e8-2f1d14efe60f/copy-manifests/0.log"
Sep 08 14:32:21.737022 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:21.736991    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jjr46/perf-node-gather-daemonset-k465l"
Sep 08 14:32:22.172662 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:22.172633    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mb4nq_dc9cc562-5361-44c7-9774-c75feb686e82/discovery/0.log"
Sep 08 14:32:22.184492 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:22.184455    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f4c5d6b6-r2k46_9322718d-a262-44db-b787-0f8bf738e5e4/kube-auth-proxy/0.log"
Sep 08 14:32:22.275161 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:22.275125    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-q4wm8_f56937cf-5625-422c-8796-28f1bd14a51d/payload-pre-processing/0.log"
Sep 08 14:32:22.301910 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:22.301873    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d6cdq_6b9662d3-1390-4eca-a3c3-82eb841865d9/payload-processing/0.log"
Sep 08 14:32:22.562156 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:22.562128    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-85d49875c6-5wzjs_be69ab76-074d-4184-ba89-f833c5a6e662/manager/0.log"
Sep 08 14:32:24.059462 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:24.059378    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mb4nq_dc9cc562-5361-44c7-9774-c75feb686e82/discovery/0.log"
Sep 08 14:32:24.076882 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:24.076850    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f4c5d6b6-r2k46_9322718d-a262-44db-b787-0f8bf738e5e4/kube-auth-proxy/0.log"
Sep 08 14:32:24.188191 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:24.188157    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-q4wm8_f56937cf-5625-422c-8796-28f1bd14a51d/payload-pre-processing/0.log"
Sep 08 14:32:24.214178 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:24.214142    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d6cdq_6b9662d3-1390-4eca-a3c3-82eb841865d9/payload-processing/0.log"
Sep 08 14:32:28.606587 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:28.606553    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-c9zsk_5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c/kube-storage-version-migrator-operator/1.log"
Sep 08 14:32:28.607693 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:28.607671    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-c9zsk_5f73bdc2-eb6e-4fde-a8ef-a860058ffe2c/kube-storage-version-migrator-operator/0.log"
Sep 08 14:32:29.721174 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:29.721148    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76nth_0905014a-a92b-43e0-9092-01dd91124be2/kube-multus-additional-cni-plugins/0.log"
Sep 08 14:32:29.743824 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:29.743797    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76nth_0905014a-a92b-43e0-9092-01dd91124be2/egress-router-binary-copy/0.log"
Sep 08 14:32:29.764182 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:29.764158    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76nth_0905014a-a92b-43e0-9092-01dd91124be2/cni-plugins/0.log"
Sep 08 14:32:29.784627 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:29.784588    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76nth_0905014a-a92b-43e0-9092-01dd91124be2/bond-cni-plugin/0.log"
Sep 08 14:32:29.805647 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:29.805601    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76nth_0905014a-a92b-43e0-9092-01dd91124be2/routeoverride-cni/0.log"
Sep 08 14:32:29.825640 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:29.825584    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76nth_0905014a-a92b-43e0-9092-01dd91124be2/whereabouts-cni-bincopy/0.log"
Sep 08 14:32:29.846594 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:29.846567    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76nth_0905014a-a92b-43e0-9092-01dd91124be2/whereabouts-cni/0.log"
Sep 08 14:32:30.245223 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:30.245188    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nsdhm_f6ff4132-d7f3-45e5-bfe5-710eccf87dcb/kube-multus/0.log"
Sep 08 14:32:30.350432 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:30.350389    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lf79g_e3603e41-2516-4a8f-ba67-862fd59e9dc5/network-metrics-daemon/0.log"
Sep 08 14:32:30.368538 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:30.368512    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lf79g_e3603e41-2516-4a8f-ba67-862fd59e9dc5/kube-rbac-proxy/0.log"
Sep 08 14:32:31.466218 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:31.466163    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcxxd_21d218e5-b574-4c50-903a-2102c395babe/ovn-controller/0.log"
Sep 08 14:32:31.483845 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:31.483816    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcxxd_21d218e5-b574-4c50-903a-2102c395babe/ovn-acl-logging/0.log"
Sep 08 14:32:31.510644 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:31.510543    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcxxd_21d218e5-b574-4c50-903a-2102c395babe/kube-rbac-proxy-node/0.log"
Sep 08 14:32:31.535919 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:31.535887    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcxxd_21d218e5-b574-4c50-903a-2102c395babe/kube-rbac-proxy-ovn-metrics/0.log"
Sep 08 14:32:31.557453 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:31.557421    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcxxd_21d218e5-b574-4c50-903a-2102c395babe/northd/0.log"
Sep 08 14:32:31.579521 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:31.579479    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcxxd_21d218e5-b574-4c50-903a-2102c395babe/nbdb/0.log"
Sep 08 14:32:31.602163 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:31.602129    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcxxd_21d218e5-b574-4c50-903a-2102c395babe/sbdb/0.log"
Sep 08 14:32:31.656139 ip-10-0-142-105 kubenswrapper[2559]: I0908 14:32:31.656101    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcxxd_21d218e5-b574-4c50-903a-2102c395babe/ovnkube-controller/0.log"