Jul 27 19:17:43.967152 ip-10-0-141-32 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 19:17:44.368286 ip-10-0-141-32 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:17:44.368286 ip-10-0-141-32 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 19:17:44.368286 ip-10-0-141-32 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:17:44.368286 ip-10-0-141-32 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 19:17:44.368286 ip-10-0-141-32 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:17:44.369140 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.369057    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 19:17:44.375106 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375082    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:17:44.375106 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375098    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:17:44.375106 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375102    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:17:44.375106 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375105    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:17:44.375106 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375108    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:17:44.375106 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375112    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:17:44.375106 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375115    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375118    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375120    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375123    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375127    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375129    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375133    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375136    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375139    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375141    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375144    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375146    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375149    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375152    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375155    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375157    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375160    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375163    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375166    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375169    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:17:44.375373 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375172    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375174    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375177    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375179    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375182    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375184    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375187    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375190    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375192    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375195    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375197    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375200    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375203    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375205    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375208    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375212    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375216    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375221    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375224    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:17:44.375935 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375226    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375231    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375235    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375239    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375242    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375246    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375249    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375252    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375255    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375258    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375261    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375264    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375266    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375269    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375271    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375274    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375276    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375279    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375281    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375285    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:17:44.376426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375287    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375290    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375292    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375295    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375297    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375300    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375302    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375305    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375308    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375311    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375313    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375316    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375319    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375321    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375324    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375326    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375329    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375331    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375334    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375337    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:17:44.376941 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375339    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375342    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375344    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375347    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375350    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375352    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375354    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375357    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375359    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375362    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375364    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375372    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375375    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.375378    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376133    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376140    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376144    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376147    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376151    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:17:44.377430 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376154    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376157    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376160    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376163    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376166    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376168    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376171    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376174    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376176    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376178    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376181    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376183    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376187    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376189    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376192    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376194    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376197    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376199    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376201    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376204    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:17:44.377918 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376206    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376209    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376211    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376214    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376217    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376220    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376222    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376225    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376228    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376231    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376233    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376236    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376238    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376241    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376245    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376249    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376252    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376255    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376258    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376260    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:17:44.378544 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376263    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376266    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376269    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376271    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376275    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376278    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376281    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376283    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376286    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376288    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376291    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376294    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376296    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376298    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376301    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376304    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376306    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376309    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376312    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376314    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:17:44.379053 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376317    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376320    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376323    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376325    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376328    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376330    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376333    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376335    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376337    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376340    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376342    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376345    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376347    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376350    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376352    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376355    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376357    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376360    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376363    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376365    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:17:44.379551 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376368    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376370    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376373    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376377    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376381    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376384    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376386    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376389    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376392    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376394    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376397    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376401    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376405    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376408    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376785    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376791    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376794    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376797    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376800    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:17:44.380036 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376803    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376805    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376808    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376810    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376813    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376815    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376818    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376820    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376823    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376825    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376828    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376831    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376834    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376836    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376838    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376841    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376844    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376846    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376848    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376851    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:17:44.380546 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376854    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376856    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376859    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376861    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376864    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376866    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376869    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376872    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376874    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376877    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376879    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376882    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376884    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376887    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376890    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376892    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376895    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376897    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376899    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376902    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:17:44.381054 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376905    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376908    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376912    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376915    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376919    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376923    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376926    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376929    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376932    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376934    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376937    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376940    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376945    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376947    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376950    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376953    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376955    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376959    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376962    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:17:44.381573 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376965    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376968    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376970    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376973    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376975    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376978    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376980    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376983    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376986    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376989    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376992    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376994    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.376997    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377000    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377003    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377006    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377008    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377011    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377014    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:17:44.382037 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377016    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377019    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377022    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377024    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377026    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377029    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377033    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377035    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377038    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377040    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377043    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377047    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377050    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377052    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377055    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377057    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377127    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377134    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377140    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377144    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377148    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 19:17:44.382548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377151    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377155    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377159    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377163    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377166    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377169    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377172    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377175    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377178    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377181    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377191    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377196    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377199    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377204    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377207    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377210    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377213    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377218    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377222    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377225    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377228    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377232    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377237    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377240    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 19:17:44.383058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377243    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377246    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377249    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377253    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377256    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377259    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377262    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377265    2558 flags.go:64] FLAG: --enable-server="true"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377268    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377273    2558 flags.go:64] FLAG: --event-burst="100"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377276    2558 flags.go:64] FLAG: --event-qps="50"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377279    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377281    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377284    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377288    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377291    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377294    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377297    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377300    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377303    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377309    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377312    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377315    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377318    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377321    2558 flags.go:64] FLAG: --feature-gates=""
Jul 27 19:17:44.383675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377326    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377329    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377333    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377336    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377339    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377344    2558 flags.go:64] FLAG: --help="false"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377347    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-141-32.ec2.internal"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377350    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377353    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377356    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377359    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377363    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377366    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377368    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377371    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377374    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377377    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377380    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377383    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377386    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377388    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377391    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377394    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377397    2558 flags.go:64] FLAG: --lock-file=""
Jul 27 19:17:44.384322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377400    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377402    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377405    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377415    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377419    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377421    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377424    2558 flags.go:64] FLAG: --logging-format="text"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377427    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377431    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377434    2558 flags.go:64] FLAG: --manifest-url=""
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377437    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377442    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377445    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377449    2558 flags.go:64] FLAG: --max-pods="110"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377452    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377455    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377458    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377461    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377464    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377467    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377469    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377476    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377492    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377497    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 19:17:44.384923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377502    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377506    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377512    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377515    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377518    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377521    2558 flags.go:64] FLAG: --port="10250"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377524    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377527    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04bc996169b701294"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377530    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377533    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377536    2558 flags.go:64] FLAG: --register-node="true"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377538    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377542    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377545    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377548    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377551    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377556    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377559    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377562    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377565    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377568    2558 flags.go:64] FLAG: --runonce="false"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377570    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377573    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377576    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377579    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 19:17:44.385528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377582    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377585    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377588    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377591    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377594    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377597    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377600    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377603    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377606    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377609    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377611    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377617    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377619    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377622    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377627    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377630    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377633    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377635    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377638    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377641    2558 flags.go:64] FLAG: --v="2"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377645    2558 flags.go:64] FLAG: --version="false"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377650    2558 flags.go:64] FLAG: --vmodule=""
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377654    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.377658    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377791    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:17:44.386142 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377795    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377798    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377800    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377803    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377806    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377809    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377812    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377815    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377817    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377820    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377822    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377825    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377827    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377830    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377832    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377835    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377838    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377840    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377843    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377845    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377848    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:17:44.386798 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377850    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377853    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377855    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377858    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377860    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377863    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377865    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377868    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377870    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377874    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377877    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377879    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377882    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377884    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377888    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377892    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377895    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377897    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377900    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:17:44.387338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377903    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377906    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377908    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377911    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377914    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377916    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377919    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377922    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377925    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377927    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377930    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377933    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377935    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377937    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377940    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377943    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377945    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377948    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377950    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377952    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:17:44.387831 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377955    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377957    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377961    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377964    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377966    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377968    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377971    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377974    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377977    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377980    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377983    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377985    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377988    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377990    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377994    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.377997    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378000    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378002    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378005    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:17:44.388314 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378008    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378010    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378013    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378015    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378018    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378020    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378022    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378025    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378027    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378030    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378033    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378035    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378037    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378040    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378042    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378047    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378051    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378053    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:17:44.388817 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.378056    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.378061    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.384639    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.384658    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.384672    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.384677    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384734    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384739    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384742    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384745    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384749    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384752    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384755    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384757    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384760    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:17:44.389267 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384763    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384765    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384768    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384771    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384773    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384776    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384778    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384781    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384784    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384786    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384789    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384793    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384797    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384800    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384803    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384806    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384808    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384811    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384814    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384816    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:17:44.389663 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384819    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384822    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384826    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384831    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384834    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384837    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384840    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384843    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384846    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384849    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384851    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384854    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384857    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384859    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384862    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384864    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384867    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384870    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384872    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:17:44.390154 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384875    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384877    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384880    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384882    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384885    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384888    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384890    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384892    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384895    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384898    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384900    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384903    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384905    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384908    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384911    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384914    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384917    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384919    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384921    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384924    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:17:44.390636 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384927    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384930    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384932    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384935    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384938    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384940    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384943    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384946    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384948    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384951    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384954    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384956    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384959    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384961    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384964    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384966    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384969    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384971    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384974    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384976    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:17:44.391173 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384979    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384981    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384985    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384987    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384990    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384993    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384996    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.384998    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385001    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385003    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385006    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.385011    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385120    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385130    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385133    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:17:44.391688 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385135    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385138    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385141    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385145    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385147    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385150    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385153    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385155    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385158    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385160    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385163    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385165    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385168    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385170    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385175    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385178    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385181    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385191    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385194    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385197    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:17:44.392117 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385201    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385204    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385207    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385211    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385214    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385218    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385221    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385224    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385227    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385229    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385232    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385235    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385237    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385240    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385242    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385245    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385248    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385250    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385253    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385255    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:17:44.392749 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385258    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385261    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385264    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385268    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385270    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385273    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385276    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385279    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385282    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385284    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385287    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385289    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385292    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385295    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385298    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385301    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385304    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385306    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385309    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:17:44.393246 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385311    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385314    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385316    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385319    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385321    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385324    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385326    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385329    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385331    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385334    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385336    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385339    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385341    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385343    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385346    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385348    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385351    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385353    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385356    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385358    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:17:44.393719 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385361    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385363    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385366    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385368    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385371    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385373    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385375    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385379    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385381    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385384    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385386    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385389    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385392    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385394    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385396    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385399    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:17:44.394294 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:44.385401    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:17:44.394712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.385406    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:17:44.394712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.385517    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 19:17:44.394712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.387364    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 19:17:44.394712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.388636    2558 server.go:1019] "Starting client certificate rotation"
Jul 27 19:17:44.394712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.388737    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:17:44.394712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.388773    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:17:44.394712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.390826    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:17:44.394712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.391973    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:17:44.402852 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.402835    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 27 19:17:45.583273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:44.404855    2558 log.go:25] "Validated CRI v1 image API"
Jul 27 19:17:45.583879 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.583866    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 19:17:45.588091 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.588072    2558 fs.go:135] Filesystem UUIDs: map[04eb4872-1e22-4a21-9b7a-ea6858152744:/dev/nvme0n1p3 2966e661-df9a-414b-9ef6-28e68b9ebc68:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 27 19:17:45.588146 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.588091    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 19:17:45.593945 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.593844    2558 manager.go:216] Machine: {Timestamp:2026-07-27 19:17:45.592586085 +0000 UTC m=+0.332141681 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109740 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21f1a178e0b87998d9c1ae3ae1e91d SystemUUID:ec21f1a1-78e0-b879-98d9-c1ae3ae1e91d BootID:3c2ae7af-46ae-4acd-9b5b-af597855e4b0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fd:35:91:3d:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fd:35:91:3d:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:58:a6:1f:de:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 19:17:45.593945 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.593941    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 19:17:45.594054 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.594015    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 19:17:45.595938 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.595924    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:17:45.596680 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.596656    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 19:17:45.596823 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.596683    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 19:17:45.597525 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.597515    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 19:17:45.597573 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.597529    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 19:17:45.597573 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.597542    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:17:45.598247 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.598236    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:17:45.598927 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.598918    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 19:17:45.600914 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.600902    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:17:45.601189 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.601179    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 19:17:45.601222 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.601213    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 19:17:45.601254 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.601232    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 19:17:45.601254 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.601246    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 19:17:45.601305 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.601256    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 27 19:17:45.601305 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.601265    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 19:17:45.601634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.601621    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:17:45.601704 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.601640    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:17:45.604026 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.603987    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 19:17:45.605887 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.605864    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 19:17:45.605972 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.605909    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 19:17:45.607475 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607462    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 19:17:45.607566 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607482    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 19:17:45.607566 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607492    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 19:17:45.607566 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607514    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 19:17:45.607566 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607528    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 19:17:45.607566 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607536    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 19:17:45.607566 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607548    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 19:17:45.607566 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607556    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 19:17:45.607810 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607575    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 19:17:45.607810 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607584    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 19:17:45.607810 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607604    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 19:17:45.607810 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.607613    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 19:17:45.608516 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.608488    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 19:17:45.608570 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.608521    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 19:17:45.611457 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.611442    2558 server.go:1268] "Started kubelet"
Jul 27 19:17:45.611566 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.611540    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 19:17:45.611633 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.611613    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 19:17:45.611673 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.611630    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 19:17:45.612170 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.612141    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:17:45.612312 ip-10-0-141-32 systemd[1]: Started Kubernetes Kubelet.
Jul 27 19:17:45.612792 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.612736    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:17:45.612792 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.612740    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:17:45.613357 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.613341    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 19:17:45.618549 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.618214    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 19:17:45.618549 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.618342    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 19:17:45.620443 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.619628    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-32.ec2.internal.18c63ba125f2b8e1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-32.ec2.internal,UID:ip-10-0-141-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-32.ec2.internal,},FirstTimestamp:2026-07-27 19:17:45.611417825 +0000 UTC m=+0.350973421,LastTimestamp:2026-07-27 19:17:45.611417825 +0000 UTC m=+0.350973421,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-32.ec2.internal,}"
Jul 27 19:17:45.624165 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.624147    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 19:17:45.624239 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.624163    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 19:17:45.624365 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.624348    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:45.624775 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.624753    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 19:17:45.624857 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.624781    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 19:17:45.624857 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.624755    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 19:17:45.624972 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.624894    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 19:17:45.624972 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.624901    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 19:17:45.625064 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.625011    2558 factory.go:55] Registering systemd factory
Jul 27 19:17:45.625064 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.625025    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 27 19:17:45.625271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.625253    2558 factory.go:153] Registering CRI-O factory
Jul 27 19:17:45.625271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.625271    2558 factory.go:223] Registration of the crio container factory successfully
Jul 27 19:17:45.625442 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.625324    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 19:17:45.625442 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.625362    2558 factory.go:103] Registering Raw factory
Jul 27 19:17:45.625442 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.625374    2558 manager.go:1196] Started watching for new ooms in manager
Jul 27 19:17:45.625783 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.625770    2558 manager.go:349] Starting recovery of all containers
Jul 27 19:17:45.626610 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.626583    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 19:17:45.626727 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.626703    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:17:45.634616 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.634462    2558 manager.go:354] Recovery completed
Jul 27 19:17:45.636155 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.636134    2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 27 19:17:45.639274 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.639261    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:17:45.641111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.641095    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:17:45.641195 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.641138    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:17:45.641195 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.641154    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:17:45.641691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.641660    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 19:17:45.641691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.641670    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 19:17:45.641691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.641686    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:17:45.641843 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.641687    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:17:45.642442 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.642427    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:17:45.642516 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.642452    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:17:45.642516 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.642461    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:17:45.643660 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.643647    2558 policy_none.go:49] "None policy: Start"
Jul 27 19:17:45.643719 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.643666    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 19:17:45.643719 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.643679    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 19:17:45.645122 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.645109    2558 policy_none.go:47] "Start"
Jul 27 19:17:45.652930 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.652915    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76ssp"
Jul 27 19:17:45.653322 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.653252    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-32.ec2.internal.18c63ba127b7ce5a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-32.ec2.internal,UID:ip-10-0-141-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-32.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-32.ec2.internal,},FirstTimestamp:2026-07-27 19:17:45.64111113 +0000 UTC m=+0.380666731,LastTimestamp:2026-07-27 19:17:45.64111113 +0000 UTC m=+0.380666731,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-32.ec2.internal,}"
Jul 27 19:17:45.658052 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.657845    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-32.ec2.internal.18c63ba127b857cd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-32.ec2.internal,UID:ip-10-0-141-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-32.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-32.ec2.internal,},FirstTimestamp:2026-07-27 19:17:45.641146317 +0000 UTC m=+0.380701917,LastTimestamp:2026-07-27 19:17:45.641146317 +0000 UTC m=+0.380701917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-32.ec2.internal,}"
Jul 27 19:17:45.663234 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.663216    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76ssp"
Jul 27 19:17:45.669422 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.669339    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-32.ec2.internal.18c63ba127b88bc0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-32.ec2.internal,UID:ip-10-0-141-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-32.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-32.ec2.internal,},FirstTimestamp:2026-07-27 19:17:45.641159616 +0000 UTC m=+0.380715217,LastTimestamp:2026-07-27 19:17:45.641159616 +0000 UTC m=+0.380715217,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-32.ec2.internal,}"
Jul 27 19:17:45.680035 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.680022    2558 manager.go:337] "Starting Device Plugin manager"
Jul 27 19:17:45.680099 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.680050    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 19:17:45.680099 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.680058    2558 server.go:87] "Starting device plugin registration server"
Jul 27 19:17:45.680296 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.680282    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 19:17:45.680380 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.680294    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 19:17:45.680446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.680384    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 19:17:45.680518 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.680469    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 19:17:45.680518 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.680478    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 19:17:45.680943 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.680918    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 19:17:45.680996 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.680960    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:45.780715 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.780690    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:17:45.781904 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.781797    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:17:45.781904 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.781824    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:17:45.781904 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.781836    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:17:45.781904 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.781861    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-32.ec2.internal"
Jul 27 19:17:45.794344 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.794327    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-32.ec2.internal"
Jul 27 19:17:45.794398 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.794353    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-32.ec2.internal\": node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:45.815047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.814990    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 19:17:45.816193 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.816166    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 19:17:45.816276 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.816202    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 19:17:45.816276 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.816221    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 19:17:45.816276 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.816254    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 19:17:45.820344 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.820328    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:17:45.835534 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.835516    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:45.917159 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.917128    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"]
Jul 27 19:17:45.917260 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.917219    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:17:45.918802 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.918787    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:17:45.918871 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.918817    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:17:45.918871 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.918826    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:17:45.920366 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.920352    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:17:45.920481 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.920463    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:45.920548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.920519    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:17:45.921062 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.921045    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:17:45.921141 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.921075    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:17:45.921141 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.921088    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:17:45.921141 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.921108    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:17:45.921141 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.921128    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:17:45.921141 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.921138    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:17:45.922193 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.922180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:45.922242 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.922205    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:17:45.922887 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.922874    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:17:45.922953 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.922897    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:17:45.922953 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.922907    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:17:45.925854 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.925835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c3dd1efb0481aca95d717590d57dbb6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-32.ec2.internal\" (UID: \"1c3dd1efb0481aca95d717590d57dbb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:45.925922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.925868    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30f0e22d1dae472412763504b35f3d27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal\" (UID: \"30f0e22d1dae472412763504b35f3d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:45.925922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:45.925901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f0e22d1dae472412763504b35f3d27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal\" (UID: \"30f0e22d1dae472412763504b35f3d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:45.936113 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.936097    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:45.950153 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.950128    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-32.ec2.internal\" not found" node="ip-10-0-141-32.ec2.internal"
Jul 27 19:17:45.954460 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:45.954442    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-32.ec2.internal\" not found" node="ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.026840 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.026810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c3dd1efb0481aca95d717590d57dbb6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-32.ec2.internal\" (UID: \"1c3dd1efb0481aca95d717590d57dbb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.026840 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.026841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30f0e22d1dae472412763504b35f3d27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal\" (UID: \"30f0e22d1dae472412763504b35f3d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.026973 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.026859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f0e22d1dae472412763504b35f3d27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal\" (UID: \"30f0e22d1dae472412763504b35f3d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.026973 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.026907    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f0e22d1dae472412763504b35f3d27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal\" (UID: \"30f0e22d1dae472412763504b35f3d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.026973 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.026913    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c3dd1efb0481aca95d717590d57dbb6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-32.ec2.internal\" (UID: \"1c3dd1efb0481aca95d717590d57dbb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.026973 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.026922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30f0e22d1dae472412763504b35f3d27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal\" (UID: \"30f0e22d1dae472412763504b35f3d27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.036437 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.036418    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:46.137092 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.137040    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:46.237111 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.237084    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:46.254289 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.254269    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.257016 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.257001    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.337645 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.337613    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:46.438132 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.438108    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-32.ec2.internal\" not found"
Jul 27 19:17:46.453861 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.453840    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:17:46.524940 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.524911    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.539775 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.539757    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:17:46.541692 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.541679    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal"
Jul 27 19:17:46.557073 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.557055    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:17:46.566197 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.566184    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 19:17:46.566302 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.566283    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:17:46.566343 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.566319    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:17:46.595434 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.595415    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:17:46.602401 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.602387    2558 apiserver.go:52] "Watching apiserver"
Jul 27 19:17:46.610044 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.610028    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:17:46.610394 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.610372    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal","openshift-multus/multus-additional-cni-plugins-65888","openshift-multus/multus-nnt6n","openshift-multus/network-metrics-daemon-spmnd","kube-system/konnectivity-agent-6bcsv","openshift-cluster-node-tuning-operator/tuned-9x27z","openshift-dns/node-resolver-mx22j","openshift-network-diagnostics/network-check-target-4pdz7","openshift-network-operator/iptables-alerter-sw5q5","openshift-ovn-kubernetes/ovnkube-node-6sbvh","kube-system/global-pull-secret-syncer-q6sw4","kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254","openshift-image-registry/node-ca-strqs"]
Jul 27 19:17:46.612080 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.612059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.614546 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.614010    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.615762 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.615522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.616732 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.616711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:46.616794 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.616769    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:17:46.617481 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.617463    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:17:46.617560 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.617464    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:17:46.617782 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.617768    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:17:46.618022 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.617999    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bg7k7\""
Jul 27 19:17:46.618129 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618080    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:17:46.618334 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618315    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:17:46.618428 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618361    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:17:46.618428 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618390    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:17:46.618428 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618402    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:17:46.618611 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618465    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:17:46.618923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618904    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dxmng\""
Jul 27 19:17:46.619010 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618938    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nzmm5\""
Jul 27 19:17:46.619010 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.618992    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:17:46.619135 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.619121    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:17:46.619244 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.619221    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:17:46.619317 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.619225    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:17:46.619640 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.619611    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.620867 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.620852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.621933 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.621917    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.623243 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.623227    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:17:46.623338 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.623286    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:17:46.623395 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.623384    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.623471 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.623456    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k4z9d\""
Jul 27 19:17:46.623549 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.623488    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:17:46.624549 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.624516    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 19:17:46.624630 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.624586    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.624705 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.624684    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:17:46.625897 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.625882    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:46.625978 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.625927    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:17:46.626758 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.626701    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:17:46.626961 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.626919    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 19:17:46.627035 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.626988    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mnbx4\""
Jul 27 19:17:46.627035 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.626997    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:17:46.627133 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627091    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:17:46.627290 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627271    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:17:46.627794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627309    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:17:46.627794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627347    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wjl2k\""
Jul 27 19:17:46.627794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627408    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:17:46.627794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627410    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.627794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627480    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q9rgl\""
Jul 27 19:17:46.627794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627561    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bfdth\""
Jul 27 19:17:46.627794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627692    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:17:46.627794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.627745    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:17:46.629193 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-cni-multus\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.629273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a19b60-5403-4e6d-81d1-7858de9a805a-tmp\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.629273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-var-lib-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.629273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.629424 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.629424 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-sys-fs\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.629424 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-hostroot\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.629424 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-run\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.629634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-iptables-alerter-script\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.629634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629448    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80f9dec5-d65e-42ae-8641-11fe87aec515-konnectivity-ca\") pod \"konnectivity-agent-6bcsv\" (UID: \"80f9dec5-d65e-42ae-8641-11fe87aec515\") " pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:17:46.629634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629471    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-kubernetes\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.629634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-etc-selinux\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.629634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-cni-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.629634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-hosts-file\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.629634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.629634 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7t9s\" (UniqueName: \"kubernetes.io/projected/0a890072-cc0b-45b4-b793-c2ed001ce0d7-kube-api-access-m7t9s\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-modprobe-d\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9cd1241-c1ee-471f-b5f1-f737d365e640-kubelet-config\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-systemd-units\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-etc-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629817    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-registration-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-var-lib-kubelet\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9cd1241-c1ee-471f-b5f1-f737d365e640-dbus\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-ovn\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-k8s-cni-cncf-io\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629960    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysctl-conf\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.629997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.629980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-tuned\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630023    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2gbm\" (UniqueName: \"kubernetes.io/projected/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-kube-api-access-r2gbm\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630060    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-run-ovn-kubernetes\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gjg\" (UniqueName: \"kubernetes.io/projected/a4948809-f296-4801-bd93-adfebe1b2acd-kube-api-access-j9gjg\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-system-cni-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-cni-bin\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630174    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmh29\" (UniqueName: \"kubernetes.io/projected/493a912b-d634-46b9-bc4a-584d7b4cd569-kube-api-access-xmh29\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-systemd\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-socket-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630250    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630260    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630254    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-log-socket\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630300    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7wz2l\""
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630312    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-etc-kubernetes\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630333    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-node-log\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-cni-bin\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630480    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-socket-dir-parent\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.630607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-netns\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630565    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-sys\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630613    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-systemd\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630644    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovnkube-script-lib\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysconfig\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-host\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cnibin\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-daemon-config\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-multus-certs\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-lib-modules\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.630998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-kubelet\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-run-netns\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovn-node-metrics-cert\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631095    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-conf-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.631460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovnkube-config\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-os-release\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631238    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-device-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bp8l\" (UniqueName: \"kubernetes.io/projected/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-kube-api-access-9bp8l\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/493a912b-d634-46b9-bc4a-584d7b4cd569-cni-binary-copy\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631337    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysctl-d\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-host-slash\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-tmp-dir\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80f9dec5-d65e-42ae-8641-11fe87aec515-agent-certs\") pod \"konnectivity-agent-6bcsv\" (UID: \"80f9dec5-d65e-42ae-8641-11fe87aec515\") " pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-cnibin\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-slash\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-cni-netd\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxft8\" (UniqueName: \"kubernetes.io/projected/b2906fc0-9443-4f33-a6b5-95386dbb0560-kube-api-access-hxft8\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.632042 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xb9t\" (UniqueName: \"kubernetes.io/projected/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-kube-api-access-7xb9t\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.632572 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-kubelet\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.632572 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjnfm\" (UniqueName: \"kubernetes.io/projected/c2a19b60-5403-4e6d-81d1-7858de9a805a-kube-api-access-pjnfm\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.632572 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-env-overrides\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.632572 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-system-cni-dir\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.632572 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.631782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-os-release\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.638076 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.638053    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:17:46.668608 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.668588    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nxbwt"
Jul 27 19:17:46.668721 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.668575    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:12:45 +0000 UTC" deadline="2028-03-22 01:58:28.982969368 +0000 UTC"
Jul 27 19:17:46.668721 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.668623    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14478h40m42.314350994s"
Jul 27 19:17:46.681696 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.681671    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nxbwt"
Jul 27 19:17:46.725552 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.725533    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 19:17:46.732217 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-systemd-units\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.732314 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-etc-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.732314 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.732314 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-registration-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.732314 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732279    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-var-lib-kubelet\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.732314 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9cd1241-c1ee-471f-b5f1-f737d365e640-dbus\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732330    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-ovn\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732352    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-registration-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-systemd-units\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732354    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-k8s-cni-cncf-io\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-var-lib-kubelet\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-k8s-cni-cncf-io\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysctl-conf\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-etc-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-ovn\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732431    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9cd1241-c1ee-471f-b5f1-f737d365e640-dbus\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-tuned\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2gbm\" (UniqueName: \"kubernetes.io/projected/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-kube-api-access-r2gbm\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-run-ovn-kubernetes\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732528    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysctl-conf\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gjg\" (UniqueName: \"kubernetes.io/projected/a4948809-f296-4801-bd93-adfebe1b2acd-kube-api-access-j9gjg\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25ab1d80-25fc-4b64-a542-7c2984a3c464-host\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.732605 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-run-ovn-kubernetes\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732600    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-system-cni-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732623    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-cni-bin\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmh29\" (UniqueName: \"kubernetes.io/projected/493a912b-d634-46b9-bc4a-584d7b4cd569-kube-api-access-xmh29\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-systemd\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-socket-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-log-socket\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-cni-bin\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-etc-kubernetes\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-node-log\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-cni-bin\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732785    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-system-cni-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732773    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732818    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732831    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-log-socket\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732853    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-socket-dir-parent\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.733470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732882    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-systemd\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732896    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-etc-kubernetes\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-node-log\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-cni-bin\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-netns\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.732999    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-socket-dir-parent\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-sys\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733054    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-netns\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-socket-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-systemd\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733120    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovnkube-script-lib\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysconfig\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-systemd\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733158    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-host\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cnibin\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733147    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-sys\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysconfig\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-daemon-config\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.734324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733230    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-multus-certs\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733242    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cnibin\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733257    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-host\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-lib-modules\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733304    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-run-multus-certs\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-kubelet\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-run-netns\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovn-node-metrics-cert\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733412    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-conf-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-lib-modules\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovnkube-config\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-os-release\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-run-netns\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-device-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.735040 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.733614    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bp8l\" (UniqueName: \"kubernetes.io/projected/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-kube-api-access-9bp8l\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.733702    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret podName:e9cd1241-c1ee-471f-b5f1-f737d365e640 nodeName:}" failed. No retries permitted until 2026-07-27 19:17:47.233662048 +0000 UTC m=+1.973217635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret") pod "global-pull-secret-syncer-q6sw4" (UID: "e9cd1241-c1ee-471f-b5f1-f737d365e640") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733729    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovnkube-script-lib\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/493a912b-d634-46b9-bc4a-584d7b4cd569-cni-binary-copy\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-daemon-config\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysctl-d\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.733780    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-host-slash\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-tmp-dir\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80f9dec5-d65e-42ae-8641-11fe87aec515-agent-certs\") pod \"konnectivity-agent-6bcsv\" (UID: \"80f9dec5-d65e-42ae-8641-11fe87aec515\") " pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-cnibin\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-slash\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733934    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-cni-netd\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.733952    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs podName:a4948809-f296-4801-bd93-adfebe1b2acd nodeName:}" failed. No retries permitted until 2026-07-27 19:17:47.233935435 +0000 UTC m=+1.973491031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs") pod "network-metrics-daemon-spmnd" (UID: "a4948809-f296-4801-bd93-adfebe1b2acd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:46.735922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxft8\" (UniqueName: \"kubernetes.io/projected/b2906fc0-9443-4f33-a6b5-95386dbb0560-kube-api-access-hxft8\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.733993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-cni-netd\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xb9t\" (UniqueName: \"kubernetes.io/projected/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-kube-api-access-7xb9t\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-kubelet\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjnfm\" (UniqueName: \"kubernetes.io/projected/c2a19b60-5403-4e6d-81d1-7858de9a805a-kube-api-access-pjnfm\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734090    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-sysctl-d\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/493a912b-d634-46b9-bc4a-584d7b4cd569-cni-binary-copy\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734087    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-env-overrides\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-system-cni-dir\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734133    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-host-slash\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jgz\" (UniqueName: \"kubernetes.io/projected/25ab1d80-25fc-4b64-a542-7c2984a3c464-kube-api-access-q9jgz\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-os-release\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-cni-multus\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734185    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a19b60-5403-4e6d-81d1-7858de9a805a-tmp\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-var-lib-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-os-release\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.736737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-sys-fs\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-kubelet\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734408    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovnkube-config\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734417    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-tmp-dir\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734462    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-conf-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734480    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2906fc0-9443-4f33-a6b5-95386dbb0560-env-overrides\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-run-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-device-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734623    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734688    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-host-slash\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734739    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-cnibin\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734789    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-cni-multus\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a890072-cc0b-45b4-b793-c2ed001ce0d7-system-cni-dir\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.734892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-os-release\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2906fc0-9443-4f33-a6b5-95386dbb0560-var-lib-openvswitch\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.737649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-host-var-lib-kubelet\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-hostroot\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-run\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735678    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-hostroot\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-iptables-alerter-script\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735717    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80f9dec5-d65e-42ae-8641-11fe87aec515-konnectivity-ca\") pod \"konnectivity-agent-6bcsv\" (UID: \"80f9dec5-d65e-42ae-8641-11fe87aec515\") " pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-sys-fs\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735745    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-kubernetes\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-run\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-etc-selinux\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25ab1d80-25fc-4b64-a542-7c2984a3c464-serviceca\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-kubernetes\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-cni-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735873    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/493a912b-d634-46b9-bc4a-584d7b4cd569-multus-cni-dir\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-etc-selinux\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-hosts-file\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.738540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.735964    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7t9s\" (UniqueName: \"kubernetes.io/projected/0a890072-cc0b-45b4-b793-c2ed001ce0d7-kube-api-access-m7t9s\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-hosts-file\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-modprobe-d\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9cd1241-c1ee-471f-b5f1-f737d365e640-kubelet-config\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9cd1241-c1ee-471f-b5f1-f737d365e640-kubelet-config\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736250    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80f9dec5-d65e-42ae-8641-11fe87aec515-konnectivity-ca\") pod \"konnectivity-agent-6bcsv\" (UID: \"80f9dec5-d65e-42ae-8641-11fe87aec515\") " pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-iptables-alerter-script\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-modprobe-d\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a890072-cc0b-45b4-b793-c2ed001ce0d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.736579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2a19b60-5403-4e6d-81d1-7858de9a805a-etc-tuned\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.737146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80f9dec5-d65e-42ae-8641-11fe87aec515-agent-certs\") pod \"konnectivity-agent-6bcsv\" (UID: \"80f9dec5-d65e-42ae-8641-11fe87aec515\") " pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.737662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2906fc0-9443-4f33-a6b5-95386dbb0560-ovn-node-metrics-cert\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.739354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.738082    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a19b60-5403-4e6d-81d1-7858de9a805a-tmp\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.743371 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.743347    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gjg\" (UniqueName: \"kubernetes.io/projected/a4948809-f296-4801-bd93-adfebe1b2acd-kube-api-access-j9gjg\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:46.746553 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.746514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2gbm\" (UniqueName: \"kubernetes.io/projected/a4c833b7-6fb2-423f-a3ee-0913cb7f9a81-kube-api-access-r2gbm\") pod \"iptables-alerter-sw5q5\" (UID: \"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81\") " pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.748519 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.748488    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:17:46.748610 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.748523    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:17:46.748610 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.748535    2558 projected.go:196] Error preparing data for projected volume kube-api-access-v2kj8 for pod openshift-network-diagnostics/network-check-target-4pdz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:46.748703 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:46.748608    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8 podName:3d80ebf5-c834-465f-819c-bd375e9ea9c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:17:47.248592121 +0000 UTC m=+1.988147717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v2kj8" (UniqueName: "kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8") pod "network-check-target-4pdz7" (UID: "3d80ebf5-c834-465f-819c-bd375e9ea9c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:46.750769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.750751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmh29\" (UniqueName: \"kubernetes.io/projected/493a912b-d634-46b9-bc4a-584d7b4cd569-kube-api-access-xmh29\") pod \"multus-nnt6n\" (UID: \"493a912b-d634-46b9-bc4a-584d7b4cd569\") " pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.751276 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.751258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bp8l\" (UniqueName: \"kubernetes.io/projected/1ecd169e-2d6e-4b6c-b7c7-96119284fe18-kube-api-access-9bp8l\") pod \"aws-ebs-csi-driver-node-c9254\" (UID: \"1ecd169e-2d6e-4b6c-b7c7-96119284fe18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:46.752151 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.752123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjnfm\" (UniqueName: \"kubernetes.io/projected/c2a19b60-5403-4e6d-81d1-7858de9a805a-kube-api-access-pjnfm\") pod \"tuned-9x27z\" (UID: \"c2a19b60-5403-4e6d-81d1-7858de9a805a\") " pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:46.752700 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.752675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7t9s\" (UniqueName: \"kubernetes.io/projected/0a890072-cc0b-45b4-b793-c2ed001ce0d7-kube-api-access-m7t9s\") pod \"multus-additional-cni-plugins-65888\" (UID: \"0a890072-cc0b-45b4-b793-c2ed001ce0d7\") " pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:46.752974 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.752958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxft8\" (UniqueName: \"kubernetes.io/projected/b2906fc0-9443-4f33-a6b5-95386dbb0560-kube-api-access-hxft8\") pod \"ovnkube-node-6sbvh\" (UID: \"b2906fc0-9443-4f33-a6b5-95386dbb0560\") " pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.753216 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.753199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xb9t\" (UniqueName: \"kubernetes.io/projected/56cd5b92-5cfe-4fcd-a1d1-2841432248ee-kube-api-access-7xb9t\") pod \"node-resolver-mx22j\" (UID: \"56cd5b92-5cfe-4fcd-a1d1-2841432248ee\") " pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.776759 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:46.776726    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3dd1efb0481aca95d717590d57dbb6.slice/crio-7e233fc367556715f81a121b190fd69dfd58a23887de2188ac186852a8f6b74c WatchSource:0}: Error finding container 7e233fc367556715f81a121b190fd69dfd58a23887de2188ac186852a8f6b74c: Status 404 returned error can't find the container with id 7e233fc367556715f81a121b190fd69dfd58a23887de2188ac186852a8f6b74c
Jul 27 19:17:46.776978 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:46.776957    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f0e22d1dae472412763504b35f3d27.slice/crio-98c1a8ee5d0b6351c035aa229a599d4f58323e8227b275179d2aab1688d8cd82 WatchSource:0}: Error finding container 98c1a8ee5d0b6351c035aa229a599d4f58323e8227b275179d2aab1688d8cd82: Status 404 returned error can't find the container with id 98c1a8ee5d0b6351c035aa229a599d4f58323e8227b275179d2aab1688d8cd82
Jul 27 19:17:46.778065 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.778048    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sw5q5"
Jul 27 19:17:46.784668 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.784653    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:17:46.787475 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:46.787455    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c833b7_6fb2_423f_a3ee_0913cb7f9a81.slice/crio-e3ac9d70c6eaa8974bcb6e2ef426efd55914a9059cc0021c0c81059b1da7e48f WatchSource:0}: Error finding container e3ac9d70c6eaa8974bcb6e2ef426efd55914a9059cc0021c0c81059b1da7e48f: Status 404 returned error can't find the container with id e3ac9d70c6eaa8974bcb6e2ef426efd55914a9059cc0021c0c81059b1da7e48f
Jul 27 19:17:46.819905 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.819854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sw5q5" event={"ID":"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81","Type":"ContainerStarted","Data":"e3ac9d70c6eaa8974bcb6e2ef426efd55914a9059cc0021c0c81059b1da7e48f"}
Jul 27 19:17:46.820949 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.820923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal" event={"ID":"1c3dd1efb0481aca95d717590d57dbb6","Type":"ContainerStarted","Data":"7e233fc367556715f81a121b190fd69dfd58a23887de2188ac186852a8f6b74c"}
Jul 27 19:17:46.824219 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.822282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal" event={"ID":"30f0e22d1dae472412763504b35f3d27","Type":"ContainerStarted","Data":"98c1a8ee5d0b6351c035aa229a599d4f58323e8227b275179d2aab1688d8cd82"}
Jul 27 19:17:46.836723 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.836700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25ab1d80-25fc-4b64-a542-7c2984a3c464-serviceca\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.836794 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.836763    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25ab1d80-25fc-4b64-a542-7c2984a3c464-host\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.836978 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.836955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jgz\" (UniqueName: \"kubernetes.io/projected/25ab1d80-25fc-4b64-a542-7c2984a3c464-kube-api-access-q9jgz\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.837121 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.837094    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25ab1d80-25fc-4b64-a542-7c2984a3c464-host\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.837272 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.837253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25ab1d80-25fc-4b64-a542-7c2984a3c464-serviceca\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.850781 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.850762    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jgz\" (UniqueName: \"kubernetes.io/projected/25ab1d80-25fc-4b64-a542-7c2984a3c464-kube-api-access-q9jgz\") pod \"node-ca-strqs\" (UID: \"25ab1d80-25fc-4b64-a542-7c2984a3c464\") " pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:46.944930 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.944902    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:17:46.953702 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:46.953678    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2906fc0_9443_4f33_a6b5_95386dbb0560.slice/crio-5b88fea855ecbf176ca7f285cea9390c9f525083c9778880c3554062482dad50 WatchSource:0}: Error finding container 5b88fea855ecbf176ca7f285cea9390c9f525083c9778880c3554062482dad50: Status 404 returned error can't find the container with id 5b88fea855ecbf176ca7f285cea9390c9f525083c9778880c3554062482dad50
Jul 27 19:17:46.960758 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.960738    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mx22j"
Jul 27 19:17:46.967572 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:46.967549    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cd5b92_5cfe_4fcd_a1d1_2841432248ee.slice/crio-51da12e0bf74af8d784d02ce58f218d4513bb2b2fb3bac5eeac6a9f9951b2029 WatchSource:0}: Error finding container 51da12e0bf74af8d784d02ce58f218d4513bb2b2fb3bac5eeac6a9f9951b2029: Status 404 returned error can't find the container with id 51da12e0bf74af8d784d02ce58f218d4513bb2b2fb3bac5eeac6a9f9951b2029
Jul 27 19:17:46.969396 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.969336    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nnt6n"
Jul 27 19:17:46.975756 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:46.975738    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493a912b_d634_46b9_bc4a_584d7b4cd569.slice/crio-d27aa3d988c410048704b7b9996fe79afc74bb17f8806bc0de5f0521edfaf3ab WatchSource:0}: Error finding container d27aa3d988c410048704b7b9996fe79afc74bb17f8806bc0de5f0521edfaf3ab: Status 404 returned error can't find the container with id d27aa3d988c410048704b7b9996fe79afc74bb17f8806bc0de5f0521edfaf3ab
Jul 27 19:17:46.996963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:46.996945    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:17:47.003386 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:47.003357    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f9dec5_d65e_42ae_8641_11fe87aec515.slice/crio-50674032efab8dc3ab862f681055bd4c3b70b6907c6c4e2167afefa4708908d5 WatchSource:0}: Error finding container 50674032efab8dc3ab862f681055bd4c3b70b6907c6c4e2167afefa4708908d5: Status 404 returned error can't find the container with id 50674032efab8dc3ab862f681055bd4c3b70b6907c6c4e2167afefa4708908d5
Jul 27 19:17:47.010493 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.010479    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9x27z"
Jul 27 19:17:47.016666 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:47.016650    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a19b60_5403_4e6d_81d1_7858de9a805a.slice/crio-1e3a54dc8b55526f26fc2345c9fb972e2fd804bbbd479a03033d3b1e1ba310a5 WatchSource:0}: Error finding container 1e3a54dc8b55526f26fc2345c9fb972e2fd804bbbd479a03033d3b1e1ba310a5: Status 404 returned error can't find the container with id 1e3a54dc8b55526f26fc2345c9fb972e2fd804bbbd479a03033d3b1e1ba310a5
Jul 27 19:17:47.031034 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.031008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-65888"
Jul 27 19:17:47.038129 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:47.038110    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a890072_cc0b_45b4_b793_c2ed001ce0d7.slice/crio-8933b10d95ccfba0eb3de975c366d1f7fe628abd878ce99c48bb797e2daa548c WatchSource:0}: Error finding container 8933b10d95ccfba0eb3de975c366d1f7fe628abd878ce99c48bb797e2daa548c: Status 404 returned error can't find the container with id 8933b10d95ccfba0eb3de975c366d1f7fe628abd878ce99c48bb797e2daa548c
Jul 27 19:17:47.049009 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.048994    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254"
Jul 27 19:17:47.052102 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.052087    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:17:47.058470 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:47.058452    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecd169e_2d6e_4b6c_b7c7_96119284fe18.slice/crio-a5b701445a5c42ac106d6ca8fd99ad71976087fa72b2e467c6f25536876d8655 WatchSource:0}: Error finding container a5b701445a5c42ac106d6ca8fd99ad71976087fa72b2e467c6f25536876d8655: Status 404 returned error can't find the container with id a5b701445a5c42ac106d6ca8fd99ad71976087fa72b2e467c6f25536876d8655
Jul 27 19:17:47.084493 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.084461    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-strqs"
Jul 27 19:17:47.091242 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:17:47.091218    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ab1d80_25fc_4b64_a542_7c2984a3c464.slice/crio-bed234640df0a9f93cd77074dcd411d2cb13e704b51878a3f034ce3ce6ff9b92 WatchSource:0}: Error finding container bed234640df0a9f93cd77074dcd411d2cb13e704b51878a3f034ce3ce6ff9b92: Status 404 returned error can't find the container with id bed234640df0a9f93cd77074dcd411d2cb13e704b51878a3f034ce3ce6ff9b92
Jul 27 19:17:47.240246 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.240154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:47.240246 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.240209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:47.240441 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:47.240312    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:47.240441 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:47.240316    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:47.240441 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:47.240364    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs podName:a4948809-f296-4801-bd93-adfebe1b2acd nodeName:}" failed. No retries permitted until 2026-07-27 19:17:48.240345733 +0000 UTC m=+2.979901317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs") pod "network-metrics-daemon-spmnd" (UID: "a4948809-f296-4801-bd93-adfebe1b2acd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:47.240441 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:47.240378    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret podName:e9cd1241-c1ee-471f-b5f1-f737d365e640 nodeName:}" failed. No retries permitted until 2026-07-27 19:17:48.240372546 +0000 UTC m=+2.979928129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret") pod "global-pull-secret-syncer-q6sw4" (UID: "e9cd1241-c1ee-471f-b5f1-f737d365e640") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:47.341220 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.341178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:47.342069 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:47.341551    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:17:47.342069 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:47.341576    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:17:47.342069 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:47.341589    2558 projected.go:196] Error preparing data for projected volume kube-api-access-v2kj8 for pod openshift-network-diagnostics/network-check-target-4pdz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:47.342069 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:47.341658    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8 podName:3d80ebf5-c834-465f-819c-bd375e9ea9c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:17:48.341639255 +0000 UTC m=+3.081194841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v2kj8" (UniqueName: "kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8") pod "network-check-target-4pdz7" (UID: "3d80ebf5-c834-465f-819c-bd375e9ea9c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:47.518157 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.518081    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:17:47.684904 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.684824    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:12:46 +0000 UTC" deadline="2028-03-14 11:12:58.81139728 +0000 UTC"
Jul 27 19:17:47.684904 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.684856    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14295h55m11.126546954s"
Jul 27 19:17:47.837689 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.837605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-strqs" event={"ID":"25ab1d80-25fc-4b64-a542-7c2984a3c464","Type":"ContainerStarted","Data":"bed234640df0a9f93cd77074dcd411d2cb13e704b51878a3f034ce3ce6ff9b92"}
Jul 27 19:17:47.852018 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.851685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerStarted","Data":"8933b10d95ccfba0eb3de975c366d1f7fe628abd878ce99c48bb797e2daa548c"}
Jul 27 19:17:47.867926 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.867887    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6bcsv" event={"ID":"80f9dec5-d65e-42ae-8641-11fe87aec515","Type":"ContainerStarted","Data":"50674032efab8dc3ab862f681055bd4c3b70b6907c6c4e2167afefa4708908d5"}
Jul 27 19:17:47.881111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.881038    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nnt6n" event={"ID":"493a912b-d634-46b9-bc4a-584d7b4cd569","Type":"ContainerStarted","Data":"d27aa3d988c410048704b7b9996fe79afc74bb17f8806bc0de5f0521edfaf3ab"}
Jul 27 19:17:47.908642 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.908606    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mx22j" event={"ID":"56cd5b92-5cfe-4fcd-a1d1-2841432248ee","Type":"ContainerStarted","Data":"51da12e0bf74af8d784d02ce58f218d4513bb2b2fb3bac5eeac6a9f9951b2029"}
Jul 27 19:17:47.926472 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.926356    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"5b88fea855ecbf176ca7f285cea9390c9f525083c9778880c3554062482dad50"}
Jul 27 19:17:47.954857 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.954765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254" event={"ID":"1ecd169e-2d6e-4b6c-b7c7-96119284fe18","Type":"ContainerStarted","Data":"a5b701445a5c42ac106d6ca8fd99ad71976087fa72b2e467c6f25536876d8655"}
Jul 27 19:17:47.960404 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:47.960367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9x27z" event={"ID":"c2a19b60-5403-4e6d-81d1-7858de9a805a","Type":"ContainerStarted","Data":"1e3a54dc8b55526f26fc2345c9fb972e2fd804bbbd479a03033d3b1e1ba310a5"}
Jul 27 19:17:48.248877 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:48.248612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:48.248877 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:48.248663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:48.248877 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.248806    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:48.248877 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.248827    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:48.248877 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.248872    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret podName:e9cd1241-c1ee-471f-b5f1-f737d365e640 nodeName:}" failed. No retries permitted until 2026-07-27 19:17:50.248854886 +0000 UTC m=+4.988410478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret") pod "global-pull-secret-syncer-q6sw4" (UID: "e9cd1241-c1ee-471f-b5f1-f737d365e640") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:48.248877 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.248890    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs podName:a4948809-f296-4801-bd93-adfebe1b2acd nodeName:}" failed. No retries permitted until 2026-07-27 19:17:50.248881278 +0000 UTC m=+4.988436862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs") pod "network-metrics-daemon-spmnd" (UID: "a4948809-f296-4801-bd93-adfebe1b2acd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:48.349380 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:48.349340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:48.349558 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.349535    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:17:48.349624 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.349560    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:17:48.349624 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.349573    2558 projected.go:196] Error preparing data for projected volume kube-api-access-v2kj8 for pod openshift-network-diagnostics/network-check-target-4pdz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:48.349738 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.349636    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8 podName:3d80ebf5-c834-465f-819c-bd375e9ea9c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:17:50.349618038 +0000 UTC m=+5.089173627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v2kj8" (UniqueName: "kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8") pod "network-check-target-4pdz7" (UID: "3d80ebf5-c834-465f-819c-bd375e9ea9c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:48.685998 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:48.685958    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:12:46 +0000 UTC" deadline="2028-02-23 00:52:48.412970982 +0000 UTC"
Jul 27 19:17:48.685998 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:48.685998    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13805h34m59.726977686s"
Jul 27 19:17:48.816914 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:48.816883    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:48.817104 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.817016    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:17:48.817104 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:48.817100    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:48.817221 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.817185    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:17:48.817271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:48.817240    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:48.817324 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:48.817299    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:17:49.422666 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:49.422636    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:17:50.268518 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:50.268247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:50.268972 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.268523    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:50.268972 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:50.268550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:50.268972 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.268607    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret podName:e9cd1241-c1ee-471f-b5f1-f737d365e640 nodeName:}" failed. No retries permitted until 2026-07-27 19:17:54.268585306 +0000 UTC m=+9.008140894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret") pod "global-pull-secret-syncer-q6sw4" (UID: "e9cd1241-c1ee-471f-b5f1-f737d365e640") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:50.268972 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.268715    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:50.268972 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.268769    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs podName:a4948809-f296-4801-bd93-adfebe1b2acd nodeName:}" failed. No retries permitted until 2026-07-27 19:17:54.268753418 +0000 UTC m=+9.008309006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs") pod "network-metrics-daemon-spmnd" (UID: "a4948809-f296-4801-bd93-adfebe1b2acd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:50.369590 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:50.369547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:50.369758 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.369738    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:17:50.369817 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.369770    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:17:50.369817 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.369784    2558 projected.go:196] Error preparing data for projected volume kube-api-access-v2kj8 for pod openshift-network-diagnostics/network-check-target-4pdz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:50.369936 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.369846    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8 podName:3d80ebf5-c834-465f-819c-bd375e9ea9c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:17:54.369827419 +0000 UTC m=+9.109383006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v2kj8" (UniqueName: "kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8") pod "network-check-target-4pdz7" (UID: "3d80ebf5-c834-465f-819c-bd375e9ea9c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:50.817379 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:50.817342    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:50.817606 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.817485    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:17:50.817679 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:50.817656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:50.818243 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.817733    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:17:50.818243 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:50.817789    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:50.818243 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:50.817856    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:17:52.817158 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:52.817123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:52.817665 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:52.817166    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:52.817665 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:52.817129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:52.817665 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:52.817274    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:17:52.817665 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:52.817355    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:17:52.817665 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:52.817424    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:17:54.301324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:54.301281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:54.301823 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:54.301375    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:54.301823 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.301514    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:54.301823 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.301584    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret podName:e9cd1241-c1ee-471f-b5f1-f737d365e640 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:02.301564665 +0000 UTC m=+17.041120251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret") pod "global-pull-secret-syncer-q6sw4" (UID: "e9cd1241-c1ee-471f-b5f1-f737d365e640") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:17:54.301823 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.301514    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:54.301823 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.301642    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs podName:a4948809-f296-4801-bd93-adfebe1b2acd nodeName:}" failed. No retries permitted until 2026-07-27 19:18:02.301628927 +0000 UTC m=+17.041184519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs") pod "network-metrics-daemon-spmnd" (UID: "a4948809-f296-4801-bd93-adfebe1b2acd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:17:54.401843 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:54.401802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:54.402030 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.401988    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:17:54.402030 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.402017    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:17:54.402030 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.402031    2558 projected.go:196] Error preparing data for projected volume kube-api-access-v2kj8 for pod openshift-network-diagnostics/network-check-target-4pdz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:54.402183 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.402092    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8 podName:3d80ebf5-c834-465f-819c-bd375e9ea9c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:02.402071235 +0000 UTC m=+17.141626839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v2kj8" (UniqueName: "kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8") pod "network-check-target-4pdz7" (UID: "3d80ebf5-c834-465f-819c-bd375e9ea9c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:17:54.816905 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:54.816872    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:54.816905 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:54.816905    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:54.817145 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:54.816877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:54.817145 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.817021    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:17:54.817145 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.817113    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:17:54.817296 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:54.817188    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:17:56.817053 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:56.817017    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:56.817549 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:56.817059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:56.817549 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:56.817146    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:17:56.817549 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:56.817287    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:56.817549 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:56.817387    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:17:56.817549 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:56.817465    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:17:58.817277 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:58.817239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:17:58.817705 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:58.817255    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:17:58.817705 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:58.817376    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:17:58.817705 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:17:58.817450    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:17:58.817705 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:58.817597    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:17:58.817705 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:17:58.817680    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:00.816738 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:00.816707    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:00.816738 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:00.816747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:00.817231 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:00.816859    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:00.817231 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:00.816907    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:00.817231 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:00.816941    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:00.817231 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:00.817004    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:02.361399 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:02.361312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:02.361399 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:02.361370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:02.361871 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.361447    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:18:02.361871 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.361479    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:18:02.361871 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.361539    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret podName:e9cd1241-c1ee-471f-b5f1-f737d365e640 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:18.361517337 +0000 UTC m=+33.101072932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret") pod "global-pull-secret-syncer-q6sw4" (UID: "e9cd1241-c1ee-471f-b5f1-f737d365e640") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:18:02.361871 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.361563    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs podName:a4948809-f296-4801-bd93-adfebe1b2acd nodeName:}" failed. No retries permitted until 2026-07-27 19:18:18.361551298 +0000 UTC m=+33.101106896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs") pod "network-metrics-daemon-spmnd" (UID: "a4948809-f296-4801-bd93-adfebe1b2acd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:18:02.462136 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:02.462101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:02.462313 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.462266    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:18:02.462313 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.462289    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:18:02.462313 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.462303    2558 projected.go:196] Error preparing data for projected volume kube-api-access-v2kj8 for pod openshift-network-diagnostics/network-check-target-4pdz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:18:02.462471 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.462365    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8 podName:3d80ebf5-c834-465f-819c-bd375e9ea9c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:18.462348808 +0000 UTC m=+33.201904394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v2kj8" (UniqueName: "kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8") pod "network-check-target-4pdz7" (UID: "3d80ebf5-c834-465f-819c-bd375e9ea9c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:18:02.817310 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:02.817282    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:02.817310 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:02.817316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:02.817675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:02.817286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:02.817675 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.817380    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:02.817675 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.817514    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:02.817675 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:02.817574    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:04.816756 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:04.816717    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:04.817231 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:04.816726    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:04.817231 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:04.816858    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:04.817231 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:04.816717    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:04.817231 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:04.816951    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:04.817231 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:04.817043    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:06.816738 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:06.816711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:06.817641 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:06.816752    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:06.817641 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:06.816831    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:06.817641 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:06.816711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:06.817641 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:06.816932    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:06.817641 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:06.817043    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:07.010478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.010302    2558 generic.go:356] "Generic (PLEG): container finished" podID="30f0e22d1dae472412763504b35f3d27" containerID="fc6de3cf6fdcca49bf3a2001fe782231cd2eb86fa7b27e7d6e25d30a5f21bcc8" exitCode=0
Jul 27 19:18:07.010590 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.010382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal" event={"ID":"30f0e22d1dae472412763504b35f3d27","Type":"ContainerDied","Data":"fc6de3cf6fdcca49bf3a2001fe782231cd2eb86fa7b27e7d6e25d30a5f21bcc8"}
Jul 27 19:18:07.011836 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.011816    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-strqs" event={"ID":"25ab1d80-25fc-4b64-a542-7c2984a3c464","Type":"ContainerStarted","Data":"f5b553401a9477f729d4cf6b8d7e51e6736cd7f2e7302f8266ab3b41587eaa18"}
Jul 27 19:18:07.013225 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.013202    2558 generic.go:356] "Generic (PLEG): container finished" podID="0a890072-cc0b-45b4-b793-c2ed001ce0d7" containerID="5d690718d80a8894921ba7d58c1b17f66b3474602049bcdb085e2ce808ee5b31" exitCode=0
Jul 27 19:18:07.013315 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.013281    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerDied","Data":"5d690718d80a8894921ba7d58c1b17f66b3474602049bcdb085e2ce808ee5b31"}
Jul 27 19:18:07.014669 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.014651    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6bcsv" event={"ID":"80f9dec5-d65e-42ae-8641-11fe87aec515","Type":"ContainerStarted","Data":"f94f254d76e2e6c4a36b554b1feae1c4f58a35e67f8ebe01cb5a7d4f72e9e150"}
Jul 27 19:18:07.016092 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.016062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nnt6n" event={"ID":"493a912b-d634-46b9-bc4a-584d7b4cd569","Type":"ContainerStarted","Data":"a1f6cf16c3dc3302b5db4db62c04db2f745623a49c813f7028f49253d93bbe57"}
Jul 27 19:18:07.017418 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.017393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mx22j" event={"ID":"56cd5b92-5cfe-4fcd-a1d1-2841432248ee","Type":"ContainerStarted","Data":"4e53f8152afcb2ed10a4846b5498e773ae961f9c8cf952c45eb43debd0a40af2"}
Jul 27 19:18:07.019785 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.019763    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"1bb67a847a6d79ec4861f0d2d0152b83b5b7d008ecbea1449f2451f9de0bab22"}
Jul 27 19:18:07.019876 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.019831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"3c5880975ae0004a9e958a789620996eda8e44533f51df6a3026cff30a9ab508"}
Jul 27 19:18:07.019932 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.019875    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"b07870cef25efef8519b821cf4f0fc4bb7ee3bda5bb5f659c9a7d13d38d69b91"}
Jul 27 19:18:07.019932 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.019922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"8982278ca7a515c7706378167ad83b1f20fccc0f95be74ca98a557743213aef2"}
Jul 27 19:18:07.021141 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.021123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal" event={"ID":"1c3dd1efb0481aca95d717590d57dbb6","Type":"ContainerStarted","Data":"6d7d79d16ca7f98460d8dab793e8baaf5ccc7ab7501d6b6406942eea328de9cc"}
Jul 27 19:18:07.022349 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.022333    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254" event={"ID":"1ecd169e-2d6e-4b6c-b7c7-96119284fe18","Type":"ContainerStarted","Data":"7dbe61211cb2ea98bec7745e197a85a1f8f9bbea6c2d44532090693849cf6e5a"}
Jul 27 19:18:07.023721 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.023699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9x27z" event={"ID":"c2a19b60-5403-4e6d-81d1-7858de9a805a","Type":"ContainerStarted","Data":"320019525c4c176d2def2de9694e3ceb90d718eee98808a5d366a9eb8bfc0731"}
Jul 27 19:18:07.041047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.041000    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-strqs" podStartSLOduration=1.658139209 podStartE2EDuration="21.04098809s" totalImagesPullingTime="19.382848881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:07.040797885 +0000 UTC m=+21.780353490" watchObservedRunningTime="2026-07-27 19:18:07.04098809 +0000 UTC m=+21.780543696"
Jul 27 19:18:07.058726 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.058625    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nnt6n" podStartSLOduration=2.525386523 podStartE2EDuration="22.058607924s" totalImagesPullingTime="19.533221401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:07.058048229 +0000 UTC m=+21.797603841" watchObservedRunningTime="2026-07-27 19:18:07.058607924 +0000 UTC m=+21.798163530"
Jul 27 19:18:07.075660 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.075625    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6bcsv" podStartSLOduration=2.6051361589999997 podStartE2EDuration="22.075612441s" totalImagesPullingTime="19.470476282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:07.07537108 +0000 UTC m=+21.814926686" watchObservedRunningTime="2026-07-27 19:18:07.075612441 +0000 UTC m=+21.815168045"
Jul 27 19:18:07.118343 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.118290    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9x27z" podStartSLOduration=2.63830618 podStartE2EDuration="22.118270018s" totalImagesPullingTime="19.479963838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:07.118201655 +0000 UTC m=+21.857757262" watchObservedRunningTime="2026-07-27 19:18:07.118270018 +0000 UTC m=+21.857825627"
Jul 27 19:18:07.133800 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.133762    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-32.ec2.internal" podStartSLOduration=21.133747135 podStartE2EDuration="21.133747135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:07.133557427 +0000 UTC m=+21.873113033" watchObservedRunningTime="2026-07-27 19:18:07.133747135 +0000 UTC m=+21.873302740"
Jul 27 19:18:07.142954 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.142925    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:07.155421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.155385    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mx22j" podStartSLOduration=7.015960552 podStartE2EDuration="22.155371542s" totalImagesPullingTime="15.13941099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:07.155148489 +0000 UTC m=+21.894704095" watchObservedRunningTime="2026-07-27 19:18:07.155371542 +0000 UTC m=+21.894927146"
Jul 27 19:18:07.291968 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.291935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:07.458045 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.457981    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:07.993273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:07.993247    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:08.000536 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.000512    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 19:18:08.027567 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.027535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sw5q5" event={"ID":"a4c833b7-6fb2-423f-a3ee-0913cb7f9a81","Type":"ContainerStarted","Data":"ad98684df6ca11515413b108ba345da027fd41d5a6448094f194a2bef957a096"}
Jul 27 19:18:08.029726 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.029699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal" event={"ID":"30f0e22d1dae472412763504b35f3d27","Type":"ContainerStarted","Data":"07af1613a9f7153374a92ba1c816e0545341549d8ba30a032f5f664724263814"}
Jul 27 19:18:08.036307 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.036276    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"2a4911a5033987a4180d720558ea6f8e7c97f0fe74e0aef528dc9998fb2ecc7b"}
Jul 27 19:18:08.036434 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.036376    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"98ec5c7e51793ee8bdfc74fea6119a371e80f0f107cb4a640f6869a966b52cef"}
Jul 27 19:18:08.038237 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.038164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254" event={"ID":"1ecd169e-2d6e-4b6c-b7c7-96119284fe18","Type":"ContainerStarted","Data":"67953da3b2051be83656633418c8d31accf6435c98a295f1a3fd65a931f0bb4d"}
Jul 27 19:18:08.044714 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.044675    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sw5q5" podStartSLOduration=6.725307871 podStartE2EDuration="22.044659125s" totalImagesPullingTime="15.319351254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:08.044352341 +0000 UTC m=+22.783907948" watchObservedRunningTime="2026-07-27 19:18:08.044659125 +0000 UTC m=+22.784214729"
Jul 27 19:18:08.059096 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.058999    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-32.ec2.internal" podStartSLOduration=22.058987078 podStartE2EDuration="22.058987078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:08.058546715 +0000 UTC m=+22.798102320" watchObservedRunningTime="2026-07-27 19:18:08.058987078 +0000 UTC m=+22.798542680"
Jul 27 19:18:08.069710 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.069682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:08.193528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.193477    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:08.531145 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.531061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:08.631601 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.631545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:08.692764 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.692607    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:18:08.000530231Z","UUID":"c7f3fd77-876c-49b0-b3fa-b8f85f177bef","Handler":null,"Name":"","Endpoint":""}
Jul 27 19:18:08.694516 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.694476    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 19:18:08.694682 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.694538    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 19:18:08.817043 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.816968    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:08.817043 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.817005    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:08.817233 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:08.816972    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:08.817233 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:08.817104    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:08.817233 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:08.817179    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:08.817399 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:08.817273    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:10.046778 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:10.046747    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"4a98e6b61c1a9afa3f18ccaef2f17fd85f61783b8a8a1c053a5efb9cd93e827e"}
Jul 27 19:18:10.048863 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:10.048832    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254" event={"ID":"1ecd169e-2d6e-4b6c-b7c7-96119284fe18","Type":"ContainerStarted","Data":"61831527c569ebb5ff2d140feba23c58c77eb342edcd6da6e7dc8803742e2ea1"}
Jul 27 19:18:10.073980 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:10.073935    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9254" podStartSLOduration=2.597489678 podStartE2EDuration="24.073923485s" totalImagesPullingTime="21.476433807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:10.073832714 +0000 UTC m=+24.813388326" watchObservedRunningTime="2026-07-27 19:18:10.073923485 +0000 UTC m=+24.813479089"
Jul 27 19:18:10.685712 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:10.685677    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:18:10.686339 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:10.686313    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:18:10.816896 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:10.816823    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:10.816896 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:10.816874    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:10.817102 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:10.816873    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:10.817102 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:10.816979    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:10.817168 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:10.817122    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:10.817227 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:10.817206    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:11.245879 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:11.245840    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:18:11.246459 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:11.246429    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6bcsv"
Jul 27 19:18:11.347344 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:11.347206    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:12.055290 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.055255    2558 generic.go:356] "Generic (PLEG): container finished" podID="0a890072-cc0b-45b4-b793-c2ed001ce0d7" containerID="58a7b443d3608d1a480497c46115ddaf685297158310c648554fd6b80f24d3b7" exitCode=0
Jul 27 19:18:12.055453 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.055306    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerDied","Data":"58a7b443d3608d1a480497c46115ddaf685297158310c648554fd6b80f24d3b7"}
Jul 27 19:18:12.058997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.058975    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" event={"ID":"b2906fc0-9443-4f33-a6b5-95386dbb0560","Type":"ContainerStarted","Data":"145e755e904829b1b0adc5f65d2e772c6881d3b6e956cd8d4d5503527f53a419"}
Jul 27 19:18:12.059267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.059243    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:18:12.059356 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.059311    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:18:12.059423 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.059361    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:18:12.074782 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.074758    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:18:12.074887 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.074878    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:18:12.158750 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.158701    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh" podStartSLOduration=7.516810467 podStartE2EDuration="27.158685744s" totalImagesPullingTime="19.641875277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:12.157805861 +0000 UTC m=+26.897361466" watchObservedRunningTime="2026-07-27 19:18:12.158685744 +0000 UTC m=+26.898241348"
Jul 27 19:18:12.237393 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.237358    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:12.442963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.442927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:12.566788 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.566756    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:12.750868 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.745082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:12.817023 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.816980    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:12.817178 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:12.817113    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:12.817250 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.817195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:12.817305 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:12.817275    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:12.817363 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:12.817324    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:12.817410 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:12.817382    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:13.960541 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:13.960337    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4pdz7"]
Jul 27 19:18:13.960910 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:13.960606    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:13.960910 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:13.960691    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:13.965295 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:13.965273    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q6sw4"]
Jul 27 19:18:13.965403 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:13.965346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:13.965444 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:13.965413    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:13.971483 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:13.971428    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-spmnd"]
Jul 27 19:18:13.971559 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:13.971524    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:13.971611 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:13.971596    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:14.065305 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:14.065273    2558 generic.go:356] "Generic (PLEG): container finished" podID="0a890072-cc0b-45b4-b793-c2ed001ce0d7" containerID="9e3ffbb35475039954e65caf5e24b4dfe93cdc200a56be0c3de7f0e71b37afb4" exitCode=0
Jul 27 19:18:14.065451 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:14.065330    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerDied","Data":"9e3ffbb35475039954e65caf5e24b4dfe93cdc200a56be0c3de7f0e71b37afb4"}
Jul 27 19:18:15.148050 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:15.148023    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:15.401271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:15.401198    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:15.817553 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:15.817521    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:15.817678 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:15.817619    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:15.817678 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:15.817626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:15.817678 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:15.817660    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:15.817765 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:15.817716    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:15.817829 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:15.817773    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:16.071726 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:16.071650    2558 generic.go:356] "Generic (PLEG): container finished" podID="0a890072-cc0b-45b4-b793-c2ed001ce0d7" containerID="48b8f3bb1cfe2c7e846139e1c88de8d1bf862fc2e46a4f85a19b967e5c4e9fab" exitCode=0
Jul 27 19:18:16.071878 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:16.071728    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerDied","Data":"48b8f3bb1cfe2c7e846139e1c88de8d1bf862fc2e46a4f85a19b967e5c4e9fab"}
Jul 27 19:18:16.532222 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:16.532190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:16.742940 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:16.742909    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:17.817172 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:17.817094    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:17.817172 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:17.817095    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:17.817700 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:17.817224    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:17.817700 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:17.817226    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pdz7" podUID="3d80ebf5-c834-465f-819c-bd375e9ea9c6"
Jul 27 19:18:17.817700 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:17.817303    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spmnd" podUID="a4948809-f296-4801-bd93-adfebe1b2acd"
Jul 27 19:18:17.817700 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:17.817384    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q6sw4" podUID="e9cd1241-c1ee-471f-b5f1-f737d365e640"
Jul 27 19:18:18.031342 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:18.031306    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:18.213167 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:18.213129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:18.387657 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:18.387625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:18.387849 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:18.387670    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:18.387849 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:18.387785    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:18:18.387849 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:18.387787    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:18:18.387849 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:18.387847    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs podName:a4948809-f296-4801-bd93-adfebe1b2acd nodeName:}" failed. No retries permitted until 2026-07-27 19:18:50.387828721 +0000 UTC m=+65.127384310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs") pod "network-metrics-daemon-spmnd" (UID: "a4948809-f296-4801-bd93-adfebe1b2acd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:18:18.388063 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:18.387865    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret podName:e9cd1241-c1ee-471f-b5f1-f737d365e640 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:50.387855912 +0000 UTC m=+65.127411499 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret") pod "global-pull-secret-syncer-q6sw4" (UID: "e9cd1241-c1ee-471f-b5f1-f737d365e640") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:18:18.488901 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:18.488816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:18.489054 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:18.488946    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:18:18.489054 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:18.488970    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:18:18.489054 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:18.488983    2558 projected.go:196] Error preparing data for projected volume kube-api-access-v2kj8 for pod openshift-network-diagnostics/network-check-target-4pdz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:18:18.489054 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:18.489033    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8 podName:3d80ebf5-c834-465f-819c-bd375e9ea9c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:50.489016598 +0000 UTC m=+65.228572188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v2kj8" (UniqueName: "kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8") pod "network-check-target-4pdz7" (UID: "3d80ebf5-c834-465f-819c-bd375e9ea9c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:18:19.469890 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.469859    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-32.ec2.internal" event="NodeReady"
Jul 27 19:18:19.470294 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.469996    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 19:18:19.534159 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.534128    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6dq5c"]
Jul 27 19:18:19.536879 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.536854    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.539866 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.539282    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:18:19.539866 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.539343    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4m4sx"]
Jul 27 19:18:19.539866 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.539288    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:18:19.539866 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.539693    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m4wg8\""
Jul 27 19:18:19.541367 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.541350    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4m4sx"
Jul 27 19:18:19.543792 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.543760    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dlv9z\""
Jul 27 19:18:19.543909 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.543872    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:18:19.544149 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.544127    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:18:19.544297 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.544173    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:18:19.555599 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.555537    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6dq5c"]
Jul 27 19:18:19.556325 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.556303    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4m4sx"]
Jul 27 19:18:19.697283 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.697247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tndjb\" (UniqueName: \"kubernetes.io/projected/909f8498-ca5a-4004-b5a3-c778d6d58202-kube-api-access-tndjb\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.697478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.697339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bbb57cd-e50f-469b-a6fa-7f5454c57c3c-cert\") pod \"ingress-canary-4m4sx\" (UID: \"2bbb57cd-e50f-469b-a6fa-7f5454c57c3c\") " pod="openshift-ingress-canary/ingress-canary-4m4sx"
Jul 27 19:18:19.697478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.697368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jdjz\" (UniqueName: \"kubernetes.io/projected/2bbb57cd-e50f-469b-a6fa-7f5454c57c3c-kube-api-access-8jdjz\") pod \"ingress-canary-4m4sx\" (UID: \"2bbb57cd-e50f-469b-a6fa-7f5454c57c3c\") " pod="openshift-ingress-canary/ingress-canary-4m4sx"
Jul 27 19:18:19.697478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.697390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/909f8498-ca5a-4004-b5a3-c778d6d58202-config-volume\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.697478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.697424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.697478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.697469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/909f8498-ca5a-4004-b5a3-c778d6d58202-tmp-dir\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.798601 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.798521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jdjz\" (UniqueName: \"kubernetes.io/projected/2bbb57cd-e50f-469b-a6fa-7f5454c57c3c-kube-api-access-8jdjz\") pod \"ingress-canary-4m4sx\" (UID: \"2bbb57cd-e50f-469b-a6fa-7f5454c57c3c\") " pod="openshift-ingress-canary/ingress-canary-4m4sx"
Jul 27 19:18:19.798601 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.798559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/909f8498-ca5a-4004-b5a3-c778d6d58202-config-volume\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.798800 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.798618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.798800 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.798648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/909f8498-ca5a-4004-b5a3-c778d6d58202-tmp-dir\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.798800 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:19.798767    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:18:19.798947 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:19.798855    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls podName:909f8498-ca5a-4004-b5a3-c778d6d58202 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:20.29883136 +0000 UTC m=+35.038386945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls") pod "dns-default-6dq5c" (UID: "909f8498-ca5a-4004-b5a3-c778d6d58202") : secret "dns-default-metrics-tls" not found
Jul 27 19:18:19.798998 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.798976    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/909f8498-ca5a-4004-b5a3-c778d6d58202-tmp-dir\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.799034 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.798995    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tndjb\" (UniqueName: \"kubernetes.io/projected/909f8498-ca5a-4004-b5a3-c778d6d58202-kube-api-access-tndjb\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.799118 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.799107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bbb57cd-e50f-469b-a6fa-7f5454c57c3c-cert\") pod \"ingress-canary-4m4sx\" (UID: \"2bbb57cd-e50f-469b-a6fa-7f5454c57c3c\") " pod="openshift-ingress-canary/ingress-canary-4m4sx"
Jul 27 19:18:19.799176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.799158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/909f8498-ca5a-4004-b5a3-c778d6d58202-config-volume\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.803972 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.803952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bbb57cd-e50f-469b-a6fa-7f5454c57c3c-cert\") pod \"ingress-canary-4m4sx\" (UID: \"2bbb57cd-e50f-469b-a6fa-7f5454c57c3c\") " pod="openshift-ingress-canary/ingress-canary-4m4sx"
Jul 27 19:18:19.811194 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.811163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jdjz\" (UniqueName: \"kubernetes.io/projected/2bbb57cd-e50f-469b-a6fa-7f5454c57c3c-kube-api-access-8jdjz\") pod \"ingress-canary-4m4sx\" (UID: \"2bbb57cd-e50f-469b-a6fa-7f5454c57c3c\") " pod="openshift-ingress-canary/ingress-canary-4m4sx"
Jul 27 19:18:19.813721 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.813696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tndjb\" (UniqueName: \"kubernetes.io/projected/909f8498-ca5a-4004-b5a3-c778d6d58202-kube-api-access-tndjb\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:19.816706 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.816688    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:19.816796 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.816687    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:19.816874 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.816861    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:19.823445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.823424    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:18:19.823585 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.823522    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:18:19.823585 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.823425    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:18:19.823700 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.823607    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d7dln\""
Jul 27 19:18:19.823700 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.823425    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lvnq9\""
Jul 27 19:18:19.824604 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.824587    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:18:19.828622 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.828599    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:19.855765 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.855740    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4m4sx"
Jul 27 19:18:19.981187 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:19.981156    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:20.029982 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:20.029961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4m4sx"]
Jul 27 19:18:20.034133 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:20.034107    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbb57cd_e50f_469b_a6fa_7f5454c57c3c.slice/crio-05deb16d995e277918cb848fe1e72316afd6b0b0da8bce413756eb19348b962c WatchSource:0}: Error finding container 05deb16d995e277918cb848fe1e72316afd6b0b0da8bce413756eb19348b962c: Status 404 returned error can't find the container with id 05deb16d995e277918cb848fe1e72316afd6b0b0da8bce413756eb19348b962c
Jul 27 19:18:20.087892 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:20.087862    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerStarted","Data":"4afcee6cec4f214e94372e7f961669ecd47cd587f7f40e7e5c4ef54064b38ec4"}
Jul 27 19:18:20.089163 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:20.089135    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4m4sx" event={"ID":"2bbb57cd-e50f-469b-a6fa-7f5454c57c3c","Type":"ContainerStarted","Data":"05deb16d995e277918cb848fe1e72316afd6b0b0da8bce413756eb19348b962c"}
Jul 27 19:18:20.302988 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:20.302941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:20.303151 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:20.303087    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:18:20.303151 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:20.303148    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls podName:909f8498-ca5a-4004-b5a3-c778d6d58202 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:21.303133136 +0000 UTC m=+36.042688720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls") pod "dns-default-6dq5c" (UID: "909f8498-ca5a-4004-b5a3-c778d6d58202") : secret "dns-default-metrics-tls" not found
Jul 27 19:18:21.094385 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.094332    2558 generic.go:356] "Generic (PLEG): container finished" podID="0a890072-cc0b-45b4-b793-c2ed001ce0d7" containerID="4afcee6cec4f214e94372e7f961669ecd47cd587f7f40e7e5c4ef54064b38ec4" exitCode=0
Jul 27 19:18:21.094385 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.094378    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerDied","Data":"4afcee6cec4f214e94372e7f961669ecd47cd587f7f40e7e5c4ef54064b38ec4"}
Jul 27 19:18:21.310932 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.310894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:21.311085 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:21.311015    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:18:21.311085 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:21.311069    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls podName:909f8498-ca5a-4004-b5a3-c778d6d58202 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:23.311055699 +0000 UTC m=+38.050611282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls") pod "dns-default-6dq5c" (UID: "909f8498-ca5a-4004-b5a3-c778d6d58202") : secret "dns-default-metrics-tls" not found
Jul 27 19:18:21.932049 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.932020    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:21.980273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.980241    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-44crp"]
Jul 27 19:18:21.992672 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.992648    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t"]
Jul 27 19:18:21.992821 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.992749    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:21.995577 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.995553    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:18:21.995691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.995671    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-djng7\""
Jul 27 19:18:21.996402 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.996385    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:18:21.996947 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.996932    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:18:21.999046 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:21.999028    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:18:22.004962 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.004937    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t"
Jul 27 19:18:22.006273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.006061    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t"]
Jul 27 19:18:22.012725 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.012453    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d2n8z\""
Jul 27 19:18:22.012725 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.012710    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 19:18:22.013661 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.013636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44crp"]
Jul 27 19:18:22.014845 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.014815    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 19:18:22.100640 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.100605    2558 generic.go:356] "Generic (PLEG): container finished" podID="0a890072-cc0b-45b4-b793-c2ed001ce0d7" containerID="b8201f840ac6b1be0a6ec5fc9c65d9c0ff906b60537bbc68bf7005e03090b087" exitCode=0
Jul 27 19:18:22.101073 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.100672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerDied","Data":"b8201f840ac6b1be0a6ec5fc9c65d9c0ff906b60537bbc68bf7005e03090b087"}
Jul 27 19:18:22.105746 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.105723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:22.116759 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.116732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.116877 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.116769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.116877 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.116802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7zs9\" (UniqueName: \"kubernetes.io/projected/1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a-kube-api-access-d7zs9\") pod \"migrator-6865c9967-72s5t\" (UID: \"1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t"
Jul 27 19:18:22.116877 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.116870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45f282d3-e012-4a00-9554-63cead3527ba-data-volume\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.117033 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.116895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6k69\" (UniqueName: \"kubernetes.io/projected/45f282d3-e012-4a00-9554-63cead3527ba-kube-api-access-j6k69\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.117033 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.116946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45f282d3-e012-4a00-9554-63cead3527ba-crio-socket\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.218410 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.218334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.218410 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.218394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7zs9\" (UniqueName: \"kubernetes.io/projected/1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a-kube-api-access-d7zs9\") pod \"migrator-6865c9967-72s5t\" (UID: \"1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t"
Jul 27 19:18:22.218644 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:22.218491    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:22.218644 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.218543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45f282d3-e012-4a00-9554-63cead3527ba-data-volume\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.218644 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:22.218600    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:22.718579371 +0000 UTC m=+37.458134955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:22.218644 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.218614    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6k69\" (UniqueName: \"kubernetes.io/projected/45f282d3-e012-4a00-9554-63cead3527ba-kube-api-access-j6k69\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.218859 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.218660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45f282d3-e012-4a00-9554-63cead3527ba-crio-socket\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.218859 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.218769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.218960 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.218865    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45f282d3-e012-4a00-9554-63cead3527ba-data-volume\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.219154 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.219046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45f282d3-e012-4a00-9554-63cead3527ba-crio-socket\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.219154 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:22.219053    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:18:22.219154 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:22.219129    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:22.719112042 +0000 UTC m=+37.458667648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : configmap "kube-rbac-proxy" not found
Jul 27 19:18:22.233678 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.233649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6k69\" (UniqueName: \"kubernetes.io/projected/45f282d3-e012-4a00-9554-63cead3527ba-kube-api-access-j6k69\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.233783 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.233686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7zs9\" (UniqueName: \"kubernetes.io/projected/1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a-kube-api-access-d7zs9\") pod \"migrator-6865c9967-72s5t\" (UID: \"1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t"
Jul 27 19:18:22.289309 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.289276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:22.314976 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.314951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t"
Jul 27 19:18:22.488264 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.488186    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:22.722767 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.722731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.722935 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.722774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:22.722935 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:22.722861    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:18:22.722935 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:22.722928    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:23.722912407 +0000 UTC m=+38.462467993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : configmap "kube-rbac-proxy" not found
Jul 27 19:18:22.723077 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:22.722947    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:22.723077 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:22.723013    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:23.722999292 +0000 UTC m=+38.462554878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:22.883309 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.883282    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t"]
Jul 27 19:18:22.884409 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:22.884383    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5f2db3_bfc4_49ae_96d9_0da40e8ea03a.slice/crio-663b5c4269ed3c8aaffabbd9e4ac95223df6f99cde999b597463232ce70d2b20 WatchSource:0}: Error finding container 663b5c4269ed3c8aaffabbd9e4ac95223df6f99cde999b597463232ce70d2b20: Status 404 returned error can't find the container with id 663b5c4269ed3c8aaffabbd9e4ac95223df6f99cde999b597463232ce70d2b20
Jul 27 19:18:22.901775 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:22.901751    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:23.079169 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.079144    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:23.106080 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.106001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65888" event={"ID":"0a890072-cc0b-45b4-b793-c2ed001ce0d7","Type":"ContainerStarted","Data":"795ed12a1f618857d7f9b072b24b634eaf7d8086bf77ea56b75c4aedd334806a"}
Jul 27 19:18:23.107670 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.107641    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4m4sx" event={"ID":"2bbb57cd-e50f-469b-a6fa-7f5454c57c3c","Type":"ContainerStarted","Data":"86bde50c66006aa9523da39287512e8950efe9433e6b82b548caa2881a572a4b"}
Jul 27 19:18:23.108667 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.108646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t" event={"ID":"1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a","Type":"ContainerStarted","Data":"663b5c4269ed3c8aaffabbd9e4ac95223df6f99cde999b597463232ce70d2b20"}
Jul 27 19:18:23.166457 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.166404    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-65888" podStartSLOduration=8.487867347 podStartE2EDuration="38.166389372s" totalImagesPullingTime="29.678522025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:23.164626816 +0000 UTC m=+37.904182420" watchObservedRunningTime="2026-07-27 19:18:23.166389372 +0000 UTC m=+37.905944981"
Jul 27 19:18:23.192927 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.192714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:23.195720 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.195667    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4m4sx" podStartSLOduration=1.222041852 podStartE2EDuration="4.195649599s" totalImagesPullingTime="2.973607747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:23.195018863 +0000 UTC m=+37.934574469" watchObservedRunningTime="2026-07-27 19:18:23.195649599 +0000 UTC m=+37.935205205"
Jul 27 19:18:23.328824 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.328727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:23.328980 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:23.328904    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:18:23.329038 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:23.328982    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls podName:909f8498-ca5a-4004-b5a3-c778d6d58202 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:27.328962069 +0000 UTC m=+42.068517668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls") pod "dns-default-6dq5c" (UID: "909f8498-ca5a-4004-b5a3-c778d6d58202") : secret "dns-default-metrics-tls" not found
Jul 27 19:18:23.366088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.366002    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:23.517358 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.517295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:23.733074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.733044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:23.733225 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.733081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:23.733225 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:23.733151    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:18:23.733225 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:23.733210    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:25.73319597 +0000 UTC m=+40.472751554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : configmap "kube-rbac-proxy" not found
Jul 27 19:18:23.733225 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:23.733224    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:23.733363 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:23.733264    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:25.733252701 +0000 UTC m=+40.472808283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:23.946699 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:23.946669    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mx22j_56cd5b92-5cfe-4fcd-a1d1-2841432248ee/dns-node-resolver/0.log"
Jul 27 19:18:24.845072 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:24.845024    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:25.001281 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.001203    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:25.114476 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.114441    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t" event={"ID":"1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a","Type":"ContainerStarted","Data":"c0d4702d7f5683b97fd40867f1b6e60b0871f55b94af3ed2ee2d9876634d2a7b"}
Jul 27 19:18:25.114664 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.114492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t" event={"ID":"1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a","Type":"ContainerStarted","Data":"8e9519846ce5a195e02e0a30831d0449ec0bedb5c9454d45be72ea6d19c77906"}
Jul 27 19:18:25.159360 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.159329    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-strqs_25ab1d80-25fc-4b64-a542-7c2984a3c464/node-ca/0.log"
Jul 27 19:18:25.284301 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.284206    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:25.564417 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.564336    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:25.750131 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.750093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:25.750131 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.750133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:25.750345 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:25.750212    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:18:25.750345 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:25.750285    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:29.750264072 +0000 UTC m=+44.489819660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : configmap "kube-rbac-proxy" not found
Jul 27 19:18:25.750450 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:25.750344    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:25.750450 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:25.750396    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:29.750381087 +0000 UTC m=+44.489936678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:25.752976 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:25.752957    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4m4sx_2bbb57cd-e50f-469b-a6fa-7f5454c57c3c/serve-healthcheck-canary/0.log"
Jul 27 19:18:26.272189 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:26.272147    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:27.362855 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:27.362816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:27.363252 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:27.362982    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:18:27.363252 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:27.363048    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls podName:909f8498-ca5a-4004-b5a3-c778d6d58202 nodeName:}" failed. No retries permitted until 2026-07-27 19:18:35.363032979 +0000 UTC m=+50.102588563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls") pod "dns-default-6dq5c" (UID: "909f8498-ca5a-4004-b5a3-c778d6d58202") : secret "dns-default-metrics-tls" not found
Jul 27 19:18:28.818101 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:28.818071    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:28.927067 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:28.927022    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:29.031221 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:29.031173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:29.127860 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:29.127775    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:29.647938 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:29.647911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:29.778664 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:29.778630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:29.778816 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:29.778721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:29.778816 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:29.778790    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:29.778885 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:29.778860    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:37.778845981 +0000 UTC m=+52.518401567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:29.778885 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:29.778799    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:18:29.778951 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:29.778897    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:37.778887431 +0000 UTC m=+52.518443014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : configmap "kube-rbac-proxy" not found
Jul 27 19:18:30.465847 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:30.465815    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:31.104804 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:31.104769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:31.170910 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:31.170876    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:31.254797 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:31.254768    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:31.660747 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:31.660706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:32.256242 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:32.256210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:32.449927 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:32.449892    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:32.643727 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:32.643655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:32.716323 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:32.716290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:33.065440 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:33.065411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:33.248789 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:33.248761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:33.348855 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:33.348771    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:33.843888 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:33.843858    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:34.284116 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:34.284084    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:34.553462 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:34.553378    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:34.654038 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:34.654010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:34.963811 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:34.963783    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:35.064472 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.064439    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:35.421135 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.421048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:35.424489 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.424459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909f8498-ca5a-4004-b5a3-c778d6d58202-metrics-tls\") pod \"dns-default-6dq5c\" (UID: \"909f8498-ca5a-4004-b5a3-c778d6d58202\") " pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:35.449757 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.449729    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:35.488213 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.488171    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:35.619283 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.619227    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-72s5t" podStartSLOduration=12.752788985 podStartE2EDuration="14.619206193s" totalImagesPullingTime="1.866417208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:25.134134607 +0000 UTC m=+39.873690204" watchObservedRunningTime="2026-07-27 19:18:35.619206193 +0000 UTC m=+50.358761798"
Jul 27 19:18:35.620210 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.620189    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6dq5c"]
Jul 27 19:18:35.623299 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:35.623274    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909f8498_ca5a_4004_b5a3_c778d6d58202.slice/crio-d86aae5b9402fb5c7709cb1cad60f8b9d2de4ed768eaaf23abf907c67f5eb3ec WatchSource:0}: Error finding container d86aae5b9402fb5c7709cb1cad60f8b9d2de4ed768eaaf23abf907c67f5eb3ec: Status 404 returned error can't find the container with id d86aae5b9402fb5c7709cb1cad60f8b9d2de4ed768eaaf23abf907c67f5eb3ec
Jul 27 19:18:35.645614 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.645585    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:35.777651 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:35.777615    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:36.086201 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:36.086127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:36.142774 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:36.142740    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dq5c" event={"ID":"909f8498-ca5a-4004-b5a3-c778d6d58202","Type":"ContainerStarted","Data":"d86aae5b9402fb5c7709cb1cad60f8b9d2de4ed768eaaf23abf907c67f5eb3ec"}
Jul 27 19:18:36.859691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:36.859625    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:37.256111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:37.256054    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:37.460571 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:37.460468    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:37.643921 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:37.643821    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:37.837090 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:37.837061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:37.838154 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:37.838133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:37.838266 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:37.838171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:37.838323 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:37.838279    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:37.838374 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:18:37.838345    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls podName:45f282d3-e012-4a00-9554-63cead3527ba nodeName:}" failed. No retries permitted until 2026-07-27 19:18:53.838327032 +0000 UTC m=+68.577882618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44crp" (UID: "45f282d3-e012-4a00-9554-63cead3527ba") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:18:37.838633 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:37.838613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f282d3-e012-4a00-9554-63cead3527ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:38.149203 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:38.149167    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dq5c" event={"ID":"909f8498-ca5a-4004-b5a3-c778d6d58202","Type":"ContainerStarted","Data":"8013d612d70e450478a475350c2662a96e1a8052192f83466d0f087ce034871e"}
Jul 27 19:18:38.149377 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:38.149217    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dq5c" event={"ID":"909f8498-ca5a-4004-b5a3-c778d6d58202","Type":"ContainerStarted","Data":"05d8c2fcb313c0fa362b25156a4967e5955c30d854937c6038c43c14a2777159"}
Jul 27 19:18:38.149377 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:38.149300    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:38.167237 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:38.167142    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6dq5c" podStartSLOduration=16.940275196 podStartE2EDuration="19.167129561s" totalImagesPullingTime="2.226854365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:38.165966516 +0000 UTC m=+52.905522120" watchObservedRunningTime="2026-07-27 19:18:38.167129561 +0000 UTC m=+52.906685167"
Jul 27 19:18:38.840881 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:38.840848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:39.112418 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:39.112340    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:39.284743 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:39.284712    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:39.427684 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:39.427655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:39.525512 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:39.525467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:39.864819 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:39.864746    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:39.951698 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:39.951670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:40.073877 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:40.073845    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:40.304224 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:40.304192    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:41.096065 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:41.096032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:41.173866 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:41.173834    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:41.308697 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:41.308668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:41.518664 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:41.518626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:42.166453 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:42.166417    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:44.083394 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:44.083368    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6sbvh"
Jul 27 19:18:46.975807 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:46.975775    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:47.138157 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:47.138120    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:47.295651 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:47.295565    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:47.415674 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:47.415643    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:48.153755 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:48.153721    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6dq5c"
Jul 27 19:18:49.098720 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:49.098686    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:49.189551 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:49.189520    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:50.429101 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.429065    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:50.429101 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.429110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:50.435783 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.435760    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:18:50.435863 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.435760    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:18:50.442284 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.442261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9cd1241-c1ee-471f-b5f1-f737d365e640-original-pull-secret\") pod \"global-pull-secret-syncer-q6sw4\" (UID: \"e9cd1241-c1ee-471f-b5f1-f737d365e640\") " pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:50.442402 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.442384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4948809-f296-4801-bd93-adfebe1b2acd-metrics-certs\") pod \"network-metrics-daemon-spmnd\" (UID: \"a4948809-f296-4801-bd93-adfebe1b2acd\") " pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:50.529840 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.529805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:50.532574 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.532555    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:18:50.542401 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.542381    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:18:50.553563 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.553536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2kj8\" (UniqueName: \"kubernetes.io/projected/3d80ebf5-c834-465f-819c-bd375e9ea9c6-kube-api-access-v2kj8\") pod \"network-check-target-4pdz7\" (UID: \"3d80ebf5-c834-465f-819c-bd375e9ea9c6\") " pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:50.729685 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.729609    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q6sw4"
Jul 27 19:18:50.739044 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.739015    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lvnq9\""
Jul 27 19:18:50.743671 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.743653    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d7dln\""
Jul 27 19:18:50.747313 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.747300    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:50.752514 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.752490    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spmnd"
Jul 27 19:18:50.895637 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.895608    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q6sw4"]
Jul 27 19:18:50.899976 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:50.899948    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cd1241_c1ee_471f_b5f1_f737d365e640.slice/crio-67828d253c4398d7d3ca0ca197c21e215b16ba62d1ec499710bf06f0f3c16387 WatchSource:0}: Error finding container 67828d253c4398d7d3ca0ca197c21e215b16ba62d1ec499710bf06f0f3c16387: Status 404 returned error can't find the container with id 67828d253c4398d7d3ca0ca197c21e215b16ba62d1ec499710bf06f0f3c16387
Jul 27 19:18:50.925965 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.925937    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4pdz7"]
Jul 27 19:18:50.929338 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:50.929310    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d80ebf5_c834_465f_819c_bd375e9ea9c6.slice/crio-d36018da2c83ecd3a16d33c2db011a62ba14b8cb3e683be2480218f1b5501d50 WatchSource:0}: Error finding container d36018da2c83ecd3a16d33c2db011a62ba14b8cb3e683be2480218f1b5501d50: Status 404 returned error can't find the container with id d36018da2c83ecd3a16d33c2db011a62ba14b8cb3e683be2480218f1b5501d50
Jul 27 19:18:50.947013 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:50.946991    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-spmnd"]
Jul 27 19:18:50.949624 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:50.949605    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4948809_f296_4801_bd93_adfebe1b2acd.slice/crio-d976d8038c78647bf4ebb3f1ef8dfc8a3a9d2a5f4a29ad7660c52829b1824bd4 WatchSource:0}: Error finding container d976d8038c78647bf4ebb3f1ef8dfc8a3a9d2a5f4a29ad7660c52829b1824bd4: Status 404 returned error can't find the container with id d976d8038c78647bf4ebb3f1ef8dfc8a3a9d2a5f4a29ad7660c52829b1824bd4
Jul 27 19:18:51.181169 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:51.181129    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4pdz7" event={"ID":"3d80ebf5-c834-465f-819c-bd375e9ea9c6","Type":"ContainerStarted","Data":"d36018da2c83ecd3a16d33c2db011a62ba14b8cb3e683be2480218f1b5501d50"}
Jul 27 19:18:51.182143 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:51.182120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spmnd" event={"ID":"a4948809-f296-4801-bd93-adfebe1b2acd","Type":"ContainerStarted","Data":"d976d8038c78647bf4ebb3f1ef8dfc8a3a9d2a5f4a29ad7660c52829b1824bd4"}
Jul 27 19:18:51.183073 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:51.183054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q6sw4" event={"ID":"e9cd1241-c1ee-471f-b5f1-f737d365e640","Type":"ContainerStarted","Data":"67828d253c4398d7d3ca0ca197c21e215b16ba62d1ec499710bf06f0f3c16387"}
Jul 27 19:18:53.193729 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:53.193692    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spmnd" event={"ID":"a4948809-f296-4801-bd93-adfebe1b2acd","Type":"ContainerStarted","Data":"4f84acbbd7bdb6ce2cfe35c977d5350ee05fd1499c3db213b49f4c6fbf087b25"}
Jul 27 19:18:53.194181 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:53.193759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spmnd" event={"ID":"a4948809-f296-4801-bd93-adfebe1b2acd","Type":"ContainerStarted","Data":"2aa0aeb8705349c01824f94c54c2d80b2e1eccd137b49093ee4f2dada789bb9d"}
Jul 27 19:18:53.211165 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:53.211112    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-spmnd" podStartSLOduration=65.429882711 podStartE2EDuration="1m7.211096093s" totalImagesPullingTime="1.781213382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:53.210944312 +0000 UTC m=+67.950499918" watchObservedRunningTime="2026-07-27 19:18:53.211096093 +0000 UTC m=+67.950651698"
Jul 27 19:18:53.852085 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:53.852054    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:53.854482 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:53.854450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f282d3-e012-4a00-9554-63cead3527ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44crp\" (UID: \"45f282d3-e012-4a00-9554-63cead3527ba\") " pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:54.107307 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:54.107230    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-djng7\""
Jul 27 19:18:54.114447 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:54.114415    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44crp"
Jul 27 19:18:55.691514 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:55.691385    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44crp"]
Jul 27 19:18:55.695646 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:55.695616    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f282d3_e012_4a00_9554_63cead3527ba.slice/crio-c8a804b82ac0ed1549fce1234ba8b506e1b433d2016f849bb10093acba17bd89 WatchSource:0}: Error finding container c8a804b82ac0ed1549fce1234ba8b506e1b433d2016f849bb10093acba17bd89: Status 404 returned error can't find the container with id c8a804b82ac0ed1549fce1234ba8b506e1b433d2016f849bb10093acba17bd89
Jul 27 19:18:55.973287 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:55.973255    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:56.094576 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.094534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:56.207704 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.207668    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q6sw4" event={"ID":"e9cd1241-c1ee-471f-b5f1-f737d365e640","Type":"ContainerStarted","Data":"61300c86e413975bfe03096fa5cc522400bf3899202e0adcf5fd211a6839c243"}
Jul 27 19:18:56.209448 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.209379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44crp" event={"ID":"45f282d3-e012-4a00-9554-63cead3527ba","Type":"ContainerStarted","Data":"c8a804b82ac0ed1549fce1234ba8b506e1b433d2016f849bb10093acba17bd89"}
Jul 27 19:18:56.211709 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.211684    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4pdz7" event={"ID":"3d80ebf5-c834-465f-819c-bd375e9ea9c6","Type":"ContainerStarted","Data":"4bb9be53d072419eda9f6cf59e88c70b9667b5c689285aaefc70d87d6949d60c"}
Jul 27 19:18:56.212124 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.212106    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:18:56.247114 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.247019    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4pdz7" podStartSLOduration=66.614630855 podStartE2EDuration="1m11.247001036s" totalImagesPullingTime="4.632370181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:56.245925837 +0000 UTC m=+70.985481445" watchObservedRunningTime="2026-07-27 19:18:56.247001036 +0000 UTC m=+70.986556637"
Jul 27 19:18:56.247270 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.247151    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q6sw4" podStartSLOduration=65.584338073 podStartE2EDuration="1m10.247143018s" totalImagesPullingTime="4.662804945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:18:56.226864948 +0000 UTC m=+70.966420554" watchObservedRunningTime="2026-07-27 19:18:56.247143018 +0000 UTC m=+70.986698624"
Jul 27 19:18:56.621216 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.621127    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"]
Jul 27 19:18:56.622979 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.622955    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"
Jul 27 19:18:56.634077 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.634049    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 19:18:56.634077 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.634071    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 19:18:56.634235 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.634210    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"]
Jul 27 19:18:56.634348 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.634332    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fwbkz\""
Jul 27 19:18:56.634568 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.634549    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 19:18:56.636386 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.636368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.642053 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.641733    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"]
Jul 27 19:18:56.646221 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.642963    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 19:18:56.646221 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.643270    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 19:18:56.646221 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.643518    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 19:18:56.646221 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.643724    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 19:18:56.646221 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.643957    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 19:18:56.653311 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.653253    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"]
Jul 27 19:18:56.670881 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.670856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.671005 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.670892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-ca\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.671005 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.670914    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-hub\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.671005 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.670972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/706eebc5-5551-4996-a1c8-cf24e97a397f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.671162 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.671042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f69e7c8-c8af-40ba-865b-9434ce7aac3a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66c946bf56-v2ths\" (UID: \"8f69e7c8-c8af-40ba-865b-9434ce7aac3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"
Jul 27 19:18:56.671162 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.671079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tndhw\" (UniqueName: \"kubernetes.io/projected/8f69e7c8-c8af-40ba-865b-9434ce7aac3a-kube-api-access-tndhw\") pod \"managed-serviceaccount-addon-agent-66c946bf56-v2ths\" (UID: \"8f69e7c8-c8af-40ba-865b-9434ce7aac3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"
Jul 27 19:18:56.671162 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.671129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lltdp\" (UniqueName: \"kubernetes.io/projected/706eebc5-5551-4996-a1c8-cf24e97a397f-kube-api-access-lltdp\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.671162 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.671157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.772240 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.772211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lltdp\" (UniqueName: \"kubernetes.io/projected/706eebc5-5551-4996-a1c8-cf24e97a397f-kube-api-access-lltdp\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.772737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.772248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.772737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.772331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.772737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.772365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-ca\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.772737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.772390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-hub\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.772737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.772549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/706eebc5-5551-4996-a1c8-cf24e97a397f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.772737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.772610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f69e7c8-c8af-40ba-865b-9434ce7aac3a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66c946bf56-v2ths\" (UID: \"8f69e7c8-c8af-40ba-865b-9434ce7aac3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"
Jul 27 19:18:56.772737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.772636    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tndhw\" (UniqueName: \"kubernetes.io/projected/8f69e7c8-c8af-40ba-865b-9434ce7aac3a-kube-api-access-tndhw\") pod \"managed-serviceaccount-addon-agent-66c946bf56-v2ths\" (UID: \"8f69e7c8-c8af-40ba-865b-9434ce7aac3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"
Jul 27 19:18:56.773387 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.773340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/706eebc5-5551-4996-a1c8-cf24e97a397f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.775637 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.775607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.775752 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.775682    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f69e7c8-c8af-40ba-865b-9434ce7aac3a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66c946bf56-v2ths\" (UID: \"8f69e7c8-c8af-40ba-865b-9434ce7aac3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"
Jul 27 19:18:56.775752 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.775704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.775752 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.775709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-ca\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.775917 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.775780    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/706eebc5-5551-4996-a1c8-cf24e97a397f-hub\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.807693 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.807671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lltdp\" (UniqueName: \"kubernetes.io/projected/706eebc5-5551-4996-a1c8-cf24e97a397f-kube-api-access-lltdp\") pod \"cluster-proxy-proxy-agent-7547dd5944-h6rwv\" (UID: \"706eebc5-5551-4996-a1c8-cf24e97a397f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:56.807833 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.807706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tndhw\" (UniqueName: \"kubernetes.io/projected/8f69e7c8-c8af-40ba-865b-9434ce7aac3a-kube-api-access-tndhw\") pod \"managed-serviceaccount-addon-agent-66c946bf56-v2ths\" (UID: \"8f69e7c8-c8af-40ba-865b-9434ce7aac3a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"
Jul 27 19:18:56.877970 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.877884    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:56.945507 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.945480    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"
Jul 27 19:18:56.954923 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:56.954888    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"
Jul 27 19:18:57.014028 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.014000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:57.109361 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.109329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths"]
Jul 27 19:18:57.112434 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:57.112407    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f69e7c8_c8af_40ba_865b_9434ce7aac3a.slice/crio-9dea7ebc41c06e242bb75414b6b675e568d36591f2a4dfa4a04fbe35a3ab1431 WatchSource:0}: Error finding container 9dea7ebc41c06e242bb75414b6b675e568d36591f2a4dfa4a04fbe35a3ab1431: Status 404 returned error can't find the container with id 9dea7ebc41c06e242bb75414b6b675e568d36591f2a4dfa4a04fbe35a3ab1431
Jul 27 19:18:57.123647 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.123620    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv"]
Jul 27 19:18:57.127123 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:18:57.127095    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod706eebc5_5551_4996_a1c8_cf24e97a397f.slice/crio-94dbad13e28d39cbaf7d5f4758884a0ad2042c9e740967f71a7491d5aa26be81 WatchSource:0}: Error finding container 94dbad13e28d39cbaf7d5f4758884a0ad2042c9e740967f71a7491d5aa26be81: Status 404 returned error can't find the container with id 94dbad13e28d39cbaf7d5f4758884a0ad2042c9e740967f71a7491d5aa26be81
Jul 27 19:18:57.133018 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.132997    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:57.216576 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.216532    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths" event={"ID":"8f69e7c8-c8af-40ba-865b-9434ce7aac3a","Type":"ContainerStarted","Data":"9dea7ebc41c06e242bb75414b6b675e568d36591f2a4dfa4a04fbe35a3ab1431"}
Jul 27 19:18:57.217946 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.217917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv" event={"ID":"706eebc5-5551-4996-a1c8-cf24e97a397f","Type":"ContainerStarted","Data":"94dbad13e28d39cbaf7d5f4758884a0ad2042c9e740967f71a7491d5aa26be81"}
Jul 27 19:18:57.257136 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.257100    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:57.370195 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.370145    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:57.945295 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:57.945248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:58.135306 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:58.135259    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:59.397311 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:59.397279    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:59.627404 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:18:59.627374    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:03.240946 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:03.240874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv" event={"ID":"706eebc5-5551-4996-a1c8-cf24e97a397f","Type":"ContainerStarted","Data":"8f55b02a8ea783e7cef9b6f8dbe274dbc67041ff9429d4c354a5602ba9e1f4c1"}
Jul 27 19:19:03.242569 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:03.242538    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44crp" event={"ID":"45f282d3-e012-4a00-9554-63cead3527ba","Type":"ContainerStarted","Data":"41cab02c472891a0337fd12320f7b5e632ce564b1b7b4f888eca6fced6216f9f"}
Jul 27 19:19:03.244263 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:03.244194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths" event={"ID":"8f69e7c8-c8af-40ba-865b-9434ce7aac3a","Type":"ContainerStarted","Data":"21ffa40e760ff37ac86e197a3c0e2364a70889fde50244f7a4dfb461d88ef884"}
Jul 27 19:19:03.266665 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:03.266619    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c946bf56-v2ths" podStartSLOduration=1.243398074 podStartE2EDuration="7.266602139s" totalImagesPullingTime="6.023204065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:19:03.266167866 +0000 UTC m=+78.005723474" watchObservedRunningTime="2026-07-27 19:19:03.266602139 +0000 UTC m=+78.006157745"
Jul 27 19:19:03.303337 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:03.303297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:03.429702 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:03.429663    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:04.004231 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:04.004156    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:04.251040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:04.251005    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv" event={"ID":"706eebc5-5551-4996-a1c8-cf24e97a397f","Type":"ContainerStarted","Data":"8b3449f475cd4a54630db299cfd4dfaf101cb901cf328c4a2f309a26345c408c"}
Jul 27 19:19:04.251516 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:04.251057    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv" event={"ID":"706eebc5-5551-4996-a1c8-cf24e97a397f","Type":"ContainerStarted","Data":"f3cc03f216f84c017edf98f198f7be567e21bb2fcd36dd6668fa6358f9dfe1ec"}
Jul 27 19:19:04.272348 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:04.272247    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7547dd5944-h6rwv" podStartSLOduration=2.251425704 podStartE2EDuration="8.272225192s" totalImagesPullingTime="6.020799488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:19:04.270351764 +0000 UTC m=+79.009907371" watchObservedRunningTime="2026-07-27 19:19:04.272225192 +0000 UTC m=+79.011780798"
Jul 27 19:19:07.263547 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:07.263490    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44crp" event={"ID":"45f282d3-e012-4a00-9554-63cead3527ba","Type":"ContainerStarted","Data":"2f0e394b1e0b87be983c569113c72ba2d99c0ef0f07e2c8e8f700f7dd320b378"}
Jul 27 19:19:08.438377 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:08.438330    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:08.583116 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:08.583086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:10.095742 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:10.095703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:10.238642 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:10.238608    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:10.460747 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:10.460705    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:11.278969 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:11.278931    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44crp" event={"ID":"45f282d3-e012-4a00-9554-63cead3527ba","Type":"ContainerStarted","Data":"054c81aa5b08949dd26eddc0f3c3ba14580aa5c33352ebd0cb954f6d5cdac7a1"}
Jul 27 19:19:11.306638 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:11.306590    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-44crp" podStartSLOduration=35.25215001 podStartE2EDuration="50.306575478s" totalImagesPullingTime="15.054425468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:18:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:19:11.305697072 +0000 UTC m=+86.045252677" watchObservedRunningTime="2026-07-27 19:19:11.306575478 +0000 UTC m=+86.046131102"
Jul 27 19:19:12.424701 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.424667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:12.662187 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.662154    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:12.753345 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.753311    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mx4hp"]
Jul 27 19:19:12.756563 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.756544    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.759892 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.759868    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:19:12.760688 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.760671    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:19:12.760790 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.760695    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4mgvm\""
Jul 27 19:19:12.760848 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.760695    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:19:12.760848 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.760707    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:19:12.760949 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.760721    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:19:12.761788 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.761771    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:19:12.787452 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.787426    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:12.885303 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885269    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc5f7688-c028-4cc3-b66f-743712fd9993-metrics-client-ca\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.885303 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-sys\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.885513 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-wtmp\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.885513 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.885513 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-accelerators-collector-config\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.885513 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885398    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-textfile\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.885513 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7kkd\" (UniqueName: \"kubernetes.io/projected/bc5f7688-c028-4cc3-b66f-743712fd9993-kube-api-access-q7kkd\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.885667 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885492    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-root\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.885667 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.885535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-tls\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986125 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986089    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7kkd\" (UniqueName: \"kubernetes.io/projected/bc5f7688-c028-4cc3-b66f-743712fd9993-kube-api-access-q7kkd\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986291 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986158    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-root\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986291 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-tls\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986291 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc5f7688-c028-4cc3-b66f-743712fd9993-metrics-client-ca\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986291 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-sys\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986291 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-wtmp\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986562 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986287    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-root\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986562 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:19:12.986310    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 19:19:12.986562 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986562 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-accelerators-collector-config\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986562 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:19:12.986382    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-tls podName:bc5f7688-c028-4cc3-b66f-743712fd9993 nodeName:}" failed. No retries permitted until 2026-07-27 19:19:13.48635968 +0000 UTC m=+88.225915269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-tls") pod "node-exporter-mx4hp" (UID: "bc5f7688-c028-4cc3-b66f-743712fd9993") : secret "node-exporter-tls" not found
Jul 27 19:19:12.986562 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-textfile\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986562 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-sys\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986912 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-wtmp\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986912 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-textfile\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.986912 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986889    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-accelerators-collector-config\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.987027 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.986922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc5f7688-c028-4cc3-b66f-743712fd9993-metrics-client-ca\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.988587 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.988566    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:12.994831 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:12.994810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7kkd\" (UniqueName: \"kubernetes.io/projected/bc5f7688-c028-4cc3-b66f-743712fd9993-kube-api-access-q7kkd\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:13.158035 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.157957    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:13.255545 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.255519    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:13.357285 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.357254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:13.491088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.491059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-tls\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:13.493246 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.493230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc5f7688-c028-4cc3-b66f-743712fd9993-node-exporter-tls\") pod \"node-exporter-mx4hp\" (UID: \"bc5f7688-c028-4cc3-b66f-743712fd9993\") " pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:13.666007 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.665975    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mx4hp"
Jul 27 19:19:13.677711 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:19:13.677681    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5f7688_c028_4cc3_b66f_743712fd9993.slice/crio-658bed840260f162b4ca4613997c52dc7636d67fa7b637a82f8edce12e1514e2 WatchSource:0}: Error finding container 658bed840260f162b4ca4613997c52dc7636d67fa7b637a82f8edce12e1514e2: Status 404 returned error can't find the container with id 658bed840260f162b4ca4613997c52dc7636d67fa7b637a82f8edce12e1514e2
Jul 27 19:19:13.714528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.714484    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:13.856246 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.856168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:13.965466 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:13.965439    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:14.067890 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:14.067860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:14.290170 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:14.290124    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mx4hp" event={"ID":"bc5f7688-c028-4cc3-b66f-743712fd9993","Type":"ContainerStarted","Data":"658bed840260f162b4ca4613997c52dc7636d67fa7b637a82f8edce12e1514e2"}
Jul 27 19:19:14.937057 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:14.937016    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:15.030342 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.030310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:15.295278 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.295193    2558 generic.go:356] "Generic (PLEG): container finished" podID="bc5f7688-c028-4cc3-b66f-743712fd9993" containerID="52c3af0c78e02d42e3b668882ce115ea9bc970e090cf593fa198c12cb9b4d1b3" exitCode=0
Jul 27 19:19:15.295278 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.295251    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mx4hp" event={"ID":"bc5f7688-c028-4cc3-b66f-743712fd9993","Type":"ContainerDied","Data":"52c3af0c78e02d42e3b668882ce115ea9bc970e090cf593fa198c12cb9b4d1b3"}
Jul 27 19:19:15.781092 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.781053    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:15.873450 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.873412    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d4d9d6-qvdk7"]
Jul 27 19:19:15.876734 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.876719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:15.880113 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.880090    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 19:19:15.880234 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.880090    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4sf9f\""
Jul 27 19:19:15.880362 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.880349    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-aju41t2ra24o2\""
Jul 27 19:19:15.880636 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.880611    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 19:19:15.880776 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.880760    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 19:19:15.881640 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.881625    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 19:19:15.883593 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.883575    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 19:19:15.908260 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.908232    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d4d9d6-qvdk7"]
Jul 27 19:19:15.957601 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:15.957574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:16.009204 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.009165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.009204 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.009209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.009445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.009242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-grpc-tls\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.009445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.009287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kccnm\" (UniqueName: \"kubernetes.io/projected/d529e5c3-9dea-48ce-8894-237579b0dc1c-kube-api-access-kccnm\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.009445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.009313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.009445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.009344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-tls\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.009445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.009364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d529e5c3-9dea-48ce-8894-237579b0dc1c-metrics-client-ca\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.009445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.009435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.058463 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.058382    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:16.110541 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.110492    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kccnm\" (UniqueName: \"kubernetes.io/projected/d529e5c3-9dea-48ce-8894-237579b0dc1c-kube-api-access-kccnm\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.110694 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.110550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.110694 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.110584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-tls\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.110694 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.110608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d529e5c3-9dea-48ce-8894-237579b0dc1c-metrics-client-ca\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.110694 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.110654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.110694 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.110688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.110930 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.110715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.110930 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.110750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-grpc-tls\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.111522 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.111467    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d529e5c3-9dea-48ce-8894-237579b0dc1c-metrics-client-ca\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.113269 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.113239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.113369 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.113314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-grpc-tls\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.113440 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.113406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-tls\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.113518 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.113461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.113594 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.113577    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.113825 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.113808    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d529e5c3-9dea-48ce-8894-237579b0dc1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.121009 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.120987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kccnm\" (UniqueName: \"kubernetes.io/projected/d529e5c3-9dea-48ce-8894-237579b0dc1c-kube-api-access-kccnm\") pod \"thanos-querier-d4d9d6-qvdk7\" (UID: \"d529e5c3-9dea-48ce-8894-237579b0dc1c\") " pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.185834 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.185800    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:16.257190 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.257159    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:16.300836 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.300807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mx4hp" event={"ID":"bc5f7688-c028-4cc3-b66f-743712fd9993","Type":"ContainerStarted","Data":"0adb2c3844deed5787a82b05efcb78581f6be6975cfbac0600c09e08bf9684ce"}
Jul 27 19:19:16.300965 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.300859    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mx4hp" event={"ID":"bc5f7688-c028-4cc3-b66f-743712fd9993","Type":"ContainerStarted","Data":"14f1c2dc63bd6c4fe2551da73f945e9710a2161a41a25ca307f3929353bb7a69"}
Jul 27 19:19:16.329941 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.329919    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d4d9d6-qvdk7"]
Jul 27 19:19:16.331782 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:19:16.331757    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd529e5c3_9dea_48ce_8894_237579b0dc1c.slice/crio-f179fc3bdf35cdc1b730da5c991f7cb110a01fe71a8ee8d38efc6b04c4572ed0 WatchSource:0}: Error finding container f179fc3bdf35cdc1b730da5c991f7cb110a01fe71a8ee8d38efc6b04c4572ed0: Status 404 returned error can't find the container with id f179fc3bdf35cdc1b730da5c991f7cb110a01fe71a8ee8d38efc6b04c4572ed0
Jul 27 19:19:16.416978 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:16.416949    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:17.305109 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:17.305077    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7" event={"ID":"d529e5c3-9dea-48ce-8894-237579b0dc1c","Type":"ContainerStarted","Data":"f179fc3bdf35cdc1b730da5c991f7cb110a01fe71a8ee8d38efc6b04c4572ed0"}
Jul 27 19:19:17.542485 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:17.542444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:17.725116 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:17.725057    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:17.859340 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:17.859288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:18.286889 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:18.286860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:18.309932 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:18.309902    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7" event={"ID":"d529e5c3-9dea-48ce-8894-237579b0dc1c","Type":"ContainerStarted","Data":"41e8365f27895fdd06e2839a7a82c876537dcca15f4db482ec19e261f9aa6964"}
Jul 27 19:19:18.310224 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:18.309970    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7" event={"ID":"d529e5c3-9dea-48ce-8894-237579b0dc1c","Type":"ContainerStarted","Data":"218db9bc9842b4d5ce1376aa80d477068ca08c1052f266e841cf443352131822"}
Jul 27 19:19:18.531274 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:18.531231    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:19.055847 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.055797    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mx4hp" podStartSLOduration=6.020848807 podStartE2EDuration="7.05577883s" totalImagesPullingTime="972.176556ms" totalInitContainerRuntime="62.753467ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:19:16.35063993 +0000 UTC m=+91.090195547" watchObservedRunningTime="2026-07-27 19:19:19.05577883 +0000 UTC m=+93.795334435"
Jul 27 19:19:19.056149 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.056135    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:19:19.060008 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.059994    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.065645 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.065619    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 19:19:19.065777 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.065705    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 19:19:19.065777 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.065713    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 19:19:19.066161 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.066145    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 19:19:19.067943 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.067923    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 19:19:19.067943 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.067922    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 19:19:19.068097 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.067990    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 19:19:19.068097 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.067937    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 19:19:19.068097 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.068035    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 19:19:19.068097 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.067924    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 19:19:19.068280 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.068148    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 19:19:19.068818 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.068800    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 19:19:19.068911 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.068807    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-amg6krsbiqhne\""
Jul 27 19:19:19.068911 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.068898    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 19:19:19.068991 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.068943    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w5h4l\""
Jul 27 19:19:19.069392 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.069347    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 19:19:19.070312 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.070294    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 19:19:19.078539 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.078520    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:19:19.129587 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.129565    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:19.133017 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.132879    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133017 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.132915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d3c1b0f-3703-4745-96ed-771ea2d623f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133017 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.132958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133017 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.132984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133228 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d3c1b0f-3703-4745-96ed-771ea2d623f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133228 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133228 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133228 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133228 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133258    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmrr\" (UniqueName: \"kubernetes.io/projected/0d3c1b0f-3703-4745-96ed-771ea2d623f7-kube-api-access-ljmrr\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133627 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133627 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-config\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133627 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133627 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.133627 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.133578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d3c1b0f-3703-4745-96ed-771ea2d623f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235453    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235483    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmrr\" (UniqueName: \"kubernetes.io/projected/0d3c1b0f-3703-4745-96ed-771ea2d623f7-kube-api-access-ljmrr\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-config\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.236526 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.237364 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.237364 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.237364 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.237364 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.235941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d3c1b0f-3703-4745-96ed-771ea2d623f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.237364 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.237039    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.238789 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.238488    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.240451 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.239563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d3c1b0f-3703-4745-96ed-771ea2d623f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.240451 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.239764    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.240451 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.240189    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.243906 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.243880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.245596 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.245205    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.247071 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.247046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.247315 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.247294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.248648 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.248000    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3c1b0f-3703-4745-96ed-771ea2d623f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.251405 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.250915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.251405 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.251368    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.251963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.251924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d3c1b0f-3703-4745-96ed-771ea2d623f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.251963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.251954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.252703 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.252663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.253421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.253402    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.253523 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.253402    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-config\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.258606 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.255006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d3c1b0f-3703-4745-96ed-771ea2d623f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.263128 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.263108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmrr\" (UniqueName: \"kubernetes.io/projected/0d3c1b0f-3703-4745-96ed-771ea2d623f7-kube-api-access-ljmrr\") pod \"prometheus-k8s-0\" (UID: \"0d3c1b0f-3703-4745-96ed-771ea2d623f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.317176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.317108    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7" event={"ID":"d529e5c3-9dea-48ce-8894-237579b0dc1c","Type":"ContainerStarted","Data":"81a2a6282ac065415957874c2139d280b497ce183d78b7771cfb780058c64751"}
Jul 27 19:19:19.317511 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.317197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7" event={"ID":"d529e5c3-9dea-48ce-8894-237579b0dc1c","Type":"ContainerStarted","Data":"641b8808ce8b33a535a199b844e4bd509aaa0abcf7e1e23ac048f912aa10b72d"}
Jul 27 19:19:19.317511 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.317223    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7" event={"ID":"d529e5c3-9dea-48ce-8894-237579b0dc1c","Type":"ContainerStarted","Data":"1433ecfcb568ad7ab16c7694244e6c18c786a94b93dfdac4dff2fb33d1e4998b"}
Jul 27 19:19:19.317511 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.317248    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7" event={"ID":"d529e5c3-9dea-48ce-8894-237579b0dc1c","Type":"ContainerStarted","Data":"2c39a4aeef7e70f579507f0c48e406be8ed24f9568a27a02ffde779c1f914624"}
Jul 27 19:19:19.317511 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.317325    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:19.324942 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.324912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:19.348422 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.348376    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7" podStartSLOduration=1.780563151 podStartE2EDuration="4.348361981s" totalImagesPullingTime="2.56779883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:19:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:19:19.348120967 +0000 UTC m=+94.087676571" watchObservedRunningTime="2026-07-27 19:19:19.348361981 +0000 UTC m=+94.087917587"
Jul 27 19:19:19.369151 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.369128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:19.465376 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.465320    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:19.507812 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.507792    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:19:19.510191 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:19:19.510158    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3c1b0f_3703_4745_96ed_771ea2d623f7.slice/crio-82679f14d9bab58204cfa22c8728a8bcab97a9ac195dd5e204993e4490892c1b WatchSource:0}: Error finding container 82679f14d9bab58204cfa22c8728a8bcab97a9ac195dd5e204993e4490892c1b: Status 404 returned error can't find the container with id 82679f14d9bab58204cfa22c8728a8bcab97a9ac195dd5e204993e4490892c1b
Jul 27 19:19:19.598298 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:19.598199    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:20.322554 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:20.322520    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d3c1b0f-3703-4745-96ed-771ea2d623f7","Type":"ContainerStarted","Data":"82679f14d9bab58204cfa22c8728a8bcab97a9ac195dd5e204993e4490892c1b"}
Jul 27 19:19:21.327093 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:21.327064    2558 generic.go:356] "Generic (PLEG): container finished" podID="0d3c1b0f-3703-4745-96ed-771ea2d623f7" containerID="e5501540c4fcb24aea5222cd0b4b7726368069ea8f0bc869762af853acc1d235" exitCode=0
Jul 27 19:19:21.327476 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:21.327121    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d3c1b0f-3703-4745-96ed-771ea2d623f7","Type":"ContainerDied","Data":"e5501540c4fcb24aea5222cd0b4b7726368069ea8f0bc869762af853acc1d235"}
Jul 27 19:19:22.648870 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:22.648835    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:22.863413 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:22.863374    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:23.467709 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:23.467674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:23.720909 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:23.720868    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:25.146154 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.146063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:25.329075 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.329039    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d4d9d6-qvdk7"
Jul 27 19:19:25.347041 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.347009    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d3c1b0f-3703-4745-96ed-771ea2d623f7","Type":"ContainerStarted","Data":"9e0684a4cd8687a58c361fae882301e7aa0f06e18c18dae55b2ee82ce9deec9d"}
Jul 27 19:19:25.347152 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.347070    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d3c1b0f-3703-4745-96ed-771ea2d623f7","Type":"ContainerStarted","Data":"278df4063b8cd31e55dea7af1793ec40153456182892c4a7a20f60cbc2f6d9c7"}
Jul 27 19:19:25.347152 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.347102    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d3c1b0f-3703-4745-96ed-771ea2d623f7","Type":"ContainerStarted","Data":"725e4a39e3a1c5cafcfeadc41ca42e80096bfff400d19076000a97ff60088dd3"}
Jul 27 19:19:25.347152 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.347127    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d3c1b0f-3703-4745-96ed-771ea2d623f7","Type":"ContainerStarted","Data":"c6151639b76f9e09f894a8c23e7ebf104a1df0518769986ece588392baad3205"}
Jul 27 19:19:25.347321 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.347154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d3c1b0f-3703-4745-96ed-771ea2d623f7","Type":"ContainerStarted","Data":"ed7b18c19b5d73a5f513599a70671816040a4b8dff97e9de25f76ed6313f3445"}
Jul 27 19:19:25.347321 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.347178    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d3c1b0f-3703-4745-96ed-771ea2d623f7","Type":"ContainerStarted","Data":"f4637ee45b4784e5367ad81d5211f8de7d89e83019a63b61015556f2d20e5767"}
Jul 27 19:19:25.384534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:25.384490    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:28.224484 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:28.224455    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4pdz7"
Jul 27 19:19:28.241731 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:28.241681    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.047277395 podStartE2EDuration="9.24166619s" totalImagesPullingTime="4.170490588s" totalInitContainerRuntime="23.898207ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:19:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:19:25.438287015 +0000 UTC m=+100.177842621" watchObservedRunningTime="2026-07-27 19:19:28.24166619 +0000 UTC m=+102.981221795"
Jul 27 19:19:28.529749 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:28.529656    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:28.631645 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:28.631583    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:29.369627 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:29.369597    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:19:32.358317 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:32.358280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:32.513614 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:32.513577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:32.704759 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:32.704730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:40.091519 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:40.091471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:40.364395 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:40.364317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:51.397714 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:19:51.397678    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:19.369421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:19.369385    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:20:19.388116 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:19.388093    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:20:19.564181 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:19.564151    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:20:32.338608 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:32.338570    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:32.697349 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:32.697319    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:41.719738 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:41.719704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:41.868876 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:41.868845    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:47.627906 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:47.627868    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:47.959469 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:47.959432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:50.014017 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:50.013980    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:50.126777 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:50.126749    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:50.908329 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:50.908298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:51.061220 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:20:51.061182    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:00.090852 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:00.090817    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:01.156355 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:01.156325    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:01.256397 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:01.256366    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:10.107519 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:10.107462    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:10.241904 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:10.241869    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:22.795156 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:22.795089    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:22.983425 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:22.983389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:24.686011 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:24.685977    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:56.241164 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:56.241123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:56.333404 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:21:56.333375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:18.318793 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:18.318712    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:19.703410 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:19.703375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:22.139515 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:22.139460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:22.253719 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:22.253683    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:23.745465 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:23.745435    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:23.900907 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:23.900863    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:24.000170 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:24.000085    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:26.107264 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:26.107229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:26.324898 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:26.324863    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:29.082781 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:29.082743    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:29.193336 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:29.193305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:33.747344 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:33.747308    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:34.981025 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:34.980965    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:37.217844 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:37.217806    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:37.319355 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:37.319302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:42.023064 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:42.023027    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:42.123464 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:42.123431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:43.305715 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:43.305656    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:44.212449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:44.212394    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:45.643625 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:45.643597    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 19:22:56.046944 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:56.046908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:56.156656 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:56.156623    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:56.613174 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:56.613139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:56.950948 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:56.950916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:57.065359 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.065326    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"]
Jul 27 19:22:57.067405 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.067390    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.074407 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.074386    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 19:22:57.074530 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.074431    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:22:57.074702 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.074687    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-92f7h\""
Jul 27 19:22:57.074772 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.074737    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:22:57.074827 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.074776    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:22:57.094424 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.094395    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"]
Jul 27 19:22:57.097664 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.097632    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9ad3a91-994d-4492-8f12-4b976667afe2-manifests\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.097764 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.097681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9ad3a91-994d-4492-8f12-4b976667afe2-tmp\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.097803 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.097780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbzm5\" (UniqueName: \"kubernetes.io/projected/e9ad3a91-994d-4492-8f12-4b976667afe2-kube-api-access-xbzm5\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.097837 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.097809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9ad3a91-994d-4492-8f12-4b976667afe2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.097871 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.097842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9ad3a91-994d-4492-8f12-4b976667afe2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.111398 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.111376    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:57.198361 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.198330    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbzm5\" (UniqueName: \"kubernetes.io/projected/e9ad3a91-994d-4492-8f12-4b976667afe2-kube-api-access-xbzm5\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.198563 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.198368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9ad3a91-994d-4492-8f12-4b976667afe2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.198563 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.198515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9ad3a91-994d-4492-8f12-4b976667afe2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.198694 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.198593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9ad3a91-994d-4492-8f12-4b976667afe2-manifests\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.198694 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.198621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9ad3a91-994d-4492-8f12-4b976667afe2-tmp\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.198968 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.198947    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9ad3a91-994d-4492-8f12-4b976667afe2-manifests\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.200823 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.200799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9ad3a91-994d-4492-8f12-4b976667afe2-tmp\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.200916 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.200867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9ad3a91-994d-4492-8f12-4b976667afe2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.201034 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.200996    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9ad3a91-994d-4492-8f12-4b976667afe2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.209584 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.209558    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbzm5\" (UniqueName: \"kubernetes.io/projected/e9ad3a91-994d-4492-8f12-4b976667afe2-kube-api-access-xbzm5\") pod \"opendatahub-operator-controller-manager-7d79566f86-rjfb4\" (UID: \"e9ad3a91-994d-4492-8f12-4b976667afe2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.307649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.307619    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:57.377648 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.377621    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:22:57.407592 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.407562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:57.509936 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.509906    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"]
Jul 27 19:22:57.515248 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:22:57.515218    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ad3a91_994d_4492_8f12_4b976667afe2.slice/crio-2d6c8a1c1eb7b413c685f1929c6328f455b2daa786d7cd8708bdd89175369f7e WatchSource:0}: Error finding container 2d6c8a1c1eb7b413c685f1929c6328f455b2daa786d7cd8708bdd89175369f7e: Status 404 returned error can't find the container with id 2d6c8a1c1eb7b413c685f1929c6328f455b2daa786d7cd8708bdd89175369f7e
Jul 27 19:22:57.517055 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.517040    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:22:57.574777 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.574750    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:57.682417 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.682387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:57.784071 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:57.784004    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:58.084156 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:22:58.084080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4" event={"ID":"e9ad3a91-994d-4492-8f12-4b976667afe2","Type":"ContainerStarted","Data":"2d6c8a1c1eb7b413c685f1929c6328f455b2daa786d7cd8708bdd89175369f7e"}
Jul 27 19:23:01.099382 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:01.099347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4" event={"ID":"e9ad3a91-994d-4492-8f12-4b976667afe2","Type":"ContainerStarted","Data":"8841f0019637642bbadb05b1c39ca5332899c58b65477ecdadbc69a17c6c5cb7"}
Jul 27 19:23:02.104088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:02.104058    2558 generic.go:356] "Generic (PLEG): container finished" podID="e9ad3a91-994d-4492-8f12-4b976667afe2" containerID="8841f0019637642bbadb05b1c39ca5332899c58b65477ecdadbc69a17c6c5cb7" exitCode=0
Jul 27 19:23:02.104428 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:02.104113    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4" event={"ID":"e9ad3a91-994d-4492-8f12-4b976667afe2","Type":"ContainerDied","Data":"8841f0019637642bbadb05b1c39ca5332899c58b65477ecdadbc69a17c6c5cb7"}
Jul 27 19:23:03.110921 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:03.110876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4" event={"ID":"e9ad3a91-994d-4492-8f12-4b976667afe2","Type":"ContainerStarted","Data":"c906785a9d82ec47b3d364964ab748485fe17e3dd5524e20cfabd2d06f85635e"}
Jul 27 19:23:03.111326 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:03.110982    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:23:03.134872 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:03.134817    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4" podStartSLOduration=1.793092505 podStartE2EDuration="6.134801231s" totalImagesPullingTime="3.321326041s" totalInitContainerRuntime="1.020382685s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:22:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:23:03.133166901 +0000 UTC m=+317.872722505" watchObservedRunningTime="2026-07-27 19:23:03.134801231 +0000 UTC m=+317.874356835"
Jul 27 19:23:08.505836 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:08.505805    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:08.612551 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:08.612517    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:08.837985 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:08.837907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:08.977143 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:08.977109    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:14.117438 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:14.117411    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d79566f86-rjfb4"
Jul 27 19:23:16.272627 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:16.270660    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:16.411932 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:16.411893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:16.930216 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:16.930182    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:17.351769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.351690    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"]
Jul 27 19:23:17.358510 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.358475    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.373415 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.373392    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:23:17.377286 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.377252    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 19:23:17.378303 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.378280    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g4v6z\""
Jul 27 19:23:17.378438 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.378280    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 19:23:17.378438 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.378287    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 19:23:17.378438 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.378312    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 19:23:17.410548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.410520    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"]
Jul 27 19:23:17.414448 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.414422    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:17.462873 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.462845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-metrics-cert\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.463040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.462889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-manager-config\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.463040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.462951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-cert\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.463040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.462994    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ccj5\" (UniqueName: \"kubernetes.io/projected/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-kube-api-access-8ccj5\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.563542 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.563509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-manager-config\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.563722 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.563556    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-cert\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.563722 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.563575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ccj5\" (UniqueName: \"kubernetes.io/projected/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-kube-api-access-8ccj5\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.563722 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.563611    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-metrics-cert\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.564175 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.564150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-manager-config\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.566106 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.566084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-cert\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.566106 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.566095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-metrics-cert\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.577678 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.577656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ccj5\" (UniqueName: \"kubernetes.io/projected/c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f-kube-api-access-8ccj5\") pod \"lws-controller-manager-6fd758c6bf-fqn4n\" (UID: \"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f\") " pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.580621 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.580596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:17.667123 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.667047    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:17.692395 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.692369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:17.806423 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.806042    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:17.807633 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:17.807608    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"]
Jul 27 19:23:17.811050 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:23:17.811025    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1190ac2_5b9b_4d42_9c0c_b7f063b97d8f.slice/crio-e1432526838352d77363f91005b18c0ee7dab87167c67bad6acd371286534af1 WatchSource:0}: Error finding container e1432526838352d77363f91005b18c0ee7dab87167c67bad6acd371286534af1: Status 404 returned error can't find the container with id e1432526838352d77363f91005b18c0ee7dab87167c67bad6acd371286534af1
Jul 27 19:23:18.111237 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:18.111187    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:18.166927 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:18.166890    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n" event={"ID":"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f","Type":"ContainerStarted","Data":"e1432526838352d77363f91005b18c0ee7dab87167c67bad6acd371286534af1"}
Jul 27 19:23:18.504205 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:18.504161    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:18.750541 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:18.750464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:18.873736 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:18.873650    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:20.089330 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:20.089286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:21.179218 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:21.179186    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n" event={"ID":"c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f","Type":"ContainerStarted","Data":"0611fddd26d87656fa8db4183466257f07d9e3b9ec07d53549d2a7cef93a931e"}
Jul 27 19:23:21.179648 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:21.179327    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:21.197780 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:21.197731    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n" podStartSLOduration=1.85011884 podStartE2EDuration="4.197713057s" totalImagesPullingTime="2.347594217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:23:21.197463653 +0000 UTC m=+335.937019257" watchObservedRunningTime="2026-07-27 19:23:21.197713057 +0000 UTC m=+335.937268664"
Jul 27 19:23:24.580893 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:24.580864    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:24.682640 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:24.682609    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:25.194751 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.194716    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"]
Jul 27 19:23:25.197592 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.197572    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.200071 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.200051    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 19:23:25.200281 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.200242    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 19:23:25.200281 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.200260    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 19:23:25.200281 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.200271    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sskzp\""
Jul 27 19:23:25.200539 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.200524    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 19:23:25.200603 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.200553    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:23:25.201020 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.201004    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:23:25.218688 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.218667    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"]
Jul 27 19:23:25.329851 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.329819    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.330029 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.329859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.330029 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.329908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.330029 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.329941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.330029 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.329974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.330231 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.330076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.330231 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.330119    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmw2n\" (UniqueName: \"kubernetes.io/projected/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-kube-api-access-rmw2n\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.430863 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.430824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.431041 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.430869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmw2n\" (UniqueName: \"kubernetes.io/projected/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-kube-api-access-rmw2n\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.431106 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.431084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.431165 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.431127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.431212 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.431161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.431212 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.431204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.431320 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.431244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.432089 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.432013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.433673 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.433642    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.434687 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.434667    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.434848 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.434830    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.434911 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.434892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.457841 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.457783    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.462061 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.462035    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmw2n\" (UniqueName: \"kubernetes.io/projected/f99bcf23-8ab0-4b80-a7bb-49f2fb57b976-kube-api-access-rmw2n\") pod \"istiod-openshift-gateway-5677ccb49b-pscbn\" (UID: \"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.506446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.506416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:25.678922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.678900    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"]
Jul 27 19:23:25.680922 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:23:25.680899    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99bcf23_8ab0_4b80_a7bb_49f2fb57b976.slice/crio-f795744cbef45ff61de24aaf41080817a3abbb40605d2bece5f288464b6b58d1 WatchSource:0}: Error finding container f795744cbef45ff61de24aaf41080817a3abbb40605d2bece5f288464b6b58d1: Status 404 returned error can't find the container with id f795744cbef45ff61de24aaf41080817a3abbb40605d2bece5f288464b6b58d1
Jul 27 19:23:25.797119 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.797000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:25.898361 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:25.898293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:26.001575 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:26.001540    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:26.197664 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:26.197625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn" event={"ID":"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976","Type":"ContainerStarted","Data":"f795744cbef45ff61de24aaf41080817a3abbb40605d2bece5f288464b6b58d1"}
Jul 27 19:23:28.051383 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:28.051316    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:28.155982 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:28.155929    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:28.356570 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:28.356532    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 19:23:28.356696 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:28.356613    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 19:23:28.547609 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:28.547574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:28.809524 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:28.809440    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:29.211735 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:29.211697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn" event={"ID":"f99bcf23-8ab0-4b80-a7bb-49f2fb57b976","Type":"ContainerStarted","Data":"07f2a6218242aa38d6bf205386a047d7a1ee71fda9bc050ba608b85a8d7174e1"}
Jul 27 19:23:29.212173 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:29.211906    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:29.213598 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:29.213576    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn"
Jul 27 19:23:29.286482 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:29.286432    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn" podStartSLOduration=1.612877474 podStartE2EDuration="4.28641607s" totalImagesPullingTime="2.673538596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:23:29.284420386 +0000 UTC m=+344.023975993" watchObservedRunningTime="2026-07-27 19:23:29.28641607 +0000 UTC m=+344.025971674"
Jul 27 19:23:29.396870 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:29.396827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:29.504385 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:29.504297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:32.184849 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:32.184818    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6fd758c6bf-fqn4n"
Jul 27 19:23:51.413493 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:51.413454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:51.529362 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:51.529332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:53.233959 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:23:53.233912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:13.305966 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:24:13.305929    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:17.611829 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:24:17.611769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:17.710300 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:24:17.710271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:17.794976 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:24:17.794947    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:09.381947 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:09.381807    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:13.566434 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:13.566385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:14.726493 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:14.726452    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:16.018477 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:16.018407    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:16.364737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:16.364639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:17.290620 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:17.290587    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:20.786679 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:20.786641    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:20.992103 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:20.992068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:21.161153 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:21.161082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:21.278995 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:21.278964    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:23.825744 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:23.825713    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:25.385122 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:25.385085    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:25.484902 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:25.484869    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:28.968227 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:28.968197    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:29.069583 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:29.069555    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:30.726740 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:30.726708    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:31.016164 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:31.016083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:32.366427 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:32.366376    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:32.689662 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:32.689630    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:39.187736 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:39.187702    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:39.291940 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:39.291907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:40.828404 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:40.828366    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:40.928138 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:40.928099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:41.030757 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:41.030722    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:43.426489 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:43.426454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:43.531898 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:43.531852    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:46.580020 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:46.579985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:46.685051 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:46.684991    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:49.050941 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:49.050877    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:50.184586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:50.184551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:50.285112 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:50.285077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:59.424237 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:59.424201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:59.563161 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:25:59.563129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:16.923557 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:16.923518    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:44.058215 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:44.058180    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:44.155691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:44.155653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:49.917984 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:49.917929    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:50.054650 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:50.054616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:52.436554 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.436521    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:52.519777 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.519717    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:52.618123 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.618072    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:52.852870 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.852789    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:26:52.855940 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.855924    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:52.858937 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.858917    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:26:52.859888 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.859869    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6w68x\""
Jul 27 19:26:52.859984 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.859891    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:26:52.860440 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.860427    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 19:26:52.874148 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.874128    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:26:52.879724 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.879706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98485\" (UniqueName: \"kubernetes.io/projected/082a93f9-8f11-4ba4-928c-1f5450d814d9-kube-api-access-98485\") pod \"limitador-limitador-54d6d988d5-bwvvr\" (UID: \"082a93f9-8f11-4ba4-928c-1f5450d814d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:52.879781 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.879733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/082a93f9-8f11-4ba4-928c-1f5450d814d9-config-file\") pod \"limitador-limitador-54d6d988d5-bwvvr\" (UID: \"082a93f9-8f11-4ba4-928c-1f5450d814d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:52.914236 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.914206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:26:52.980271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.980242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98485\" (UniqueName: \"kubernetes.io/projected/082a93f9-8f11-4ba4-928c-1f5450d814d9-kube-api-access-98485\") pod \"limitador-limitador-54d6d988d5-bwvvr\" (UID: \"082a93f9-8f11-4ba4-928c-1f5450d814d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:52.980271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.980272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/082a93f9-8f11-4ba4-928c-1f5450d814d9-config-file\") pod \"limitador-limitador-54d6d988d5-bwvvr\" (UID: \"082a93f9-8f11-4ba4-928c-1f5450d814d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:52.980925 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.980908    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/082a93f9-8f11-4ba4-928c-1f5450d814d9-config-file\") pod \"limitador-limitador-54d6d988d5-bwvvr\" (UID: \"082a93f9-8f11-4ba4-928c-1f5450d814d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:52.988894 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:52.988872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98485\" (UniqueName: \"kubernetes.io/projected/082a93f9-8f11-4ba4-928c-1f5450d814d9-kube-api-access-98485\") pod \"limitador-limitador-54d6d988d5-bwvvr\" (UID: \"082a93f9-8f11-4ba4-928c-1f5450d814d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:53.165617 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:53.165518    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:53.317818 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:53.317727    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:26:53.327775 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:26:53.327745    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082a93f9_8f11_4ba4_928c_1f5450d814d9.slice/crio-459d3ec3cfa7d91b2a7faf507925c0046b15cbab9fa1dc12fac0325823648a13 WatchSource:0}: Error finding container 459d3ec3cfa7d91b2a7faf507925c0046b15cbab9fa1dc12fac0325823648a13: Status 404 returned error can't find the container with id 459d3ec3cfa7d91b2a7faf507925c0046b15cbab9fa1dc12fac0325823648a13
Jul 27 19:26:53.359744 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:53.359718    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:53.478283 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:53.478255    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:53.957380 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:53.957306    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr" event={"ID":"082a93f9-8f11-4ba4-928c-1f5450d814d9","Type":"ContainerStarted","Data":"459d3ec3cfa7d91b2a7faf507925c0046b15cbab9fa1dc12fac0325823648a13"}
Jul 27 19:26:55.967153 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:55.967126    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr" event={"ID":"082a93f9-8f11-4ba4-928c-1f5450d814d9","Type":"ContainerStarted","Data":"9720186a9bb6df16c11889a96bf6bf9a22b23beec83f61d65b410a9817f7045f"}
Jul 27 19:26:55.967462 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:55.967323    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:26:55.992943 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:26:55.992895    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr" podStartSLOduration=1.433732725 podStartE2EDuration="3.992880409s" totalImagesPullingTime="2.559147684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:55.990233699 +0000 UTC m=+550.729789304" watchObservedRunningTime="2026-07-27 19:26:55.992880409 +0000 UTC m=+550.732436014"
Jul 27 19:27:06.971544 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:06.971493    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"
Jul 27 19:27:12.940511 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:12.940458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:13.036459 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:13.036428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:13.469639 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:13.469611    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:26.080117 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:26.080081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:26.432647 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:26.432616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:33.443555 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:33.443521    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:33.542326 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:33.542264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:33.647723 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:33.647693    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:36.734312 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:36.734277    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:37.908131 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:37.908094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:39.340469 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:27:39.340432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:03.937069 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:03.937037    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:04.027099 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:04.027070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:08.446235 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:08.446152    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:08.555381 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:08.555349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:09.020322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:09.020286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:09.220670 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:09.220628    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:09.865887 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:09.865856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:09.972276 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:09.972244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:10.290443 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:10.290411    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:28:21.106220 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:21.106188    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:21.206320 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:21.206279    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:27.276193 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:27.276158    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:28:29.067996 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:29.067962    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:50.113319 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.113288    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"]
Jul 27 19:28:50.116355 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.116340    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.118731 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.118708    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:28:50.119546 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.119521    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zs4xt\""
Jul 27 19:28:50.119651 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.119591    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:28:50.119854 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.119839    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 19:28:50.124843 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.124826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.124913 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.124854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.124913 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.124871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29g89\" (UniqueName: \"kubernetes.io/projected/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-kube-api-access-29g89\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.124913 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.124889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.125041 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.124962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.125041 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.125021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.134846 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.134824    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"]
Jul 27 19:28:50.226301 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.226447 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226302    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29g89\" (UniqueName: \"kubernetes.io/projected/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-kube-api-access-29g89\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.226447 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.226447 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226409    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.226447 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.226855 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.226855 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226729    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.226855 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226838    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.227023 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.226837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.228906 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.228885    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.229184 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.229164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.238862 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.238842    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29g89\" (UniqueName: \"kubernetes.io/projected/3b63fec5-3537-4b78-a22e-1d93ec43f4b5-kube-api-access-29g89\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r8rcg\" (UID: \"3b63fec5-3537-4b78-a22e-1d93ec43f4b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.257708 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.257685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:50.426572 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.426484    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:28:50.551214 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.551191    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"]
Jul 27 19:28:50.553465 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:28:50.553440    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b63fec5_3537_4b78_a22e_1d93ec43f4b5.slice/crio-bab37ea3f1d15413d91d02fa6c25edf9b4233d94e709a1c5cbb09ac3067b64be WatchSource:0}: Error finding container bab37ea3f1d15413d91d02fa6c25edf9b4233d94e709a1c5cbb09ac3067b64be: Status 404 returned error can't find the container with id bab37ea3f1d15413d91d02fa6c25edf9b4233d94e709a1c5cbb09ac3067b64be
Jul 27 19:28:50.554788 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:50.554772    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:28:51.378284 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:51.378252    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:28:51.400072 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:51.400034    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg" event={"ID":"3b63fec5-3537-4b78-a22e-1d93ec43f4b5","Type":"ContainerStarted","Data":"bab37ea3f1d15413d91d02fa6c25edf9b4233d94e709a1c5cbb09ac3067b64be"}
Jul 27 19:28:52.405445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:52.405408    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg" event={"ID":"3b63fec5-3537-4b78-a22e-1d93ec43f4b5","Type":"ContainerStarted","Data":"c435e3f605ae911ec232f6bc5e6132fe647eceaa4bfd6e8c891abcc49b2203c7"}
Jul 27 19:28:52.422408 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:52.422365    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg" podStartSLOduration=1.373556551 podStartE2EDuration="2.422350802s" totalImagesPullingTime="1.048794251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:52.420829924 +0000 UTC m=+667.160385523" watchObservedRunningTime="2026-07-27 19:28:52.422350802 +0000 UTC m=+667.161906385"
Jul 27 19:28:54.619840 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:54.619801    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:56.176602 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:28:56.176569    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:29:00.427219 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:00.427188    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:29:00.427701 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:00.427280    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:29:00.439446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:00.439417    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:29:00.450464 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:00.450445    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r8rcg"
Jul 27 19:29:26.929659 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:26.929621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:28.672667 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:28.672636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:29:33.268644 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:33.268597    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:33.369241 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:33.369214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:42.569598 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.569567    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"]
Jul 27 19:29:42.572717 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.572702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.575192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.575170    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 27 19:29:42.584007 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.583988    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"]
Jul 27 19:29:42.635090 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.635061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:42.664961 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.664929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkblp\" (UniqueName: \"kubernetes.io/projected/f8e28eb5-650e-476e-b6ab-0630547ffe19-kube-api-access-xkblp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.665118 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.664973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e28eb5-650e-476e-b6ab-0630547ffe19-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.665118 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.665010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.665118 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.665048    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.665118 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.665066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.665271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.665122    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.766348 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.766519 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766369    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkblp\" (UniqueName: \"kubernetes.io/projected/f8e28eb5-650e-476e-b6ab-0630547ffe19-kube-api-access-xkblp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.766519 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e28eb5-650e-476e-b6ab-0630547ffe19-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.766519 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766463    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.766519 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.766671 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766544    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.766922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766900    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.767002 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.767002 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.766969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.768629 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.768608    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e28eb5-650e-476e-b6ab-0630547ffe19-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.768901 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.768885    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e28eb5-650e-476e-b6ab-0630547ffe19-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.775113 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.775090    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkblp\" (UniqueName: \"kubernetes.io/projected/f8e28eb5-650e-476e-b6ab-0630547ffe19-kube-api-access-xkblp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-md2rs\" (UID: \"f8e28eb5-650e-476e-b6ab-0630547ffe19\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:42.882540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:42.882442    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:43.013586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:43.013463    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"]
Jul 27 19:29:43.016349 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:29:43.016322    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e28eb5_650e_476e_b6ab_0630547ffe19.slice/crio-7b838593369c9e68ce388bce6aba82d3a0d9ffc9056e5f82709b60509ef2af7d WatchSource:0}: Error finding container 7b838593369c9e68ce388bce6aba82d3a0d9ffc9056e5f82709b60509ef2af7d: Status 404 returned error can't find the container with id 7b838593369c9e68ce388bce6aba82d3a0d9ffc9056e5f82709b60509ef2af7d
Jul 27 19:29:43.592997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:43.592915    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs" event={"ID":"f8e28eb5-650e-476e-b6ab-0630547ffe19","Type":"ContainerStarted","Data":"2398f794f7a033b4688b13bc1f60d8113e5a8c7b6577d77f07845b09b3aac681"}
Jul 27 19:29:43.592997 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:43.592965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs" event={"ID":"f8e28eb5-650e-476e-b6ab-0630547ffe19","Type":"ContainerStarted","Data":"7b838593369c9e68ce388bce6aba82d3a0d9ffc9056e5f82709b60509ef2af7d"}
Jul 27 19:29:43.612780 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:43.612731    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs" podStartSLOduration=1.344298818 podStartE2EDuration="1.612713486s" totalImagesPullingTime="268.414668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:43.611090961 +0000 UTC m=+718.350646640" watchObservedRunningTime="2026-07-27 19:29:43.612713486 +0000 UTC m=+718.352269090"
Jul 27 19:29:44.675729 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:44.675698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:29:52.883231 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:52.883193    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:52.883657 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:52.883260    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:52.895782 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:52.895760    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:53.410891 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:53.410855    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:53.645259 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:53.645229    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-md2rs"
Jul 27 19:29:56.581029 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:29:56.580990    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:30:39.364795 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:30:39.364757    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:39.466093 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:30:39.466060    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:40.527987 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:30:40.527955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:40.620068 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:30:40.620033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:31:12.474488 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:31:12.474400    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:31:22.679998 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:31:22.679962    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:31:33.082170 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:31:33.082138    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:31:41.944336 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:31:41.944295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:06.290317 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:32:06.290281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:49.123439 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:32:49.123399    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:50.669193 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:32:50.669163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:53.204651 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:32:53.204620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:15.995059 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:15.995023    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:33:25.899036 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:25.898999    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:33:25.977273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:25.977224    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:26.081482 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:26.081444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:26.200697 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:26.200651    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:32.984261 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:32.984220    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:33.106532 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:33.106491    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:33.208061 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:33.208023    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:33.325109 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:33.325035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:39.421700 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:39.421668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:39.503786 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:39.503708    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:43.186069 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:43.186032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:58.788727 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:33:58.788683    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:34:06.676742 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:34:06.676708    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:34:16.481104 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:34:16.481065    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:34:22.281756 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:34:22.281715    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:34:33.007300 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:34:33.007262    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:34:42.789724 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:34:42.789689    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:34:54.070105 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:34:54.070068    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:35:04.469972 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:35:04.469932    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:35:26.473170 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:35:26.473132    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:35:37.575230 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:35:37.575190    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:36:02.979072 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:02.979042    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:36:13.678432 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:13.678399    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:36:28.782972 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:28.782934    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:36:38.485810 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:38.485773    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:36:40.349801 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:40.349773    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:40.433831 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:40.433805    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:48.586930 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:48.586888    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:36:51.210893 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:51.210860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:51.356478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:51.356442    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:58.507319 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:36:58.507278    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:37:07.975931 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:37:07.975853    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:38:14.118114 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:38:14.118077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:38:55.589047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:38:55.589010    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:39:05.781203 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:39:05.781163    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:39:17.877804 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:39:17.877771    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:39:32.403791 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:39:32.403754    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:39:33.471207 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:39:33.471173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:44.736614 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:39:44.736581    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:39:56.007398 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:39:56.007365    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:40:08.216222 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:40:08.216140    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:40:16.723472 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:40:16.723439    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:40:27.274537 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:40:27.274491    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:40:38.485082 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:40:38.485046    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:40:46.973665 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:40:46.973628    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:41:08.173607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:08.173571    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:41:15.996797 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:15.996754    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:41:16.133513 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:16.133465    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:41:23.027115 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:23.027077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:41:29.174742 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:29.174707    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:41:39.288697 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:39.288661    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:41:39.605295 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:39.605218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:41:41.255040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:41.255007    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:41:43.257059 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:43.257028    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:41:46.377017 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:41:46.376984    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:42:01.873115 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:42:01.873083    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:42:10.225442 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:42:10.225406    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:42:22.669756 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:42:22.669722    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:42:32.473971 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:42:32.473938    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:42:41.967308 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:42:41.967271    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:42:49.975799 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:42:49.975765    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:43:01.379947 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:43:01.379916    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:43:12.077929 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:43:12.077859    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:43:28.985655 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:43:28.985611    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:43:42.802779 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:43:42.802740    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:43:55.902389 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:43:55.902352    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:44:07.061146 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:44:07.061112    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:44:15.167078 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:44:15.167042    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:44:23.632764 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:44:23.632730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:44:27.780064 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:44:27.780026    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:44:40.176971 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:44:40.176938    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:44:53.770307 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:44:53.770266    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:44:56.221519 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:44:56.221469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:07.582484 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:07.582444    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:45:17.481569 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:17.481528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:20.432318 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:20.432282    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:20.535408 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:20.535380    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:20.893383 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:20.893300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:20.982201 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:20.982171    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:45:27.245821 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:27.245783    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:27.354482 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:27.354446    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:27.489815 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:27.489778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:27.815091 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:27.815054    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:28.168136 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:28.168041    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:30.474448 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.474413    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"]
Jul 27 19:45:30.477730 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.477711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.480809 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.480783    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-68303af4-serving-cert\""
Jul 27 19:45:30.480934 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.480865    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:45:30.481511 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.481479    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:45:30.481604 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.481536    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:45:30.491085 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.491059    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"]
Jul 27 19:45:30.494447 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.494419    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:30.552002 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.551966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8459de82-67f3-4583-bd6c-b169f4558cb7-maas-api-tls\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.552002 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.551999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8459de82-67f3-4583-bd6c-b169f4558cb7-openshift-service-ca\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.552202 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.552125    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vr64\" (UniqueName: \"kubernetes.io/projected/8459de82-67f3-4583-bd6c-b169f4558cb7-kube-api-access-4vr64\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.592226 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.592193    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:30.653103 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.653067    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8459de82-67f3-4583-bd6c-b169f4558cb7-maas-api-tls\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.653103 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.653109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8459de82-67f3-4583-bd6c-b169f4558cb7-openshift-service-ca\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.653316 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.653294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vr64\" (UniqueName: \"kubernetes.io/projected/8459de82-67f3-4583-bd6c-b169f4558cb7-kube-api-access-4vr64\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.653835 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.653815    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8459de82-67f3-4583-bd6c-b169f4558cb7-openshift-service-ca\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.655465 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.655445    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8459de82-67f3-4583-bd6c-b169f4558cb7-maas-api-tls\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.663101 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.663077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vr64\" (UniqueName: \"kubernetes.io/projected/8459de82-67f3-4583-bd6c-b169f4558cb7-kube-api-access-4vr64\") pod \"maas-api-e2e-ait-68303af4-5588b46db5-q29wz\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.708795 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.708762    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:30.787968 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.787870    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:30.927034 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.926981    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"]
Jul 27 19:45:30.930006 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:45:30.929982    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8459de82_67f3_4583_bd6c_b169f4558cb7.slice/crio-801e9b57149584aaa931150872ec1ec448fa8d53cb77cf293b7a3a834835f3c3 WatchSource:0}: Error finding container 801e9b57149584aaa931150872ec1ec448fa8d53cb77cf293b7a3a834835f3c3: Status 404 returned error can't find the container with id 801e9b57149584aaa931150872ec1ec448fa8d53cb77cf293b7a3a834835f3c3
Jul 27 19:45:30.931643 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:30.931624    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:45:31.073415 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:31.073331    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:31.173480 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:31.173446    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:31.403074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:31.402992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz" event={"ID":"8459de82-67f3-4583-bd6c-b169f4558cb7","Type":"ContainerStarted","Data":"801e9b57149584aaa931150872ec1ec448fa8d53cb77cf293b7a3a834835f3c3"}
Jul 27 19:45:33.413334 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:33.413303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz" event={"ID":"8459de82-67f3-4583-bd6c-b169f4558cb7","Type":"ContainerStarted","Data":"3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e"}
Jul 27 19:45:33.413722 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:33.413406    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:45:33.432169 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:33.432101    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz" podStartSLOduration=1.192950114 podStartE2EDuration="3.432086613s" totalImagesPullingTime="2.239136499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:45:33.430914276 +0000 UTC m=+1668.170469884" watchObservedRunningTime="2026-07-27 19:45:33.432086613 +0000 UTC m=+1668.171642217"
Jul 27 19:45:38.476444 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:38.476410    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:45:39.424623 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:45:39.424594    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:46:06.443321 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.443286    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"]
Jul 27 19:46:06.443906 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.443557    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz" podUID="8459de82-67f3-4583-bd6c-b169f4558cb7" containerName="maas-api" containerID="cri-o://3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e" gracePeriod=30
Jul 27 19:46:06.498742 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.498710    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:06.626090 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.626055    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:06.686374 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.686351    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:46:06.753753 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.753674    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8459de82-67f3-4583-bd6c-b169f4558cb7-maas-api-tls\") pod \"8459de82-67f3-4583-bd6c-b169f4558cb7\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") "
Jul 27 19:46:06.753753 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.753734    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vr64\" (UniqueName: \"kubernetes.io/projected/8459de82-67f3-4583-bd6c-b169f4558cb7-kube-api-access-4vr64\") pod \"8459de82-67f3-4583-bd6c-b169f4558cb7\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") "
Jul 27 19:46:06.753929 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.753758    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8459de82-67f3-4583-bd6c-b169f4558cb7-openshift-service-ca\") pod \"8459de82-67f3-4583-bd6c-b169f4558cb7\" (UID: \"8459de82-67f3-4583-bd6c-b169f4558cb7\") "
Jul 27 19:46:06.754185 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.754156    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8459de82-67f3-4583-bd6c-b169f4558cb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8459de82-67f3-4583-bd6c-b169f4558cb7" (UID: "8459de82-67f3-4583-bd6c-b169f4558cb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:46:06.755922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.755893    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8459de82-67f3-4583-bd6c-b169f4558cb7-kube-api-access-4vr64" (OuterVolumeSpecName: "kube-api-access-4vr64") pod "8459de82-67f3-4583-bd6c-b169f4558cb7" (UID: "8459de82-67f3-4583-bd6c-b169f4558cb7"). InnerVolumeSpecName "kube-api-access-4vr64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:46:06.756010 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.755971    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8459de82-67f3-4583-bd6c-b169f4558cb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8459de82-67f3-4583-bd6c-b169f4558cb7" (UID: "8459de82-67f3-4583-bd6c-b169f4558cb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:46:06.855449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.855384    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8459de82-67f3-4583-bd6c-b169f4558cb7-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:46:06.855449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.855408    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vr64\" (UniqueName: \"kubernetes.io/projected/8459de82-67f3-4583-bd6c-b169f4558cb7-kube-api-access-4vr64\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:46:06.855449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:06.855417    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8459de82-67f3-4583-bd6c-b169f4558cb7-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:46:07.555110 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.555072    2558 generic.go:356] "Generic (PLEG): container finished" podID="8459de82-67f3-4583-bd6c-b169f4558cb7" containerID="3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e" exitCode=0
Jul 27 19:46:07.555544 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.555124    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"
Jul 27 19:46:07.555544 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.555127    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz" event={"ID":"8459de82-67f3-4583-bd6c-b169f4558cb7","Type":"ContainerDied","Data":"3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e"}
Jul 27 19:46:07.555544 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.555179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz" event={"ID":"8459de82-67f3-4583-bd6c-b169f4558cb7","Type":"ContainerDied","Data":"801e9b57149584aaa931150872ec1ec448fa8d53cb77cf293b7a3a834835f3c3"}
Jul 27 19:46:07.555544 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.555210    2558 scope.go:117] "RemoveContainer" containerID="3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e"
Jul 27 19:46:07.564237 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.564219    2558 scope.go:117] "RemoveContainer" containerID="3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e"
Jul 27 19:46:07.564511 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:46:07.564475    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e\": container with ID starting with 3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e not found: ID does not exist" containerID="3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e"
Jul 27 19:46:07.564585 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.564516    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e"} err="failed to get container status \"3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e\": rpc error: code = NotFound desc = could not find container \"3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e\": container with ID starting with 3f03c1ed908ef2f696736df86cdf24898879f386b9ec6b6218511ebff3896b6e not found: ID does not exist"
Jul 27 19:46:07.578143 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.578118    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"]
Jul 27 19:46:07.582528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.582485    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68303af4-5588b46db5-q29wz"]
Jul 27 19:46:07.822886 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:07.822812    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8459de82-67f3-4583-bd6c-b169f4558cb7" path="/var/lib/kubelet/pods/8459de82-67f3-4583-bd6c-b169f4558cb7/volumes"
Jul 27 19:46:09.467683 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:09.467650    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:46:10.999192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:10.999123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:11.189902 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:11.189871    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:11.377206 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:11.377125    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:11.609889 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:11.609856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:11.774362 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:11.774329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:11.890075 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:11.890019    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:12.222358 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:12.222323    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:12.758492 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:12.758454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:14.757719 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.757680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:14.870604 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.870571    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"]
Jul 27 19:46:14.871067 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.871050    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8459de82-67f3-4583-bd6c-b169f4558cb7" containerName="maas-api"
Jul 27 19:46:14.871110 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.871070    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8459de82-67f3-4583-bd6c-b169f4558cb7" containerName="maas-api"
Jul 27 19:46:14.871152 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.871141    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8459de82-67f3-4583-bd6c-b169f4558cb7" containerName="maas-api"
Jul 27 19:46:14.875740 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.875724    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:14.878643 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.878617    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:46:14.878890 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.878874    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a312c841-serving-cert\""
Jul 27 19:46:14.879188 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.879175    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:46:14.879449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.879435    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:46:14.890531 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.890493    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"]
Jul 27 19:46:14.924810 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.924778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:14.924956 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.924813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2pw4\" (UniqueName: \"kubernetes.io/projected/9fe349c3-6c0b-44c1-9216-7fce073ee37b-kube-api-access-k2pw4\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:14.924956 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.924853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fe349c3-6c0b-44c1-9216-7fce073ee37b-openshift-service-ca\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:14.943386 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:14.943356    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:15.025889 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.025801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:15.025889 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.025843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2pw4\" (UniqueName: \"kubernetes.io/projected/9fe349c3-6c0b-44c1-9216-7fce073ee37b-kube-api-access-k2pw4\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:15.026091 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.025895    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fe349c3-6c0b-44c1-9216-7fce073ee37b-openshift-service-ca\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:15.026091 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:46:15.025956    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-serving-cert: secret "maas-api-e2e-migrate-a312c841-serving-cert" not found
Jul 27 19:46:15.026091 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:46:15.026037    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls podName:9fe349c3-6c0b-44c1-9216-7fce073ee37b nodeName:}" failed. No retries permitted until 2026-07-27 19:46:15.526014813 +0000 UTC m=+1710.265570403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls") pod "maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2" (UID: "9fe349c3-6c0b-44c1-9216-7fce073ee37b") : secret "maas-api-e2e-migrate-a312c841-serving-cert" not found
Jul 27 19:46:15.026647 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.026629    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fe349c3-6c0b-44c1-9216-7fce073ee37b-openshift-service-ca\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:15.034320 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.034297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2pw4\" (UniqueName: \"kubernetes.io/projected/9fe349c3-6c0b-44c1-9216-7fce073ee37b-kube-api-access-k2pw4\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:15.125540 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.125486    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:15.530445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.530411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:15.532892 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.532866    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls\") pod \"maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:15.601014 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.600983    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"]
Jul 27 19:46:15.604705 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.604686    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:15.606989 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.606970    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-a312c841-dockercfg-8f89g\""
Jul 27 19:46:15.607283 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.607267    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-a312c841\""
Jul 27 19:46:15.618632 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.618610    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"]
Jul 27 19:46:15.629922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.629895    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:15.731819 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.731788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swx6g\" (UniqueName: \"kubernetes.io/projected/b304a121-e60a-4beb-9da8-9d2f3911a762-kube-api-access-swx6g\") pod \"payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc\" (UID: \"b304a121-e60a-4beb-9da8-9d2f3911a762\") " pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:15.731976 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.731866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b304a121-e60a-4beb-9da8-9d2f3911a762-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc\" (UID: \"b304a121-e60a-4beb-9da8-9d2f3911a762\") " pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:15.746063 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.746031    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:15.785755 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.785688    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:15.833387 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.833244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b304a121-e60a-4beb-9da8-9d2f3911a762-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc\" (UID: \"b304a121-e60a-4beb-9da8-9d2f3911a762\") " pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:15.833387 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.833324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swx6g\" (UniqueName: \"kubernetes.io/projected/b304a121-e60a-4beb-9da8-9d2f3911a762-kube-api-access-swx6g\") pod \"payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc\" (UID: \"b304a121-e60a-4beb-9da8-9d2f3911a762\") " pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:15.834297 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.834203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b304a121-e60a-4beb-9da8-9d2f3911a762-plugins-config-volume\") pod \"payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc\" (UID: \"b304a121-e60a-4beb-9da8-9d2f3911a762\") " pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:15.842913 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.842886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swx6g\" (UniqueName: \"kubernetes.io/projected/b304a121-e60a-4beb-9da8-9d2f3911a762-kube-api-access-swx6g\") pod \"payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc\" (UID: \"b304a121-e60a-4beb-9da8-9d2f3911a762\") " pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:15.914998 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.914964    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:15.917114 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:15.917092    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"]
Jul 27 19:46:15.919529 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:46:15.919493    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe349c3_6c0b_44c1_9216_7fce073ee37b.slice/crio-01c947feb20de2398020c4a254f3bba9caf89fc51d098f90555f56c78d7c90e9 WatchSource:0}: Error finding container 01c947feb20de2398020c4a254f3bba9caf89fc51d098f90555f56c78d7c90e9: Status 404 returned error can't find the container with id 01c947feb20de2398020c4a254f3bba9caf89fc51d098f90555f56c78d7c90e9
Jul 27 19:46:16.042143 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:16.042112    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"]
Jul 27 19:46:16.044435 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:46:16.044404    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb304a121_e60a_4beb_9da8_9d2f3911a762.slice/crio-a22f73b1703d30ac56c5347b073360246d90c965e8aced98134e20a742459a6c WatchSource:0}: Error finding container a22f73b1703d30ac56c5347b073360246d90c965e8aced98134e20a742459a6c: Status 404 returned error can't find the container with id a22f73b1703d30ac56c5347b073360246d90c965e8aced98134e20a742459a6c
Jul 27 19:46:16.595021 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:16.594983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc" event={"ID":"b304a121-e60a-4beb-9da8-9d2f3911a762","Type":"ContainerStarted","Data":"a22f73b1703d30ac56c5347b073360246d90c965e8aced98134e20a742459a6c"}
Jul 27 19:46:16.596541 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:16.596488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2" event={"ID":"9fe349c3-6c0b-44c1-9216-7fce073ee37b","Type":"ContainerStarted","Data":"4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca"}
Jul 27 19:46:16.596668 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:16.596564    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2" event={"ID":"9fe349c3-6c0b-44c1-9216-7fce073ee37b","Type":"ContainerStarted","Data":"01c947feb20de2398020c4a254f3bba9caf89fc51d098f90555f56c78d7c90e9"}
Jul 27 19:46:16.596722 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:16.596667    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:16.615416 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:16.615366    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2" podStartSLOduration=2.098187945 podStartE2EDuration="2.615350317s" totalImagesPullingTime="517.162372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:46:16.613322711 +0000 UTC m=+1711.352878318" watchObservedRunningTime="2026-07-27 19:46:16.615350317 +0000 UTC m=+1711.354905921"
Jul 27 19:46:18.607910 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:18.607822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc" event={"ID":"b304a121-e60a-4beb-9da8-9d2f3911a762","Type":"ContainerStarted","Data":"0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7"}
Jul 27 19:46:18.608245 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:18.607910    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:18.623727 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:18.623680    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc" podStartSLOduration=1.36874108 podStartE2EDuration="3.623664666s" totalImagesPullingTime="2.254923586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:46:18.622843521 +0000 UTC m=+1713.362399128" watchObservedRunningTime="2026-07-27 19:46:18.623664666 +0000 UTC m=+1713.363220271"
Jul 27 19:46:21.273926 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:21.273883    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:46:22.608513 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:22.608467    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:29.614080 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:29.614050    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:50.142202 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.142164    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"]
Jul 27 19:46:50.142720 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.142384    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2" podUID="9fe349c3-6c0b-44c1-9216-7fce073ee37b" containerName="maas-api" containerID="cri-o://4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca" gracePeriod=30
Jul 27 19:46:50.195851 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.195822    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"]
Jul 27 19:46:50.196060 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.196022    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc" podUID="b304a121-e60a-4beb-9da8-9d2f3911a762" containerName="payload-processing" containerID="cri-o://0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7" gracePeriod=30
Jul 27 19:46:50.208908 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.208873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:50.435691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.435667    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:50.472976 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.472955    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:50.517710 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.517675    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:50.518720 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.518698    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swx6g\" (UniqueName: \"kubernetes.io/projected/b304a121-e60a-4beb-9da8-9d2f3911a762-kube-api-access-swx6g\") pod \"b304a121-e60a-4beb-9da8-9d2f3911a762\" (UID: \"b304a121-e60a-4beb-9da8-9d2f3911a762\") "
Jul 27 19:46:50.518823 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.518755    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2pw4\" (UniqueName: \"kubernetes.io/projected/9fe349c3-6c0b-44c1-9216-7fce073ee37b-kube-api-access-k2pw4\") pod \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") "
Jul 27 19:46:50.518823 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.518799    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fe349c3-6c0b-44c1-9216-7fce073ee37b-openshift-service-ca\") pod \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") "
Jul 27 19:46:50.518924 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.518838    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b304a121-e60a-4beb-9da8-9d2f3911a762-plugins-config-volume\") pod \"b304a121-e60a-4beb-9da8-9d2f3911a762\" (UID: \"b304a121-e60a-4beb-9da8-9d2f3911a762\") "
Jul 27 19:46:50.518924 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.518877    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls\") pod \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\" (UID: \"9fe349c3-6c0b-44c1-9216-7fce073ee37b\") "
Jul 27 19:46:50.519245 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.519203    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fe349c3-6c0b-44c1-9216-7fce073ee37b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fe349c3-6c0b-44c1-9216-7fce073ee37b" (UID: "9fe349c3-6c0b-44c1-9216-7fce073ee37b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:46:50.519245 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.519216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b304a121-e60a-4beb-9da8-9d2f3911a762-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b304a121-e60a-4beb-9da8-9d2f3911a762" (UID: "b304a121-e60a-4beb-9da8-9d2f3911a762"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:46:50.521052 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.521021    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fe349c3-6c0b-44c1-9216-7fce073ee37b" (UID: "9fe349c3-6c0b-44c1-9216-7fce073ee37b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:46:50.521443 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.521413    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b304a121-e60a-4beb-9da8-9d2f3911a762-kube-api-access-swx6g" (OuterVolumeSpecName: "kube-api-access-swx6g") pod "b304a121-e60a-4beb-9da8-9d2f3911a762" (UID: "b304a121-e60a-4beb-9da8-9d2f3911a762"). InnerVolumeSpecName "kube-api-access-swx6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:46:50.521554 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.521444    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fe349c3-6c0b-44c1-9216-7fce073ee37b-kube-api-access-k2pw4" (OuterVolumeSpecName: "kube-api-access-k2pw4") pod "9fe349c3-6c0b-44c1-9216-7fce073ee37b" (UID: "9fe349c3-6c0b-44c1-9216-7fce073ee37b"). InnerVolumeSpecName "kube-api-access-k2pw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:46:50.620296 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.620264    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b304a121-e60a-4beb-9da8-9d2f3911a762-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:46:50.620296 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.620291    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fe349c3-6c0b-44c1-9216-7fce073ee37b-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:46:50.620296 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.620300    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swx6g\" (UniqueName: \"kubernetes.io/projected/b304a121-e60a-4beb-9da8-9d2f3911a762-kube-api-access-swx6g\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:46:50.620544 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.620309    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2pw4\" (UniqueName: \"kubernetes.io/projected/9fe349c3-6c0b-44c1-9216-7fce073ee37b-kube-api-access-k2pw4\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:46:50.620544 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.620317    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fe349c3-6c0b-44c1-9216-7fce073ee37b-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:46:50.747881 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.747847    2558 generic.go:356] "Generic (PLEG): container finished" podID="9fe349c3-6c0b-44c1-9216-7fce073ee37b" containerID="4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca" exitCode=0
Jul 27 19:46:50.748047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.747892    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"
Jul 27 19:46:50.748047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.747934    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2" event={"ID":"9fe349c3-6c0b-44c1-9216-7fce073ee37b","Type":"ContainerDied","Data":"4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca"}
Jul 27 19:46:50.748047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.747987    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2" event={"ID":"9fe349c3-6c0b-44c1-9216-7fce073ee37b","Type":"ContainerDied","Data":"01c947feb20de2398020c4a254f3bba9caf89fc51d098f90555f56c78d7c90e9"}
Jul 27 19:46:50.748047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.748015    2558 scope.go:117] "RemoveContainer" containerID="4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca"
Jul 27 19:46:50.749229 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.749206    2558 generic.go:356] "Generic (PLEG): container finished" podID="b304a121-e60a-4beb-9da8-9d2f3911a762" containerID="0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7" exitCode=0
Jul 27 19:46:50.749342 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.749250    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"
Jul 27 19:46:50.749342 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.749275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc" event={"ID":"b304a121-e60a-4beb-9da8-9d2f3911a762","Type":"ContainerDied","Data":"0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7"}
Jul 27 19:46:50.749342 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.749311    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc" event={"ID":"b304a121-e60a-4beb-9da8-9d2f3911a762","Type":"ContainerDied","Data":"a22f73b1703d30ac56c5347b073360246d90c965e8aced98134e20a742459a6c"}
Jul 27 19:46:50.756800 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.756753    2558 scope.go:117] "RemoveContainer" containerID="4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca"
Jul 27 19:46:50.757098 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:46:50.757076    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca\": container with ID starting with 4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca not found: ID does not exist" containerID="4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca"
Jul 27 19:46:50.757176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.757104    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca"} err="failed to get container status \"4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca\": rpc error: code = NotFound desc = could not find container \"4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca\": container with ID starting with 4df3aa46fb447cc401ee5cc15e75d975663a22baa720e4ca777db06cdc8dbaca not found: ID does not exist"
Jul 27 19:46:50.757176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.757121    2558 scope.go:117] "RemoveContainer" containerID="0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7"
Jul 27 19:46:50.764547 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.764532    2558 scope.go:117] "RemoveContainer" containerID="0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7"
Jul 27 19:46:50.764788 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:46:50.764768    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7\": container with ID starting with 0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7 not found: ID does not exist" containerID="0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7"
Jul 27 19:46:50.764837 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.764795    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7"} err="failed to get container status \"0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7\": rpc error: code = NotFound desc = could not find container \"0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7\": container with ID starting with 0e264abdb33666273f6167175b318b29eff0d73f23e02b54804a06952568c3a7 not found: ID does not exist"
Jul 27 19:46:50.775022 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.775001    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"]
Jul 27 19:46:50.784107 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.784087    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a312c841-b4678f58b-r4tp2"]
Jul 27 19:46:50.797909 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.797890    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"]
Jul 27 19:46:50.802408 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:50.802381    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc"]
Jul 27 19:46:51.822106 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:51.822071    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fe349c3-6c0b-44c1-9216-7fce073ee37b" path="/var/lib/kubelet/pods/9fe349c3-6c0b-44c1-9216-7fce073ee37b/volumes"
Jul 27 19:46:51.822471 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:51.822405    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b304a121-e60a-4beb-9da8-9d2f3911a762" path="/var/lib/kubelet/pods/b304a121-e60a-4beb-9da8-9d2f3911a762/volumes"
Jul 27 19:46:53.073207 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:53.073170    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:46:54.861548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:54.861520    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:55.042990 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:55.042950    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:55.213151 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:55.213118    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:55.424078 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:55.424048    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:55.717244 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:55.717211    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:55.939391 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:55.939361    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:58.040705 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.040676    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"]
Jul 27 19:46:58.041074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.040971    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fe349c3-6c0b-44c1-9216-7fce073ee37b" containerName="maas-api"
Jul 27 19:46:58.041074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.040982    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fe349c3-6c0b-44c1-9216-7fce073ee37b" containerName="maas-api"
Jul 27 19:46:58.041074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.040998    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b304a121-e60a-4beb-9da8-9d2f3911a762" containerName="payload-processing"
Jul 27 19:46:58.041074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.041004    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b304a121-e60a-4beb-9da8-9d2f3911a762" containerName="payload-processing"
Jul 27 19:46:58.041074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.041072    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b304a121-e60a-4beb-9da8-9d2f3911a762" containerName="payload-processing"
Jul 27 19:46:58.041272 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.041084    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fe349c3-6c0b-44c1-9216-7fce073ee37b" containerName="maas-api"
Jul 27 19:46:58.044040 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.044023    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.046708 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.046688    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0b0189d4-serving-cert\""
Jul 27 19:46:58.046826 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.046795    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:46:58.047318 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.047299    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:46:58.047671 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.047658    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:46:58.055491 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.055471    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"]
Jul 27 19:46:58.076842 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.076818    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:58.082475 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.082453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c4f4b5-e2b1-4c23-8636-cb7142827087-openshift-service-ca\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.082583 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.082481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.082583 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.082552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgrq9\" (UniqueName: \"kubernetes.io/projected/34c4f4b5-e2b1-4c23-8636-cb7142827087-kube-api-access-kgrq9\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.183600 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.183563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.183762 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.183617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgrq9\" (UniqueName: \"kubernetes.io/projected/34c4f4b5-e2b1-4c23-8636-cb7142827087-kube-api-access-kgrq9\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.183762 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.183684    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c4f4b5-e2b1-4c23-8636-cb7142827087-openshift-service-ca\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.183762 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:46:58.183708    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-serving-cert: secret "maas-api-e2e-ait-0b0189d4-serving-cert" not found
Jul 27 19:46:58.183866 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:46:58.183784    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls podName:34c4f4b5-e2b1-4c23-8636-cb7142827087 nodeName:}" failed. No retries permitted until 2026-07-27 19:46:58.68376731 +0000 UTC m=+1753.423322892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls") pod "maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw" (UID: "34c4f4b5-e2b1-4c23-8636-cb7142827087") : secret "maas-api-e2e-ait-0b0189d4-serving-cert" not found
Jul 27 19:46:58.184258 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.184242    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c4f4b5-e2b1-4c23-8636-cb7142827087-openshift-service-ca\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.195573 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.195552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgrq9\" (UniqueName: \"kubernetes.io/projected/34c4f4b5-e2b1-4c23-8636-cb7142827087-kube-api-access-kgrq9\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.396936 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.396847    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:58.627769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.627730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:58.687452 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.687417    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.689762 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.689740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls\") pod \"maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:58.755718 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.755684    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"]
Jul 27 19:46:58.758110 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.758093    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:58.760489 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.760468    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0b0189d4\""
Jul 27 19:46:58.760489 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.760481    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0b0189d4-dockercfg-7tncq\""
Jul 27 19:46:58.764807 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.764778    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"]
Jul 27 19:46:58.767469 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.767452    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:58.770512 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.770484    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"]
Jul 27 19:46:58.779626 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.779604    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"]
Jul 27 19:46:58.787968 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.787936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7q8r\" (UniqueName: \"kubernetes.io/projected/e350b52f-72d4-494a-af7f-be494df1081f-kube-api-access-d7q8r\") pod \"payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j\" (UID: \"e350b52f-72d4-494a-af7f-be494df1081f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:58.788088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.788012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35fd996f-3c05-44c1-8d9d-072616280392-plugins-config-volume\") pod \"payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm\" (UID: \"35fd996f-3c05-44c1-8d9d-072616280392\") " pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:58.788088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.788045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5x75\" (UniqueName: \"kubernetes.io/projected/35fd996f-3c05-44c1-8d9d-072616280392-kube-api-access-q5x75\") pod \"payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm\" (UID: \"35fd996f-3c05-44c1-8d9d-072616280392\") " pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:58.788088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.788075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e350b52f-72d4-494a-af7f-be494df1081f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j\" (UID: \"e350b52f-72d4-494a-af7f-be494df1081f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:58.820953 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.820922    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:58.888966 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.888928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7q8r\" (UniqueName: \"kubernetes.io/projected/e350b52f-72d4-494a-af7f-be494df1081f-kube-api-access-d7q8r\") pod \"payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j\" (UID: \"e350b52f-72d4-494a-af7f-be494df1081f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:58.889162 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.889097    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35fd996f-3c05-44c1-8d9d-072616280392-plugins-config-volume\") pod \"payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm\" (UID: \"35fd996f-3c05-44c1-8d9d-072616280392\") " pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:58.889162 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.889128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5x75\" (UniqueName: \"kubernetes.io/projected/35fd996f-3c05-44c1-8d9d-072616280392-kube-api-access-q5x75\") pod \"payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm\" (UID: \"35fd996f-3c05-44c1-8d9d-072616280392\") " pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:58.889785 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.889751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e350b52f-72d4-494a-af7f-be494df1081f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j\" (UID: \"e350b52f-72d4-494a-af7f-be494df1081f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:58.894608 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.890878    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e350b52f-72d4-494a-af7f-be494df1081f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j\" (UID: \"e350b52f-72d4-494a-af7f-be494df1081f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:58.894608 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.891008    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35fd996f-3c05-44c1-8d9d-072616280392-plugins-config-volume\") pod \"payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm\" (UID: \"35fd996f-3c05-44c1-8d9d-072616280392\") " pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:58.898842 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.898814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7q8r\" (UniqueName: \"kubernetes.io/projected/e350b52f-72d4-494a-af7f-be494df1081f-kube-api-access-d7q8r\") pod \"payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j\" (UID: \"e350b52f-72d4-494a-af7f-be494df1081f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:58.898842 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.898819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5x75\" (UniqueName: \"kubernetes.io/projected/35fd996f-3c05-44c1-8d9d-072616280392-kube-api-access-q5x75\") pod \"payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm\" (UID: \"35fd996f-3c05-44c1-8d9d-072616280392\") " pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:58.954680 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:58.954579    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:46:59.070943 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.070908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:59.081284 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.081244    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"]
Jul 27 19:46:59.081385 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.081318    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:59.082924 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:46:59.082894    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c4f4b5_e2b1_4c23_8636_cb7142827087.slice/crio-53a5ff39659816a2308c1b3e10259bdfa3ad595f31505d4c28deb59c42cde5d7 WatchSource:0}: Error finding container 53a5ff39659816a2308c1b3e10259bdfa3ad595f31505d4c28deb59c42cde5d7: Status 404 returned error can't find the container with id 53a5ff39659816a2308c1b3e10259bdfa3ad595f31505d4c28deb59c42cde5d7
Jul 27 19:46:59.149459 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.149418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:46:59.212139 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.210909    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"]
Jul 27 19:46:59.239955 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.239931    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"]
Jul 27 19:46:59.242418 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:46:59.242391    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35fd996f_3c05_44c1_8d9d_072616280392.slice/crio-066545ab3c178b96dee2118f07e0b7a7fbc0e2dd29162c74e56ee24a122ec597 WatchSource:0}: Error finding container 066545ab3c178b96dee2118f07e0b7a7fbc0e2dd29162c74e56ee24a122ec597: Status 404 returned error can't find the container with id 066545ab3c178b96dee2118f07e0b7a7fbc0e2dd29162c74e56ee24a122ec597
Jul 27 19:46:59.790408 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.790371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j" event={"ID":"e350b52f-72d4-494a-af7f-be494df1081f","Type":"ContainerStarted","Data":"f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040"}
Jul 27 19:46:59.790539 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.790432    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j" event={"ID":"e350b52f-72d4-494a-af7f-be494df1081f","Type":"ContainerStarted","Data":"67c63d6cb6ab3b52742247b8462a69411d6577d2ecad6d0f4da1e16b5de64fb1"}
Jul 27 19:46:59.790539 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.790477    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:46:59.791874 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.791842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm" event={"ID":"35fd996f-3c05-44c1-8d9d-072616280392","Type":"ContainerStarted","Data":"4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348"}
Jul 27 19:46:59.791952 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.791888    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm" event={"ID":"35fd996f-3c05-44c1-8d9d-072616280392","Type":"ContainerStarted","Data":"066545ab3c178b96dee2118f07e0b7a7fbc0e2dd29162c74e56ee24a122ec597"}
Jul 27 19:46:59.791952 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.791944    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:46:59.792993 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.792973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw" event={"ID":"34c4f4b5-e2b1-4c23-8636-cb7142827087","Type":"ContainerStarted","Data":"53a5ff39659816a2308c1b3e10259bdfa3ad595f31505d4c28deb59c42cde5d7"}
Jul 27 19:46:59.808396 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.808349    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j" podStartSLOduration=1.808333498 podStartE2EDuration="1.808333498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:46:59.807582225 +0000 UTC m=+1754.547137829" watchObservedRunningTime="2026-07-27 19:46:59.808333498 +0000 UTC m=+1754.547889097"
Jul 27 19:46:59.825281 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:46:59.825228    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm" podStartSLOduration=1.825210141 podStartE2EDuration="1.825210141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:46:59.824819303 +0000 UTC m=+1754.564374910" watchObservedRunningTime="2026-07-27 19:46:59.825210141 +0000 UTC m=+1754.564765747"
Jul 27 19:47:00.799209 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:00.799166    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw" event={"ID":"34c4f4b5-e2b1-4c23-8636-cb7142827087","Type":"ContainerStarted","Data":"cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff"}
Jul 27 19:47:00.825315 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:00.825264    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw" podStartSLOduration=2.153916085 podStartE2EDuration="2.825250509s" totalImagesPullingTime="671.334424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:47:00.82368737 +0000 UTC m=+1755.563242976" watchObservedRunningTime="2026-07-27 19:47:00.825250509 +0000 UTC m=+1755.564806114"
Jul 27 19:47:01.804180 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:01.804153    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:47:04.772403 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:04.772366    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:47:07.814650 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:07.814619    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:47:10.801397 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:10.801366    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:47:10.801853 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:10.801447    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:47:33.674102 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:33.674063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:33.975014 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:33.974959    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:34.396955 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.396874    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"]
Jul 27 19:47:34.397142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.397117    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw" podUID="34c4f4b5-e2b1-4c23-8636-cb7142827087" containerName="maas-api" containerID="cri-o://cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff" gracePeriod=30
Jul 27 19:47:34.447169 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.447139    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"]
Jul 27 19:47:34.447382 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.447357    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm" podUID="35fd996f-3c05-44c1-8d9d-072616280392" containerName="payload-processing" containerID="cri-o://4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348" gracePeriod=30
Jul 27 19:47:34.455263 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.455229    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"]
Jul 27 19:47:34.455470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.455447    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j" podUID="e350b52f-72d4-494a-af7f-be494df1081f" containerName="payload-pre-processing" containerID="cri-o://f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040" gracePeriod=30
Jul 27 19:47:34.482019 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.481982    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:34.672311 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.672280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:34.707384 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.707360    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:47:34.739113 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.739088    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:47:34.748134 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.748110    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:47:34.794483 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.794441    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5x75\" (UniqueName: \"kubernetes.io/projected/35fd996f-3c05-44c1-8d9d-072616280392-kube-api-access-q5x75\") pod \"35fd996f-3c05-44c1-8d9d-072616280392\" (UID: \"35fd996f-3c05-44c1-8d9d-072616280392\") "
Jul 27 19:47:34.794483 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.794482    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35fd996f-3c05-44c1-8d9d-072616280392-plugins-config-volume\") pod \"35fd996f-3c05-44c1-8d9d-072616280392\" (UID: \"35fd996f-3c05-44c1-8d9d-072616280392\") "
Jul 27 19:47:34.794917 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.794889    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35fd996f-3c05-44c1-8d9d-072616280392-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "35fd996f-3c05-44c1-8d9d-072616280392" (UID: "35fd996f-3c05-44c1-8d9d-072616280392"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:47:34.796590 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.796557    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35fd996f-3c05-44c1-8d9d-072616280392-kube-api-access-q5x75" (OuterVolumeSpecName: "kube-api-access-q5x75") pod "35fd996f-3c05-44c1-8d9d-072616280392" (UID: "35fd996f-3c05-44c1-8d9d-072616280392"). InnerVolumeSpecName "kube-api-access-q5x75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:47:34.895704 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.895671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e350b52f-72d4-494a-af7f-be494df1081f-plugins-config-volume\") pod \"e350b52f-72d4-494a-af7f-be494df1081f\" (UID: \"e350b52f-72d4-494a-af7f-be494df1081f\") "
Jul 27 19:47:34.895704 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.895710    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls\") pod \"34c4f4b5-e2b1-4c23-8636-cb7142827087\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") "
Jul 27 19:47:34.895950 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.895754    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7q8r\" (UniqueName: \"kubernetes.io/projected/e350b52f-72d4-494a-af7f-be494df1081f-kube-api-access-d7q8r\") pod \"e350b52f-72d4-494a-af7f-be494df1081f\" (UID: \"e350b52f-72d4-494a-af7f-be494df1081f\") "
Jul 27 19:47:34.895950 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.895781    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c4f4b5-e2b1-4c23-8636-cb7142827087-openshift-service-ca\") pod \"34c4f4b5-e2b1-4c23-8636-cb7142827087\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") "
Jul 27 19:47:34.895950 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.895823    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgrq9\" (UniqueName: \"kubernetes.io/projected/34c4f4b5-e2b1-4c23-8636-cb7142827087-kube-api-access-kgrq9\") pod \"34c4f4b5-e2b1-4c23-8636-cb7142827087\" (UID: \"34c4f4b5-e2b1-4c23-8636-cb7142827087\") "
Jul 27 19:47:34.896113 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.896067    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5x75\" (UniqueName: \"kubernetes.io/projected/35fd996f-3c05-44c1-8d9d-072616280392-kube-api-access-q5x75\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:47:34.896113 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.896087    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35fd996f-3c05-44c1-8d9d-072616280392-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:47:34.896205 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.896108    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c4f4b5-e2b1-4c23-8636-cb7142827087-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34c4f4b5-e2b1-4c23-8636-cb7142827087" (UID: "34c4f4b5-e2b1-4c23-8636-cb7142827087"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:47:34.896205 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.896150    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e350b52f-72d4-494a-af7f-be494df1081f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e350b52f-72d4-494a-af7f-be494df1081f" (UID: "e350b52f-72d4-494a-af7f-be494df1081f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:47:34.897946 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.897922    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34c4f4b5-e2b1-4c23-8636-cb7142827087" (UID: "34c4f4b5-e2b1-4c23-8636-cb7142827087"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:47:34.898028 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.897940    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c4f4b5-e2b1-4c23-8636-cb7142827087-kube-api-access-kgrq9" (OuterVolumeSpecName: "kube-api-access-kgrq9") pod "34c4f4b5-e2b1-4c23-8636-cb7142827087" (UID: "34c4f4b5-e2b1-4c23-8636-cb7142827087"). InnerVolumeSpecName "kube-api-access-kgrq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:47:34.898028 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.897989    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e350b52f-72d4-494a-af7f-be494df1081f-kube-api-access-d7q8r" (OuterVolumeSpecName: "kube-api-access-d7q8r") pod "e350b52f-72d4-494a-af7f-be494df1081f" (UID: "e350b52f-72d4-494a-af7f-be494df1081f"). InnerVolumeSpecName "kube-api-access-d7q8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:47:34.945796 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.945767    2558 generic.go:356] "Generic (PLEG): container finished" podID="e350b52f-72d4-494a-af7f-be494df1081f" containerID="f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040" exitCode=0
Jul 27 19:47:34.945952 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.945814    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"
Jul 27 19:47:34.945952 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.945856    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j" event={"ID":"e350b52f-72d4-494a-af7f-be494df1081f","Type":"ContainerDied","Data":"f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040"}
Jul 27 19:47:34.945952 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.945920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j" event={"ID":"e350b52f-72d4-494a-af7f-be494df1081f","Type":"ContainerDied","Data":"67c63d6cb6ab3b52742247b8462a69411d6577d2ecad6d0f4da1e16b5de64fb1"}
Jul 27 19:47:34.946091 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.945954    2558 scope.go:117] "RemoveContainer" containerID="f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040"
Jul 27 19:47:34.947166 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.947139    2558 generic.go:356] "Generic (PLEG): container finished" podID="35fd996f-3c05-44c1-8d9d-072616280392" containerID="4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348" exitCode=0
Jul 27 19:47:34.947279 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.947180    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"
Jul 27 19:47:34.947279 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.947227    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm" event={"ID":"35fd996f-3c05-44c1-8d9d-072616280392","Type":"ContainerDied","Data":"4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348"}
Jul 27 19:47:34.947390 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.947281    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm" event={"ID":"35fd996f-3c05-44c1-8d9d-072616280392","Type":"ContainerDied","Data":"066545ab3c178b96dee2118f07e0b7a7fbc0e2dd29162c74e56ee24a122ec597"}
Jul 27 19:47:34.948601 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.948584    2558 generic.go:356] "Generic (PLEG): container finished" podID="34c4f4b5-e2b1-4c23-8636-cb7142827087" containerID="cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff" exitCode=0
Jul 27 19:47:34.948711 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.948612    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw" event={"ID":"34c4f4b5-e2b1-4c23-8636-cb7142827087","Type":"ContainerDied","Data":"cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff"}
Jul 27 19:47:34.948711 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.948632    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"
Jul 27 19:47:34.948711 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.948678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw" event={"ID":"34c4f4b5-e2b1-4c23-8636-cb7142827087","Type":"ContainerDied","Data":"53a5ff39659816a2308c1b3e10259bdfa3ad595f31505d4c28deb59c42cde5d7"}
Jul 27 19:47:34.954362 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.954343    2558 scope.go:117] "RemoveContainer" containerID="f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040"
Jul 27 19:47:34.954726 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:47:34.954698    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040\": container with ID starting with f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040 not found: ID does not exist" containerID="f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040"
Jul 27 19:47:34.954816 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.954737    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040"} err="failed to get container status \"f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040\": rpc error: code = NotFound desc = could not find container \"f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040\": container with ID starting with f704998b7c8d00b82d5a821dbaa6def07a27ad39422a1a3985ac0370858dc040 not found: ID does not exist"
Jul 27 19:47:34.954816 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.954756    2558 scope.go:117] "RemoveContainer" containerID="4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348"
Jul 27 19:47:34.963535 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.963516    2558 scope.go:117] "RemoveContainer" containerID="4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348"
Jul 27 19:47:34.963784 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:47:34.963765    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348\": container with ID starting with 4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348 not found: ID does not exist" containerID="4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348"
Jul 27 19:47:34.963859 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.963795    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348"} err="failed to get container status \"4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348\": rpc error: code = NotFound desc = could not find container \"4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348\": container with ID starting with 4981bf049c0ced2bb0e7281805bc60fd73f6393cd5a0cdf56c8a2531eb463348 not found: ID does not exist"
Jul 27 19:47:34.963859 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.963820    2558 scope.go:117] "RemoveContainer" containerID="cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff"
Jul 27 19:47:34.967428 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.967408    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"]
Jul 27 19:47:34.971956 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.971933    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j"]
Jul 27 19:47:34.972369 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.972354    2558 scope.go:117] "RemoveContainer" containerID="cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff"
Jul 27 19:47:34.972718 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:47:34.972700    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff\": container with ID starting with cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff not found: ID does not exist" containerID="cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff"
Jul 27 19:47:34.972782 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.972726    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff"} err="failed to get container status \"cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff\": rpc error: code = NotFound desc = could not find container \"cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff\": container with ID starting with cacede15958494f270602ba33128ca3bcff9437d1a4994257526b0a2f31711ff not found: ID does not exist"
Jul 27 19:47:34.980520 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.980486    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"]
Jul 27 19:47:34.983569 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.983550    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm"]
Jul 27 19:47:34.992900 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.992874    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"]
Jul 27 19:47:34.996661 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.996635    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgrq9\" (UniqueName: \"kubernetes.io/projected/34c4f4b5-e2b1-4c23-8636-cb7142827087-kube-api-access-kgrq9\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:47:34.996791 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.996670    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e350b52f-72d4-494a-af7f-be494df1081f-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:47:34.996791 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.996686    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c4f4b5-e2b1-4c23-8636-cb7142827087-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:47:34.996791 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.996700    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7q8r\" (UniqueName: \"kubernetes.io/projected/e350b52f-72d4-494a-af7f-be494df1081f-kube-api-access-d7q8r\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:47:34.996791 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.996713    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c4f4b5-e2b1-4c23-8636-cb7142827087-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:47:34.997953 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:34.997932    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b0189d4-65984f96cb-xhrrw"]
Jul 27 19:47:35.822290 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:35.822259    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c4f4b5-e2b1-4c23-8636-cb7142827087" path="/var/lib/kubelet/pods/34c4f4b5-e2b1-4c23-8636-cb7142827087/volumes"
Jul 27 19:47:35.822665 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:35.822613    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35fd996f-3c05-44c1-8d9d-072616280392" path="/var/lib/kubelet/pods/35fd996f-3c05-44c1-8d9d-072616280392/volumes"
Jul 27 19:47:35.822922 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:35.822909    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e350b52f-72d4-494a-af7f-be494df1081f" path="/var/lib/kubelet/pods/e350b52f-72d4-494a-af7f-be494df1081f/volumes"
Jul 27 19:47:38.024273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:38.024239    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:47:38.584762 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:38.584724    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:38.991493 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:38.991463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:40.200401 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:40.200371    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:40.376874 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:40.376840    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:40.661451 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:40.661382    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:41.091711 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:41.091677    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:41.283249 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:41.283212    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:43.691918 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:43.691880    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:43.902836 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:43.902774    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:44.107092 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107016    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"]
Jul 27 19:47:44.107353 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107340    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35fd996f-3c05-44c1-8d9d-072616280392" containerName="payload-processing"
Jul 27 19:47:44.107400 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107354    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="35fd996f-3c05-44c1-8d9d-072616280392" containerName="payload-processing"
Jul 27 19:47:44.107400 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107364    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e350b52f-72d4-494a-af7f-be494df1081f" containerName="payload-pre-processing"
Jul 27 19:47:44.107400 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107370    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e350b52f-72d4-494a-af7f-be494df1081f" containerName="payload-pre-processing"
Jul 27 19:47:44.107400 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107376    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c4f4b5-e2b1-4c23-8636-cb7142827087" containerName="maas-api"
Jul 27 19:47:44.107400 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107382    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c4f4b5-e2b1-4c23-8636-cb7142827087" containerName="maas-api"
Jul 27 19:47:44.107574 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107434    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="35fd996f-3c05-44c1-8d9d-072616280392" containerName="payload-processing"
Jul 27 19:47:44.107574 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107442    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c4f4b5-e2b1-4c23-8636-cb7142827087" containerName="maas-api"
Jul 27 19:47:44.107574 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.107451    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e350b52f-72d4-494a-af7f-be494df1081f" containerName="payload-pre-processing"
Jul 27 19:47:44.110251 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.110233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.112960 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.112938    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-67e1471d-serving-cert\""
Jul 27 19:47:44.113095 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.112975    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:47:44.113622 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.113606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:47:44.113720 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.113633    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:47:44.177442 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.177408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9231d491-9458-4200-b1b0-499d6b0877fa-openshift-service-ca\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.177442 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.177445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9231d491-9458-4200-b1b0-499d6b0877fa-maas-api-tls\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.177663 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.177518    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hhcc\" (UniqueName: \"kubernetes.io/projected/9231d491-9458-4200-b1b0-499d6b0877fa-kube-api-access-7hhcc\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.184030 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.183991    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"]
Jul 27 19:47:44.277995 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.277964    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hhcc\" (UniqueName: \"kubernetes.io/projected/9231d491-9458-4200-b1b0-499d6b0877fa-kube-api-access-7hhcc\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.278176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.278021    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9231d491-9458-4200-b1b0-499d6b0877fa-openshift-service-ca\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.278176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.278046    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9231d491-9458-4200-b1b0-499d6b0877fa-maas-api-tls\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.278653 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.278631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9231d491-9458-4200-b1b0-499d6b0877fa-openshift-service-ca\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.280383 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.280361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9231d491-9458-4200-b1b0-499d6b0877fa-maas-api-tls\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.363185 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.363108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hhcc\" (UniqueName: \"kubernetes.io/projected/9231d491-9458-4200-b1b0-499d6b0877fa-kube-api-access-7hhcc\") pod \"maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.380061 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.380025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:44.420181 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.420149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:44.596622 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.596598    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"]
Jul 27 19:47:44.599167 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:47:44.599141    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9231d491_9458_4200_b1b0_499d6b0877fa.slice/crio-876ff3c10ac2199a96b22917297facec9556f0bedea415c931c0ffa5397a27c5 WatchSource:0}: Error finding container 876ff3c10ac2199a96b22917297facec9556f0bedea415c931c0ffa5397a27c5: Status 404 returned error can't find the container with id 876ff3c10ac2199a96b22917297facec9556f0bedea415c931c0ffa5397a27c5
Jul 27 19:47:44.637445 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.637383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:44.995973 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:44.995945    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd" event={"ID":"9231d491-9458-4200-b1b0-499d6b0877fa","Type":"ContainerStarted","Data":"876ff3c10ac2199a96b22917297facec9556f0bedea415c931c0ffa5397a27c5"}
Jul 27 19:47:45.589267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:45.589233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:45.895733 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:45.895649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:47:46.003458 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.003421    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd" event={"ID":"9231d491-9458-4200-b1b0-499d6b0877fa","Type":"ContainerStarted","Data":"c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70"}
Jul 27 19:47:46.003846 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.003604    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:46.046938 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.046888    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd" podStartSLOduration=1.6708986700000001 podStartE2EDuration="2.046872597s" totalImagesPullingTime="375.973927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:47:46.04592465 +0000 UTC m=+1800.785480256" watchObservedRunningTime="2026-07-27 19:47:46.046872597 +0000 UTC m=+1800.786428203"
Jul 27 19:47:46.123183 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.123153    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"]
Jul 27 19:47:46.127876 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.127861    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:46.130392 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.130372    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-67e1471d-dockercfg-jbfwm\""
Jul 27 19:47:46.130487 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.130409    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-67e1471d\""
Jul 27 19:47:46.158244 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.158151    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"]
Jul 27 19:47:46.161790 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.161771    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"]
Jul 27 19:47:46.161890 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.161854    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:46.191424 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.191393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4afb8134-9a0a-4b4b-91da-b7246abda193-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk\" (UID: \"4afb8134-9a0a-4b4b-91da-b7246abda193\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:46.191587 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.191478    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9r4\" (UniqueName: \"kubernetes.io/projected/4afb8134-9a0a-4b4b-91da-b7246abda193-kube-api-access-4b9r4\") pod \"payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk\" (UID: \"4afb8134-9a0a-4b4b-91da-b7246abda193\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:46.198419 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.198385    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"]
Jul 27 19:47:46.292774 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.292738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9r4\" (UniqueName: \"kubernetes.io/projected/4afb8134-9a0a-4b4b-91da-b7246abda193-kube-api-access-4b9r4\") pod \"payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk\" (UID: \"4afb8134-9a0a-4b4b-91da-b7246abda193\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:46.292956 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.292815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qk2\" (UniqueName: \"kubernetes.io/projected/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-kube-api-access-s6qk2\") pod \"payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6\" (UID: \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\") " pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:46.292956 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.292847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-plugins-config-volume\") pod \"payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6\" (UID: \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\") " pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:46.292956 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.292876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4afb8134-9a0a-4b4b-91da-b7246abda193-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk\" (UID: \"4afb8134-9a0a-4b4b-91da-b7246abda193\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:46.293562 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.293543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4afb8134-9a0a-4b4b-91da-b7246abda193-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk\" (UID: \"4afb8134-9a0a-4b4b-91da-b7246abda193\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:46.302225 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.302199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9r4\" (UniqueName: \"kubernetes.io/projected/4afb8134-9a0a-4b4b-91da-b7246abda193-kube-api-access-4b9r4\") pod \"payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk\" (UID: \"4afb8134-9a0a-4b4b-91da-b7246abda193\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:46.393285 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.393247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qk2\" (UniqueName: \"kubernetes.io/projected/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-kube-api-access-s6qk2\") pod \"payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6\" (UID: \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\") " pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:46.393285 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.393285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-plugins-config-volume\") pod \"payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6\" (UID: \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\") " pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:46.393998 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.393978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-plugins-config-volume\") pod \"payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6\" (UID: \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\") " pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:46.400992 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.400971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qk2\" (UniqueName: \"kubernetes.io/projected/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-kube-api-access-s6qk2\") pod \"payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6\" (UID: \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\") " pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:46.437798 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.437772    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:46.471675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.471648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:46.639797 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.639665    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"]
Jul 27 19:47:46.642211 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:47:46.642183    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a9858d_1fda_4e7b_9a1c_f2447e6e46af.slice/crio-7a130f5c49263f5915ac504760d6abefb928dca859423c1dc639363d9ddd7cfa WatchSource:0}: Error finding container 7a130f5c49263f5915ac504760d6abefb928dca859423c1dc639363d9ddd7cfa: Status 404 returned error can't find the container with id 7a130f5c49263f5915ac504760d6abefb928dca859423c1dc639363d9ddd7cfa
Jul 27 19:47:46.654915 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:46.654898    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"]
Jul 27 19:47:46.657120 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:47:46.656952    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afb8134_9a0a_4b4b_91da_b7246abda193.slice/crio-53e03cab969f94966ce2cca11752eb5346e94d2282d3762d29adab889a658e67 WatchSource:0}: Error finding container 53e03cab969f94966ce2cca11752eb5346e94d2282d3762d29adab889a658e67: Status 404 returned error can't find the container with id 53e03cab969f94966ce2cca11752eb5346e94d2282d3762d29adab889a658e67
Jul 27 19:47:47.009672 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:47.009573    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk" event={"ID":"4afb8134-9a0a-4b4b-91da-b7246abda193","Type":"ContainerStarted","Data":"8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244"}
Jul 27 19:47:47.009672 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:47.009637    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk" event={"ID":"4afb8134-9a0a-4b4b-91da-b7246abda193","Type":"ContainerStarted","Data":"53e03cab969f94966ce2cca11752eb5346e94d2282d3762d29adab889a658e67"}
Jul 27 19:47:47.010174 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:47.009704    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:47.011164 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:47.011140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6" event={"ID":"53a9858d-1fda-4e7b-9a1c-f2447e6e46af","Type":"ContainerStarted","Data":"5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949"}
Jul 27 19:47:47.011307 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:47.011175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6" event={"ID":"53a9858d-1fda-4e7b-9a1c-f2447e6e46af","Type":"ContainerStarted","Data":"7a130f5c49263f5915ac504760d6abefb928dca859423c1dc639363d9ddd7cfa"}
Jul 27 19:47:47.011307 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:47.011211    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:47:47.061430 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:47.061375    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk" podStartSLOduration=1.061357308 podStartE2EDuration="1.061357308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:47:47.060915546 +0000 UTC m=+1801.800471150" watchObservedRunningTime="2026-07-27 19:47:47.061357308 +0000 UTC m=+1801.800912913"
Jul 27 19:47:47.138655 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:47.138601    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6" podStartSLOduration=1.138582322 podStartE2EDuration="1.138582322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:47:47.13619941 +0000 UTC m=+1801.875755015" watchObservedRunningTime="2026-07-27 19:47:47.138582322 +0000 UTC m=+1801.878137926"
Jul 27 19:47:48.069823 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:48.069789    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:47:52.017021 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:52.016992    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:47:58.016669 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:58.016629    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:47:58.017058 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:47:58.016708    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:48:24.743367 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:24.743330    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"]
Jul 27 19:48:24.743914 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:24.743569    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd" podUID="9231d491-9458-4200-b1b0-499d6b0877fa" containerName="maas-api" containerID="cri-o://c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70" gracePeriod=30
Jul 27 19:48:24.782158 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:24.782127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:24.810828 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:24.810793    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"]
Jul 27 19:48:24.811105 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:24.811047    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6" podUID="53a9858d-1fda-4e7b-9a1c-f2447e6e46af" containerName="payload-processing" containerID="cri-o://5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949" gracePeriod=30
Jul 27 19:48:24.817538 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:24.817491    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"]
Jul 27 19:48:24.817746 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:24.817723    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk" podUID="4afb8134-9a0a-4b4b-91da-b7246abda193" containerName="payload-pre-processing" containerID="cri-o://8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244" gracePeriod=30
Jul 27 19:48:24.958839 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:24.958784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:25.079842 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.079816    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:48:25.093697 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.093678    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:48:25.099718 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.099700    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:48:25.174737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.174704    2558 generic.go:356] "Generic (PLEG): container finished" podID="4afb8134-9a0a-4b4b-91da-b7246abda193" containerID="8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244" exitCode=0
Jul 27 19:48:25.174908 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.174753    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"
Jul 27 19:48:25.174908 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.174785    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk" event={"ID":"4afb8134-9a0a-4b4b-91da-b7246abda193","Type":"ContainerDied","Data":"8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244"}
Jul 27 19:48:25.174908 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.174847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk" event={"ID":"4afb8134-9a0a-4b4b-91da-b7246abda193","Type":"ContainerDied","Data":"53e03cab969f94966ce2cca11752eb5346e94d2282d3762d29adab889a658e67"}
Jul 27 19:48:25.174908 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.174873    2558 scope.go:117] "RemoveContainer" containerID="8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244"
Jul 27 19:48:25.176122 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.176096    2558 generic.go:356] "Generic (PLEG): container finished" podID="53a9858d-1fda-4e7b-9a1c-f2447e6e46af" containerID="5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949" exitCode=0
Jul 27 19:48:25.176228 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.176136    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"
Jul 27 19:48:25.176228 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.176183    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6" event={"ID":"53a9858d-1fda-4e7b-9a1c-f2447e6e46af","Type":"ContainerDied","Data":"5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949"}
Jul 27 19:48:25.176340 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.176226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6" event={"ID":"53a9858d-1fda-4e7b-9a1c-f2447e6e46af","Type":"ContainerDied","Data":"7a130f5c49263f5915ac504760d6abefb928dca859423c1dc639363d9ddd7cfa"}
Jul 27 19:48:25.177304 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.177284    2558 generic.go:356] "Generic (PLEG): container finished" podID="9231d491-9458-4200-b1b0-499d6b0877fa" containerID="c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70" exitCode=0
Jul 27 19:48:25.177413 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.177325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd" event={"ID":"9231d491-9458-4200-b1b0-499d6b0877fa","Type":"ContainerDied","Data":"c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70"}
Jul 27 19:48:25.177413 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.177353    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd" event={"ID":"9231d491-9458-4200-b1b0-499d6b0877fa","Type":"ContainerDied","Data":"876ff3c10ac2199a96b22917297facec9556f0bedea415c931c0ffa5397a27c5"}
Jul 27 19:48:25.177413 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.177319    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"
Jul 27 19:48:25.183145 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.183123    2558 scope.go:117] "RemoveContainer" containerID="8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244"
Jul 27 19:48:25.183416 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:48:25.183398    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244\": container with ID starting with 8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244 not found: ID does not exist" containerID="8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244"
Jul 27 19:48:25.183466 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.183425    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244"} err="failed to get container status \"8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244\": rpc error: code = NotFound desc = could not find container \"8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244\": container with ID starting with 8e9407e72ac51001ef6302e7472735d181a8544ee1f0d1b28ede009639c90244 not found: ID does not exist"
Jul 27 19:48:25.183466 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.183441    2558 scope.go:117] "RemoveContainer" containerID="5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949"
Jul 27 19:48:25.190836 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.190820    2558 scope.go:117] "RemoveContainer" containerID="5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949"
Jul 27 19:48:25.191092 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:48:25.191071    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949\": container with ID starting with 5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949 not found: ID does not exist" containerID="5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949"
Jul 27 19:48:25.191135 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.191098    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949"} err="failed to get container status \"5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949\": rpc error: code = NotFound desc = could not find container \"5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949\": container with ID starting with 5837f28e93c1c807064963c5546d3f65a27f5d5b21c7af5daddc1629cdb93949 not found: ID does not exist"
Jul 27 19:48:25.191135 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.191113    2558 scope.go:117] "RemoveContainer" containerID="c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70"
Jul 27 19:48:25.197885 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.197868    2558 scope.go:117] "RemoveContainer" containerID="c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70"
Jul 27 19:48:25.198121 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:48:25.198101    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70\": container with ID starting with c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70 not found: ID does not exist" containerID="c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70"
Jul 27 19:48:25.198198 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.198125    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70"} err="failed to get container status \"c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70\": rpc error: code = NotFound desc = could not find container \"c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70\": container with ID starting with c566a1bb763b374b1f2f7f05dfb0bd2985c928457e796738830073b8121dee70 not found: ID does not exist"
Jul 27 19:48:25.242529 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.242477    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9231d491-9458-4200-b1b0-499d6b0877fa-openshift-service-ca\") pod \"9231d491-9458-4200-b1b0-499d6b0877fa\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") "
Jul 27 19:48:25.242529 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.242534    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4afb8134-9a0a-4b4b-91da-b7246abda193-plugins-config-volume\") pod \"4afb8134-9a0a-4b4b-91da-b7246abda193\" (UID: \"4afb8134-9a0a-4b4b-91da-b7246abda193\") "
Jul 27 19:48:25.242766 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.242560    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hhcc\" (UniqueName: \"kubernetes.io/projected/9231d491-9458-4200-b1b0-499d6b0877fa-kube-api-access-7hhcc\") pod \"9231d491-9458-4200-b1b0-499d6b0877fa\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") "
Jul 27 19:48:25.242766 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.242589    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6qk2\" (UniqueName: \"kubernetes.io/projected/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-kube-api-access-s6qk2\") pod \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\" (UID: \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\") "
Jul 27 19:48:25.242766 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.242628    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b9r4\" (UniqueName: \"kubernetes.io/projected/4afb8134-9a0a-4b4b-91da-b7246abda193-kube-api-access-4b9r4\") pod \"4afb8134-9a0a-4b4b-91da-b7246abda193\" (UID: \"4afb8134-9a0a-4b4b-91da-b7246abda193\") "
Jul 27 19:48:25.242766 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.242709    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-plugins-config-volume\") pod \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\" (UID: \"53a9858d-1fda-4e7b-9a1c-f2447e6e46af\") "
Jul 27 19:48:25.242766 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.242741    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9231d491-9458-4200-b1b0-499d6b0877fa-maas-api-tls\") pod \"9231d491-9458-4200-b1b0-499d6b0877fa\" (UID: \"9231d491-9458-4200-b1b0-499d6b0877fa\") "
Jul 27 19:48:25.243020 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.242910    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9231d491-9458-4200-b1b0-499d6b0877fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9231d491-9458-4200-b1b0-499d6b0877fa" (UID: "9231d491-9458-4200-b1b0-499d6b0877fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:48:25.243076 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.243021    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4afb8134-9a0a-4b4b-91da-b7246abda193-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4afb8134-9a0a-4b4b-91da-b7246abda193" (UID: "4afb8134-9a0a-4b4b-91da-b7246abda193"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:48:25.243345 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.243319    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53a9858d-1fda-4e7b-9a1c-f2447e6e46af" (UID: "53a9858d-1fda-4e7b-9a1c-f2447e6e46af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:48:25.244968 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.244947    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-kube-api-access-s6qk2" (OuterVolumeSpecName: "kube-api-access-s6qk2") pod "53a9858d-1fda-4e7b-9a1c-f2447e6e46af" (UID: "53a9858d-1fda-4e7b-9a1c-f2447e6e46af"). InnerVolumeSpecName "kube-api-access-s6qk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:48:25.244968 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.244957    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9231d491-9458-4200-b1b0-499d6b0877fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9231d491-9458-4200-b1b0-499d6b0877fa" (UID: "9231d491-9458-4200-b1b0-499d6b0877fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:48:25.245207 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.245183    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9231d491-9458-4200-b1b0-499d6b0877fa-kube-api-access-7hhcc" (OuterVolumeSpecName: "kube-api-access-7hhcc") pod "9231d491-9458-4200-b1b0-499d6b0877fa" (UID: "9231d491-9458-4200-b1b0-499d6b0877fa"). InnerVolumeSpecName "kube-api-access-7hhcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:48:25.245294 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.245212    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4afb8134-9a0a-4b4b-91da-b7246abda193-kube-api-access-4b9r4" (OuterVolumeSpecName: "kube-api-access-4b9r4") pod "4afb8134-9a0a-4b4b-91da-b7246abda193" (UID: "4afb8134-9a0a-4b4b-91da-b7246abda193"). InnerVolumeSpecName "kube-api-access-4b9r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:48:25.343534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.343435    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6qk2\" (UniqueName: \"kubernetes.io/projected/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-kube-api-access-s6qk2\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:48:25.343534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.343462    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b9r4\" (UniqueName: \"kubernetes.io/projected/4afb8134-9a0a-4b4b-91da-b7246abda193-kube-api-access-4b9r4\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:48:25.343534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.343471    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a9858d-1fda-4e7b-9a1c-f2447e6e46af-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:48:25.343534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.343480    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9231d491-9458-4200-b1b0-499d6b0877fa-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:48:25.343534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.343488    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9231d491-9458-4200-b1b0-499d6b0877fa-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:48:25.343534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.343519    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4afb8134-9a0a-4b4b-91da-b7246abda193-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:48:25.343534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.343529    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hhcc\" (UniqueName: \"kubernetes.io/projected/9231d491-9458-4200-b1b0-499d6b0877fa-kube-api-access-7hhcc\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:48:25.498983 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.498960    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"]
Jul 27 19:48:25.504400 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.504379    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk"]
Jul 27 19:48:25.515691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.515663    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"]
Jul 27 19:48:25.518431 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.518411    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67e1471d-5c57dd7c9d-4zztd"]
Jul 27 19:48:25.528521 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.528488    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"]
Jul 27 19:48:25.532486 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.532468    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6"]
Jul 27 19:48:25.821682 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.821651    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4afb8134-9a0a-4b4b-91da-b7246abda193" path="/var/lib/kubelet/pods/4afb8134-9a0a-4b4b-91da-b7246abda193/volumes"
Jul 27 19:48:25.822039 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.822012    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53a9858d-1fda-4e7b-9a1c-f2447e6e46af" path="/var/lib/kubelet/pods/53a9858d-1fda-4e7b-9a1c-f2447e6e46af/volumes"
Jul 27 19:48:25.822345 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:25.822333    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9231d491-9458-4200-b1b0-499d6b0877fa" path="/var/lib/kubelet/pods/9231d491-9458-4200-b1b0-499d6b0877fa/volumes"
Jul 27 19:48:27.770514 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:27.770465    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:48:28.536092 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:28.536053    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:28.682824 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:28.682792    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:28.917261 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:28.917174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:29.377892 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:29.377861    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:29.507564 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:29.507535    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:30.926706 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:30.926672    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:37.145025 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:37.144989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:37.362343 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:37.362310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:37.573389 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:37.573353    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:48:37.830108 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:48:37.830006    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:03.835137 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:03.835096    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:10.669372 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:10.669332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:10.906614 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:10.906582    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:39.660769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:39.660736    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:41.310390 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:41.310355    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:43.598190 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:43.598152    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:44.365939 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:44.365903    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:50.907647 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:50.907611    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:51.051038 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:51.050999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:51.225680 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:51.225642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:52.012709 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:52.012671    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:52.134168 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:52.134136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:56.286363 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:56.286329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:49:58.811811 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:49:58.811778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:05.082419 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:05.082373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:05.232972 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:05.232937    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:05.299681 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:05.299644    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:50:05.777562 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:05.777532    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:15.902344 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902305    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"]
Jul 27 19:50:15.902920 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902779    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53a9858d-1fda-4e7b-9a1c-f2447e6e46af" containerName="payload-processing"
Jul 27 19:50:15.902920 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902800    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="53a9858d-1fda-4e7b-9a1c-f2447e6e46af" containerName="payload-processing"
Jul 27 19:50:15.902920 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902828    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9231d491-9458-4200-b1b0-499d6b0877fa" containerName="maas-api"
Jul 27 19:50:15.902920 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902838    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9231d491-9458-4200-b1b0-499d6b0877fa" containerName="maas-api"
Jul 27 19:50:15.902920 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902848    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4afb8134-9a0a-4b4b-91da-b7246abda193" containerName="payload-pre-processing"
Jul 27 19:50:15.902920 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902857    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4afb8134-9a0a-4b4b-91da-b7246abda193" containerName="payload-pre-processing"
Jul 27 19:50:15.903279 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902935    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9231d491-9458-4200-b1b0-499d6b0877fa" containerName="maas-api"
Jul 27 19:50:15.903279 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902947    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4afb8134-9a0a-4b4b-91da-b7246abda193" containerName="payload-pre-processing"
Jul 27 19:50:15.903279 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.902960    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="53a9858d-1fda-4e7b-9a1c-f2447e6e46af" containerName="payload-processing"
Jul 27 19:50:15.906110 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.906090    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:15.913013 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.912993    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-eae5981c-serving-cert\""
Jul 27 19:50:15.913096 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.913030    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:50:15.913741 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.913725    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:50:15.913783 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.913752    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:50:15.926358 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:15.926337    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"]
Jul 27 19:50:16.051958 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.051921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba153306-3525-4fe9-95e4-873801b1b0e9-openshift-service-ca\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.051958 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.051962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxtsf\" (UniqueName: \"kubernetes.io/projected/ba153306-3525-4fe9-95e4-873801b1b0e9-kube-api-access-mxtsf\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.052166 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.051984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.153308 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.153240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba153306-3525-4fe9-95e4-873801b1b0e9-openshift-service-ca\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.153308 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.153277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxtsf\" (UniqueName: \"kubernetes.io/projected/ba153306-3525-4fe9-95e4-873801b1b0e9-kube-api-access-mxtsf\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.153308 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.153297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.153601 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:50:16.153483    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-serving-cert: secret "maas-api-e2e-mt-eae5981c-serving-cert" not found
Jul 27 19:50:16.153601 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:50:16.153583    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls podName:ba153306-3525-4fe9-95e4-873801b1b0e9 nodeName:}" failed. No retries permitted until 2026-07-27 19:50:16.653560826 +0000 UTC m=+1951.393116426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls") pod "maas-api-e2e-mt-eae5981c-56c47f884d-gqctq" (UID: "ba153306-3525-4fe9-95e4-873801b1b0e9") : secret "maas-api-e2e-mt-eae5981c-serving-cert" not found
Jul 27 19:50:16.153861 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.153840    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba153306-3525-4fe9-95e4-873801b1b0e9-openshift-service-ca\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.170074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.170046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxtsf\" (UniqueName: \"kubernetes.io/projected/ba153306-3525-4fe9-95e4-873801b1b0e9-kube-api-access-mxtsf\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.657966 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.657906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.660550 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.660524    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls\") pod \"maas-api-e2e-mt-eae5981c-56c47f884d-gqctq\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.816338 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.816303    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:16.816921 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.816902    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"]
Jul 27 19:50:16.819851 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.819836    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:16.822912 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.822895    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-eae5981c\""
Jul 27 19:50:16.836491 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.836465    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"]
Jul 27 19:50:16.847699 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.847675    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"]
Jul 27 19:50:16.851123 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.851105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:16.853649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.853631    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-eae5981c-dockercfg-f6g7t\""
Jul 27 19:50:16.863144 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.863124    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"]
Jul 27 19:50:16.953746 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.953722    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"]
Jul 27 19:50:16.955990 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:50:16.955942    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba153306_3525_4fe9_95e4_873801b1b0e9.slice/crio-e85d1b0d4e941b0a9c73bd310ed4a51b48910c8432be405046aacfeaccba6a5b WatchSource:0}: Error finding container e85d1b0d4e941b0a9c73bd310ed4a51b48910c8432be405046aacfeaccba6a5b: Status 404 returned error can't find the container with id e85d1b0d4e941b0a9c73bd310ed4a51b48910c8432be405046aacfeaccba6a5b
Jul 27 19:50:16.960158 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.960134    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-plugins-config-volume\") pod \"payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc\" (UID: \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\") " pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:16.960266 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.960171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzvls\" (UniqueName: \"kubernetes.io/projected/98c8f68d-489c-4356-a125-a1a7d98820c7-kube-api-access-wzvls\") pod \"payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn\" (UID: \"98c8f68d-489c-4356-a125-a1a7d98820c7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:16.960266 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.960215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c8f68d-489c-4356-a125-a1a7d98820c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn\" (UID: \"98c8f68d-489c-4356-a125-a1a7d98820c7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:16.960266 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:16.960256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm29h\" (UniqueName: \"kubernetes.io/projected/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-kube-api-access-cm29h\") pod \"payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc\" (UID: \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\") " pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:17.061564 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.061534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c8f68d-489c-4356-a125-a1a7d98820c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn\" (UID: \"98c8f68d-489c-4356-a125-a1a7d98820c7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:17.061564 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.061568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm29h\" (UniqueName: \"kubernetes.io/projected/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-kube-api-access-cm29h\") pod \"payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc\" (UID: \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\") " pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:17.061782 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.061705    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-plugins-config-volume\") pod \"payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc\" (UID: \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\") " pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:17.061782 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.061744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzvls\" (UniqueName: \"kubernetes.io/projected/98c8f68d-489c-4356-a125-a1a7d98820c7-kube-api-access-wzvls\") pod \"payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn\" (UID: \"98c8f68d-489c-4356-a125-a1a7d98820c7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:17.062294 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.062272    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c8f68d-489c-4356-a125-a1a7d98820c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn\" (UID: \"98c8f68d-489c-4356-a125-a1a7d98820c7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:17.062373 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.062361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-plugins-config-volume\") pod \"payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc\" (UID: \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\") " pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:17.073414 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.073392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzvls\" (UniqueName: \"kubernetes.io/projected/98c8f68d-489c-4356-a125-a1a7d98820c7-kube-api-access-wzvls\") pod \"payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn\" (UID: \"98c8f68d-489c-4356-a125-a1a7d98820c7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:17.073749 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.073733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm29h\" (UniqueName: \"kubernetes.io/projected/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-kube-api-access-cm29h\") pod \"payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc\" (UID: \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\") " pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:17.144396 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.144362    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:17.162158 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.162124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:17.280660 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.280633    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"]
Jul 27 19:50:17.282952 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:50:17.282919    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c8f68d_489c_4356_a125_a1a7d98820c7.slice/crio-b3ab32b127721f4f43f728aa04b26642219bcca77fc566c77554c1920d5c0c6b WatchSource:0}: Error finding container b3ab32b127721f4f43f728aa04b26642219bcca77fc566c77554c1920d5c0c6b: Status 404 returned error can't find the container with id b3ab32b127721f4f43f728aa04b26642219bcca77fc566c77554c1920d5c0c6b
Jul 27 19:50:17.307713 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.307690    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"]
Jul 27 19:50:17.324669 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:50:17.324642    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82a16ac_4e0c_4e80_8da5_a5077c3b5e02.slice/crio-bcb3d00b94fc54930b584339f961dc575d9df8cd74fdbf6fd3bc8ece88960bd3 WatchSource:0}: Error finding container bcb3d00b94fc54930b584339f961dc575d9df8cd74fdbf6fd3bc8ece88960bd3: Status 404 returned error can't find the container with id bcb3d00b94fc54930b584339f961dc575d9df8cd74fdbf6fd3bc8ece88960bd3
Jul 27 19:50:17.654856 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.654760    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq" event={"ID":"ba153306-3525-4fe9-95e4-873801b1b0e9","Type":"ContainerStarted","Data":"0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480"}
Jul 27 19:50:17.654856 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.654831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq" event={"ID":"ba153306-3525-4fe9-95e4-873801b1b0e9","Type":"ContainerStarted","Data":"e85d1b0d4e941b0a9c73bd310ed4a51b48910c8432be405046aacfeaccba6a5b"}
Jul 27 19:50:17.655079 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.654893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:17.656434 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.656407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc" event={"ID":"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02","Type":"ContainerStarted","Data":"3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d"}
Jul 27 19:50:17.656583 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.656448    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc" event={"ID":"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02","Type":"ContainerStarted","Data":"bcb3d00b94fc54930b584339f961dc575d9df8cd74fdbf6fd3bc8ece88960bd3"}
Jul 27 19:50:17.656583 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.656542    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:17.657853 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.657827    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn" event={"ID":"98c8f68d-489c-4356-a125-a1a7d98820c7","Type":"ContainerStarted","Data":"ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d"}
Jul 27 19:50:17.657967 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.657869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn" event={"ID":"98c8f68d-489c-4356-a125-a1a7d98820c7","Type":"ContainerStarted","Data":"b3ab32b127721f4f43f728aa04b26642219bcca77fc566c77554c1920d5c0c6b"}
Jul 27 19:50:17.658076 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.657985    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:17.672643 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.672591    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq" podStartSLOduration=2.271427367 podStartE2EDuration="2.672574274s" totalImagesPullingTime="401.146907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:50:17.671096591 +0000 UTC m=+1952.410652196" watchObservedRunningTime="2026-07-27 19:50:17.672574274 +0000 UTC m=+1952.412129879"
Jul 27 19:50:17.688306 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.688258    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn" podStartSLOduration=1.6882463250000002 podStartE2EDuration="1.688246325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:50:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:50:17.687132199 +0000 UTC m=+1952.426687816" watchObservedRunningTime="2026-07-27 19:50:17.688246325 +0000 UTC m=+1952.427801931"
Jul 27 19:50:17.703538 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:17.703464    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc" podStartSLOduration=1.703447221 podStartE2EDuration="1.703447221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:50:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:50:17.702483111 +0000 UTC m=+1952.442038720" watchObservedRunningTime="2026-07-27 19:50:17.703447221 +0000 UTC m=+1952.443002827"
Jul 27 19:50:18.682233 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:18.682205    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:50:23.667717 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:23.667689    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:28.663859 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:28.663820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:28.664292 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:28.664054    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:30.376048 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:30.376017    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:50:38.102901 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.102868    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"]
Jul 27 19:50:38.103322 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.103067    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq" podUID="ba153306-3525-4fe9-95e4-873801b1b0e9" containerName="maas-api" containerID="cri-o://0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480" gracePeriod=30
Jul 27 19:50:38.166944 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.166913    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"]
Jul 27 19:50:38.167206 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.167158    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc" podUID="b82a16ac-4e0c-4e80-8da5-a5077c3b5e02" containerName="payload-processing" containerID="cri-o://3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d" gracePeriod=30
Jul 27 19:50:38.175452 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.175056    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"]
Jul 27 19:50:38.175452 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.175281    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn" podUID="98c8f68d-489c-4356-a125-a1a7d98820c7" containerName="payload-pre-processing" containerID="cri-o://ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d" gracePeriod=30
Jul 27 19:50:38.432672 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.432647    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:38.446491 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.446462    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c8f68d-489c-4356-a125-a1a7d98820c7-plugins-config-volume\") pod \"98c8f68d-489c-4356-a125-a1a7d98820c7\" (UID: \"98c8f68d-489c-4356-a125-a1a7d98820c7\") "
Jul 27 19:50:38.446626 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.446531    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzvls\" (UniqueName: \"kubernetes.io/projected/98c8f68d-489c-4356-a125-a1a7d98820c7-kube-api-access-wzvls\") pod \"98c8f68d-489c-4356-a125-a1a7d98820c7\" (UID: \"98c8f68d-489c-4356-a125-a1a7d98820c7\") "
Jul 27 19:50:38.446799 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.446776    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98c8f68d-489c-4356-a125-a1a7d98820c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98c8f68d-489c-4356-a125-a1a7d98820c7" (UID: "98c8f68d-489c-4356-a125-a1a7d98820c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:50:38.448607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.448583    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98c8f68d-489c-4356-a125-a1a7d98820c7-kube-api-access-wzvls" (OuterVolumeSpecName: "kube-api-access-wzvls") pod "98c8f68d-489c-4356-a125-a1a7d98820c7" (UID: "98c8f68d-489c-4356-a125-a1a7d98820c7"). InnerVolumeSpecName "kube-api-access-wzvls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:50:38.452686 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.452363    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:38.457932 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.457913    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:38.547323 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547294    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-plugins-config-volume\") pod \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\" (UID: \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\") "
Jul 27 19:50:38.547484 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547343    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm29h\" (UniqueName: \"kubernetes.io/projected/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-kube-api-access-cm29h\") pod \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\" (UID: \"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02\") "
Jul 27 19:50:38.547484 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547365    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls\") pod \"ba153306-3525-4fe9-95e4-873801b1b0e9\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") "
Jul 27 19:50:38.547484 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547399    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxtsf\" (UniqueName: \"kubernetes.io/projected/ba153306-3525-4fe9-95e4-873801b1b0e9-kube-api-access-mxtsf\") pod \"ba153306-3525-4fe9-95e4-873801b1b0e9\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") "
Jul 27 19:50:38.547484 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547425    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba153306-3525-4fe9-95e4-873801b1b0e9-openshift-service-ca\") pod \"ba153306-3525-4fe9-95e4-873801b1b0e9\" (UID: \"ba153306-3525-4fe9-95e4-873801b1b0e9\") "
Jul 27 19:50:38.547722 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547588    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c8f68d-489c-4356-a125-a1a7d98820c7-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:50:38.547722 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547600    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzvls\" (UniqueName: \"kubernetes.io/projected/98c8f68d-489c-4356-a125-a1a7d98820c7-kube-api-access-wzvls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:50:38.547840 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547705    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b82a16ac-4e0c-4e80-8da5-a5077c3b5e02" (UID: "b82a16ac-4e0c-4e80-8da5-a5077c3b5e02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:50:38.547921 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.547894    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba153306-3525-4fe9-95e4-873801b1b0e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba153306-3525-4fe9-95e4-873801b1b0e9" (UID: "ba153306-3525-4fe9-95e4-873801b1b0e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:50:38.549626 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.549602    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-kube-api-access-cm29h" (OuterVolumeSpecName: "kube-api-access-cm29h") pod "b82a16ac-4e0c-4e80-8da5-a5077c3b5e02" (UID: "b82a16ac-4e0c-4e80-8da5-a5077c3b5e02"). InnerVolumeSpecName "kube-api-access-cm29h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:50:38.549626 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.549615    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba153306-3525-4fe9-95e4-873801b1b0e9" (UID: "ba153306-3525-4fe9-95e4-873801b1b0e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:50:38.549726 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.549633    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba153306-3525-4fe9-95e4-873801b1b0e9-kube-api-access-mxtsf" (OuterVolumeSpecName: "kube-api-access-mxtsf") pod "ba153306-3525-4fe9-95e4-873801b1b0e9" (UID: "ba153306-3525-4fe9-95e4-873801b1b0e9"). InnerVolumeSpecName "kube-api-access-mxtsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:50:38.648446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.648363    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:50:38.648446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.648401    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm29h\" (UniqueName: \"kubernetes.io/projected/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02-kube-api-access-cm29h\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:50:38.648446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.648412    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba153306-3525-4fe9-95e4-873801b1b0e9-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:50:38.648446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.648421    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxtsf\" (UniqueName: \"kubernetes.io/projected/ba153306-3525-4fe9-95e4-873801b1b0e9-kube-api-access-mxtsf\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:50:38.648446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.648432    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba153306-3525-4fe9-95e4-873801b1b0e9-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:50:38.746161 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.746131    2558 generic.go:356] "Generic (PLEG): container finished" podID="ba153306-3525-4fe9-95e4-873801b1b0e9" containerID="0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480" exitCode=0
Jul 27 19:50:38.746323 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.746176    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"
Jul 27 19:50:38.746323 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.746205    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq" event={"ID":"ba153306-3525-4fe9-95e4-873801b1b0e9","Type":"ContainerDied","Data":"0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480"}
Jul 27 19:50:38.746323 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.746246    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq" event={"ID":"ba153306-3525-4fe9-95e4-873801b1b0e9","Type":"ContainerDied","Data":"e85d1b0d4e941b0a9c73bd310ed4a51b48910c8432be405046aacfeaccba6a5b"}
Jul 27 19:50:38.746323 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.746263    2558 scope.go:117] "RemoveContainer" containerID="0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480"
Jul 27 19:50:38.747559 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.747526    2558 generic.go:356] "Generic (PLEG): container finished" podID="b82a16ac-4e0c-4e80-8da5-a5077c3b5e02" containerID="3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d" exitCode=0
Jul 27 19:50:38.747662 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.747616    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"
Jul 27 19:50:38.747662 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.747635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc" event={"ID":"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02","Type":"ContainerDied","Data":"3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d"}
Jul 27 19:50:38.747757 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.747686    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc" event={"ID":"b82a16ac-4e0c-4e80-8da5-a5077c3b5e02","Type":"ContainerDied","Data":"bcb3d00b94fc54930b584339f961dc575d9df8cd74fdbf6fd3bc8ece88960bd3"}
Jul 27 19:50:38.749012 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.748987    2558 generic.go:356] "Generic (PLEG): container finished" podID="98c8f68d-489c-4356-a125-a1a7d98820c7" containerID="ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d" exitCode=0
Jul 27 19:50:38.749133 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.749032    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"
Jul 27 19:50:38.749133 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.749028    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn" event={"ID":"98c8f68d-489c-4356-a125-a1a7d98820c7","Type":"ContainerDied","Data":"ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d"}
Jul 27 19:50:38.749250 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.749159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn" event={"ID":"98c8f68d-489c-4356-a125-a1a7d98820c7","Type":"ContainerDied","Data":"b3ab32b127721f4f43f728aa04b26642219bcca77fc566c77554c1920d5c0c6b"}
Jul 27 19:50:38.754945 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.754926    2558 scope.go:117] "RemoveContainer" containerID="0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480"
Jul 27 19:50:38.755216 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:50:38.755194    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480\": container with ID starting with 0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480 not found: ID does not exist" containerID="0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480"
Jul 27 19:50:38.755299 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.755222    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480"} err="failed to get container status \"0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480\": rpc error: code = NotFound desc = could not find container \"0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480\": container with ID starting with 0b836e40d2a59455f0bef9d68ad10f5579d5816d808cc3702e73a2be87761480 not found: ID does not exist"
Jul 27 19:50:38.755299 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.755238    2558 scope.go:117] "RemoveContainer" containerID="3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d"
Jul 27 19:50:38.763859 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.763839    2558 scope.go:117] "RemoveContainer" containerID="3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d"
Jul 27 19:50:38.764086 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:50:38.764065    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d\": container with ID starting with 3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d not found: ID does not exist" containerID="3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d"
Jul 27 19:50:38.764129 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.764092    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d"} err="failed to get container status \"3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d\": rpc error: code = NotFound desc = could not find container \"3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d\": container with ID starting with 3f7b89a75c17c95f4ddebb4e8cbbefbf56214d505ec950cfcc0d77ef9d8d396d not found: ID does not exist"
Jul 27 19:50:38.764129 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.764109    2558 scope.go:117] "RemoveContainer" containerID="ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d"
Jul 27 19:50:38.770834 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.770816    2558 scope.go:117] "RemoveContainer" containerID="ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d"
Jul 27 19:50:38.771100 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:50:38.771083    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d\": container with ID starting with ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d not found: ID does not exist" containerID="ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d"
Jul 27 19:50:38.771177 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.771105    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d"} err="failed to get container status \"ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d\": rpc error: code = NotFound desc = could not find container \"ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d\": container with ID starting with ebe09480a990a0bb2162e44bf53497ba7d18e415fa1b0563be77338194fac71d not found: ID does not exist"
Jul 27 19:50:38.779387 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.779364    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"]
Jul 27 19:50:38.783737 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.783716    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eae5981c-56c47f884d-gqctq"]
Jul 27 19:50:38.796426 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.796406    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"]
Jul 27 19:50:38.802844 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.802822    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc"]
Jul 27 19:50:38.813217 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.813195    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"]
Jul 27 19:50:38.817670 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:38.817651    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn"]
Jul 27 19:50:39.821665 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:39.821628    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98c8f68d-489c-4356-a125-a1a7d98820c7" path="/var/lib/kubelet/pods/98c8f68d-489c-4356-a125-a1a7d98820c7/volumes"
Jul 27 19:50:39.822161 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:39.821981    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82a16ac-4e0c-4e80-8da5-a5077c3b5e02" path="/var/lib/kubelet/pods/b82a16ac-4e0c-4e80-8da5-a5077c3b5e02/volumes"
Jul 27 19:50:39.822319 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:39.822305    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba153306-3525-4fe9-95e4-873801b1b0e9" path="/var/lib/kubelet/pods/ba153306-3525-4fe9-95e4-873801b1b0e9/volumes"
Jul 27 19:50:41.874426 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:41.874389    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:50:42.708142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:42.708111    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:42.858237 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:42.858205    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:43.030741 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:43.030661    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:49.168225 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:49.168190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:49.268336 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:49.268305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:49.440858 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:49.440829    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:49.640623 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:49.640589    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:49.814124 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:49.814049    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:49.913849 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:49.913814    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:50.014682 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:50.014651    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:57.742064 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:57.742033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:50:57.823534 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:50:57.823487    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:02.550340 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:02.550274    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:02.686657 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:02.686614    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:08.251791 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:08.251755    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:08.370677 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:08.370637    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:09.347731 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:09.347702    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:09.634940 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:09.634854    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:10.135895 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:10.135861    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:13.087473 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.087414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:13.171187 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171151    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"]
Jul 27 19:51:13.171595 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171576    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98c8f68d-489c-4356-a125-a1a7d98820c7" containerName="payload-pre-processing"
Jul 27 19:51:13.171699 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171596    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="98c8f68d-489c-4356-a125-a1a7d98820c7" containerName="payload-pre-processing"
Jul 27 19:51:13.171699 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171615    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82a16ac-4e0c-4e80-8da5-a5077c3b5e02" containerName="payload-processing"
Jul 27 19:51:13.171699 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171623    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82a16ac-4e0c-4e80-8da5-a5077c3b5e02" containerName="payload-processing"
Jul 27 19:51:13.171699 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171643    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba153306-3525-4fe9-95e4-873801b1b0e9" containerName="maas-api"
Jul 27 19:51:13.171699 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171652    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba153306-3525-4fe9-95e4-873801b1b0e9" containerName="maas-api"
Jul 27 19:51:13.171946 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171727    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82a16ac-4e0c-4e80-8da5-a5077c3b5e02" containerName="payload-processing"
Jul 27 19:51:13.171946 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171742    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="98c8f68d-489c-4356-a125-a1a7d98820c7" containerName="payload-pre-processing"
Jul 27 19:51:13.171946 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.171752    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba153306-3525-4fe9-95e4-873801b1b0e9" containerName="maas-api"
Jul 27 19:51:13.174741 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.174722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.176915 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.176896    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ef75af22-serving-cert\""
Jul 27 19:51:13.177092 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.177080    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:51:13.177674 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.177659    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:51:13.177729 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.177664    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:51:13.185120 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.185097    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"]
Jul 27 19:51:13.191335 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.191314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:13.248996 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.248965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcdea04-be25-4e6a-8519-15435259ed4a-openshift-service-ca\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.249197 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.249040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggrpj\" (UniqueName: \"kubernetes.io/projected/1bcdea04-be25-4e6a-8519-15435259ed4a-kube-api-access-ggrpj\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.249197 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.249064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.284771 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.284746    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:13.349559 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.349480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.349709 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.349574    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcdea04-be25-4e6a-8519-15435259ed4a-openshift-service-ca\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.349709 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:51:13.349613    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-serving-cert: secret "maas-api-e2e-mt-ef75af22-serving-cert" not found
Jul 27 19:51:13.349709 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.349622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggrpj\" (UniqueName: \"kubernetes.io/projected/1bcdea04-be25-4e6a-8519-15435259ed4a-kube-api-access-ggrpj\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.349709 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:51:13.349668    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls podName:1bcdea04-be25-4e6a-8519-15435259ed4a nodeName:}" failed. No retries permitted until 2026-07-27 19:51:13.849652755 +0000 UTC m=+2008.589208338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls") pod "maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv" (UID: "1bcdea04-be25-4e6a-8519-15435259ed4a") : secret "maas-api-e2e-mt-ef75af22-serving-cert" not found
Jul 27 19:51:13.350302 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.350279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcdea04-be25-4e6a-8519-15435259ed4a-openshift-service-ca\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.374350 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.374329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggrpj\" (UniqueName: \"kubernetes.io/projected/1bcdea04-be25-4e6a-8519-15435259ed4a-kube-api-access-ggrpj\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.467084 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.467048    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:13.853690 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.853657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.856039 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.856022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls\") pod \"maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:13.953772 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:13.953734    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:14.060102 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.060071    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"]
Jul 27 19:51:14.063462 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.063447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.066102 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.066079    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ef75af22\""
Jul 27 19:51:14.066247 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.066107    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ef75af22-dockercfg-5bq29\""
Jul 27 19:51:14.067115 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.067091    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"]
Jul 27 19:51:14.070462 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.070443    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.074458 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.074434    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"]
Jul 27 19:51:14.085899 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.085875    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:14.086558 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.086535    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"]
Jul 27 19:51:14.086800 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.086775    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:14.155044 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.155007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rm4n\" (UniqueName: \"kubernetes.io/projected/1b64d4fe-1c57-4689-8b27-351be6778469-kube-api-access-6rm4n\") pod \"payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx\" (UID: \"1b64d4fe-1c57-4689-8b27-351be6778469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.155449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.155049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghcw\" (UniqueName: \"kubernetes.io/projected/4751f556-3fa7-40e8-8db7-3abebc9928f9-kube-api-access-cghcw\") pod \"payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm\" (UID: \"4751f556-3fa7-40e8-8db7-3abebc9928f9\") " pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.155449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.155109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4751f556-3fa7-40e8-8db7-3abebc9928f9-plugins-config-volume\") pod \"payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm\" (UID: \"4751f556-3fa7-40e8-8db7-3abebc9928f9\") " pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.155449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.155159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b64d4fe-1c57-4689-8b27-351be6778469-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx\" (UID: \"1b64d4fe-1c57-4689-8b27-351be6778469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.225877 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.225855    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"]
Jul 27 19:51:14.227726 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:51:14.227701    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcdea04_be25_4e6a_8519_15435259ed4a.slice/crio-283bdee5534c2c61135c86fbc9b8b78a348cf0e6953af3cd8fb7b65c723272f6 WatchSource:0}: Error finding container 283bdee5534c2c61135c86fbc9b8b78a348cf0e6953af3cd8fb7b65c723272f6: Status 404 returned error can't find the container with id 283bdee5534c2c61135c86fbc9b8b78a348cf0e6953af3cd8fb7b65c723272f6
Jul 27 19:51:14.229132 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.229114    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:51:14.256144 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.256120    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rm4n\" (UniqueName: \"kubernetes.io/projected/1b64d4fe-1c57-4689-8b27-351be6778469-kube-api-access-6rm4n\") pod \"payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx\" (UID: \"1b64d4fe-1c57-4689-8b27-351be6778469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.256258 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.256162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghcw\" (UniqueName: \"kubernetes.io/projected/4751f556-3fa7-40e8-8db7-3abebc9928f9-kube-api-access-cghcw\") pod \"payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm\" (UID: \"4751f556-3fa7-40e8-8db7-3abebc9928f9\") " pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.256258 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.256187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4751f556-3fa7-40e8-8db7-3abebc9928f9-plugins-config-volume\") pod \"payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm\" (UID: \"4751f556-3fa7-40e8-8db7-3abebc9928f9\") " pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.256258 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.256221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b64d4fe-1c57-4689-8b27-351be6778469-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx\" (UID: \"1b64d4fe-1c57-4689-8b27-351be6778469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.256880 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.256863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4751f556-3fa7-40e8-8db7-3abebc9928f9-plugins-config-volume\") pod \"payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm\" (UID: \"4751f556-3fa7-40e8-8db7-3abebc9928f9\") " pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.256936 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.256917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b64d4fe-1c57-4689-8b27-351be6778469-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx\" (UID: \"1b64d4fe-1c57-4689-8b27-351be6778469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.264435 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.264405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rm4n\" (UniqueName: \"kubernetes.io/projected/1b64d4fe-1c57-4689-8b27-351be6778469-kube-api-access-6rm4n\") pod \"payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx\" (UID: \"1b64d4fe-1c57-4689-8b27-351be6778469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.264435 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.264415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghcw\" (UniqueName: \"kubernetes.io/projected/4751f556-3fa7-40e8-8db7-3abebc9928f9-kube-api-access-cghcw\") pod \"payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm\" (UID: \"4751f556-3fa7-40e8-8db7-3abebc9928f9\") " pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.378398 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.378133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.384597 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.384572    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.522481 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.522458    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"]
Jul 27 19:51:14.523084 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:51:14.523059    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b64d4fe_1c57_4689_8b27_351be6778469.slice/crio-4bd59e457c568e511fe7ef4080ad30abb433326ce165c4a637259b9c9d4a82c0 WatchSource:0}: Error finding container 4bd59e457c568e511fe7ef4080ad30abb433326ce165c4a637259b9c9d4a82c0: Status 404 returned error can't find the container with id 4bd59e457c568e511fe7ef4080ad30abb433326ce165c4a637259b9c9d4a82c0
Jul 27 19:51:14.541381 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.541357    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"]
Jul 27 19:51:14.543995 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:51:14.543971    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4751f556_3fa7_40e8_8db7_3abebc9928f9.slice/crio-4c62f6147aa2cc91d1faa353e662467d877137ccaad191028169036eeb4ccc61 WatchSource:0}: Error finding container 4c62f6147aa2cc91d1faa353e662467d877137ccaad191028169036eeb4ccc61: Status 404 returned error can't find the container with id 4c62f6147aa2cc91d1faa353e662467d877137ccaad191028169036eeb4ccc61
Jul 27 19:51:14.894226 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.894163    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx" event={"ID":"1b64d4fe-1c57-4689-8b27-351be6778469","Type":"ContainerStarted","Data":"25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c"}
Jul 27 19:51:14.894226 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.894230    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx" event={"ID":"1b64d4fe-1c57-4689-8b27-351be6778469","Type":"ContainerStarted","Data":"4bd59e457c568e511fe7ef4080ad30abb433326ce165c4a637259b9c9d4a82c0"}
Jul 27 19:51:14.894488 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.894335    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:14.896140 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.896114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm" event={"ID":"4751f556-3fa7-40e8-8db7-3abebc9928f9","Type":"ContainerStarted","Data":"bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2"}
Jul 27 19:51:14.896268 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.896151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm" event={"ID":"4751f556-3fa7-40e8-8db7-3abebc9928f9","Type":"ContainerStarted","Data":"4c62f6147aa2cc91d1faa353e662467d877137ccaad191028169036eeb4ccc61"}
Jul 27 19:51:14.896268 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.896211    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:14.897646 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.897620    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv" event={"ID":"1bcdea04-be25-4e6a-8519-15435259ed4a","Type":"ContainerStarted","Data":"4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc"}
Jul 27 19:51:14.897768 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.897664    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv" event={"ID":"1bcdea04-be25-4e6a-8519-15435259ed4a","Type":"ContainerStarted","Data":"283bdee5534c2c61135c86fbc9b8b78a348cf0e6953af3cd8fb7b65c723272f6"}
Jul 27 19:51:14.897768 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.897755    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:14.913290 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.913209    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx" podStartSLOduration=0.913193723 podStartE2EDuration="913.193723ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:51:14.911672401 +0000 UTC m=+2009.651228038" watchObservedRunningTime="2026-07-27 19:51:14.913193723 +0000 UTC m=+2009.652749330"
Jul 27 19:51:14.931067 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.931021    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv" podStartSLOduration=1.5398104849999998 podStartE2EDuration="1.931009605s" totalImagesPullingTime="391.19912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:51:14.929906721 +0000 UTC m=+2009.669462327" watchObservedRunningTime="2026-07-27 19:51:14.931009605 +0000 UTC m=+2009.670565214"
Jul 27 19:51:14.952454 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:14.952415    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm" podStartSLOduration=0.952406294 podStartE2EDuration="952.406294ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:51:14.950995129 +0000 UTC m=+2009.690550733" watchObservedRunningTime="2026-07-27 19:51:14.952406294 +0000 UTC m=+2009.691961929"
Jul 27 19:51:17.577960 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:17.577928    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:18.273724 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:18.273693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:51:20.907172 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:20.907147    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:51:25.904028 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:25.903998    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:51:25.904465 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:25.904071    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:51:38.295744 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:38.295713    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:41.671696 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:41.671658    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:51:46.246836 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:46.246798    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:59.971198 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:51:59.971157    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:52:21.481829 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:21.481792    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:52:22.781354 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:22.781323    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"]
Jul 27 19:52:22.781836 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:22.781599    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv" podUID="1bcdea04-be25-4e6a-8519-15435259ed4a" containerName="maas-api" containerID="cri-o://4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc" gracePeriod=30
Jul 27 19:52:22.831876 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:22.831846    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:52:22.858469 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:22.858437    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"]
Jul 27 19:52:22.858747 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:22.858693    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm" podUID="4751f556-3fa7-40e8-8db7-3abebc9928f9" containerName="payload-processing" containerID="cri-o://bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2" gracePeriod=30
Jul 27 19:52:22.866525 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:22.865983    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"]
Jul 27 19:52:22.866525 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:22.866191    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx" podUID="1b64d4fe-1c57-4689-8b27-351be6778469" containerName="payload-pre-processing" containerID="cri-o://25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c" gracePeriod=30
Jul 27 19:52:22.964353 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:22.964316    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:52:23.133368 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.133348    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:52:23.148703 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.148673    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:52:23.158364 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.158346    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:52:23.196885 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.196846    2558 generic.go:356] "Generic (PLEG): container finished" podID="1b64d4fe-1c57-4689-8b27-351be6778469" containerID="25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c" exitCode=0
Jul 27 19:52:23.196885 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.196873    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"
Jul 27 19:52:23.197093 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.196899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx" event={"ID":"1b64d4fe-1c57-4689-8b27-351be6778469","Type":"ContainerDied","Data":"25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c"}
Jul 27 19:52:23.197093 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.196946    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx" event={"ID":"1b64d4fe-1c57-4689-8b27-351be6778469","Type":"ContainerDied","Data":"4bd59e457c568e511fe7ef4080ad30abb433326ce165c4a637259b9c9d4a82c0"}
Jul 27 19:52:23.197093 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.196976    2558 scope.go:117] "RemoveContainer" containerID="25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c"
Jul 27 19:52:23.201337 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.201318    2558 generic.go:356] "Generic (PLEG): container finished" podID="4751f556-3fa7-40e8-8db7-3abebc9928f9" containerID="bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2" exitCode=0
Jul 27 19:52:23.201440 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.201350    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm" event={"ID":"4751f556-3fa7-40e8-8db7-3abebc9928f9","Type":"ContainerDied","Data":"bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2"}
Jul 27 19:52:23.201440 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.201384    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"
Jul 27 19:52:23.201440 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.201397    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm" event={"ID":"4751f556-3fa7-40e8-8db7-3abebc9928f9","Type":"ContainerDied","Data":"4c62f6147aa2cc91d1faa353e662467d877137ccaad191028169036eeb4ccc61"}
Jul 27 19:52:23.203250 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.203231    2558 generic.go:356] "Generic (PLEG): container finished" podID="1bcdea04-be25-4e6a-8519-15435259ed4a" containerID="4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc" exitCode=0
Jul 27 19:52:23.203397 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.203280    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"
Jul 27 19:52:23.203397 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.203331    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv" event={"ID":"1bcdea04-be25-4e6a-8519-15435259ed4a","Type":"ContainerDied","Data":"4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc"}
Jul 27 19:52:23.203397 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.203381    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv" event={"ID":"1bcdea04-be25-4e6a-8519-15435259ed4a","Type":"ContainerDied","Data":"283bdee5534c2c61135c86fbc9b8b78a348cf0e6953af3cd8fb7b65c723272f6"}
Jul 27 19:52:23.210161 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.210145    2558 scope.go:117] "RemoveContainer" containerID="25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c"
Jul 27 19:52:23.210456 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:52:23.210437    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c\": container with ID starting with 25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c not found: ID does not exist" containerID="25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c"
Jul 27 19:52:23.210585 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.210464    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c"} err="failed to get container status \"25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c\": rpc error: code = NotFound desc = could not find container \"25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c\": container with ID starting with 25a4464e143c54c107a01aa99abd1e8d279ac74b6067517f0f9310180767b52c not found: ID does not exist"
Jul 27 19:52:23.210585 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.210480    2558 scope.go:117] "RemoveContainer" containerID="bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2"
Jul 27 19:52:23.218065 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.218045    2558 scope.go:117] "RemoveContainer" containerID="bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2"
Jul 27 19:52:23.218309 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:52:23.218289    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2\": container with ID starting with bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2 not found: ID does not exist" containerID="bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2"
Jul 27 19:52:23.218357 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.218315    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2"} err="failed to get container status \"bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2\": rpc error: code = NotFound desc = could not find container \"bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2\": container with ID starting with bfadf73a8a195e8a6434f5a55b3ade70f071f5c07e416a8c66bd12e001a450b2 not found: ID does not exist"
Jul 27 19:52:23.218357 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.218330    2558 scope.go:117] "RemoveContainer" containerID="4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc"
Jul 27 19:52:23.225259 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.225243    2558 scope.go:117] "RemoveContainer" containerID="4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc"
Jul 27 19:52:23.225493 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:52:23.225474    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc\": container with ID starting with 4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc not found: ID does not exist" containerID="4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc"
Jul 27 19:52:23.225578 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.225512    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc"} err="failed to get container status \"4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc\": rpc error: code = NotFound desc = could not find container \"4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc\": container with ID starting with 4bb70d79af33208112d7f157b88378b531467aeffcb0a6866172a7deeb1e88bc not found: ID does not exist"
Jul 27 19:52:23.244811 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.244788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b64d4fe-1c57-4689-8b27-351be6778469-plugins-config-volume\") pod \"1b64d4fe-1c57-4689-8b27-351be6778469\" (UID: \"1b64d4fe-1c57-4689-8b27-351be6778469\") "
Jul 27 19:52:23.244897 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.244849    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls\") pod \"1bcdea04-be25-4e6a-8519-15435259ed4a\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") "
Jul 27 19:52:23.244897 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.244866    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cghcw\" (UniqueName: \"kubernetes.io/projected/4751f556-3fa7-40e8-8db7-3abebc9928f9-kube-api-access-cghcw\") pod \"4751f556-3fa7-40e8-8db7-3abebc9928f9\" (UID: \"4751f556-3fa7-40e8-8db7-3abebc9928f9\") "
Jul 27 19:52:23.244897 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.244892    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcdea04-be25-4e6a-8519-15435259ed4a-openshift-service-ca\") pod \"1bcdea04-be25-4e6a-8519-15435259ed4a\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") "
Jul 27 19:52:23.245063 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.244910    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggrpj\" (UniqueName: \"kubernetes.io/projected/1bcdea04-be25-4e6a-8519-15435259ed4a-kube-api-access-ggrpj\") pod \"1bcdea04-be25-4e6a-8519-15435259ed4a\" (UID: \"1bcdea04-be25-4e6a-8519-15435259ed4a\") "
Jul 27 19:52:23.245063 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.244929    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rm4n\" (UniqueName: \"kubernetes.io/projected/1b64d4fe-1c57-4689-8b27-351be6778469-kube-api-access-6rm4n\") pod \"1b64d4fe-1c57-4689-8b27-351be6778469\" (UID: \"1b64d4fe-1c57-4689-8b27-351be6778469\") "
Jul 27 19:52:23.245063 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.245029    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4751f556-3fa7-40e8-8db7-3abebc9928f9-plugins-config-volume\") pod \"4751f556-3fa7-40e8-8db7-3abebc9928f9\" (UID: \"4751f556-3fa7-40e8-8db7-3abebc9928f9\") "
Jul 27 19:52:23.245254 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.245233    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b64d4fe-1c57-4689-8b27-351be6778469-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b64d4fe-1c57-4689-8b27-351be6778469" (UID: "1b64d4fe-1c57-4689-8b27-351be6778469"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:52:23.245342 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.245276    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcdea04-be25-4e6a-8519-15435259ed4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bcdea04-be25-4e6a-8519-15435259ed4a" (UID: "1bcdea04-be25-4e6a-8519-15435259ed4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:52:23.245342 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.245332    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b64d4fe-1c57-4689-8b27-351be6778469-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:52:23.245470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.245443    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4751f556-3fa7-40e8-8db7-3abebc9928f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4751f556-3fa7-40e8-8db7-3abebc9928f9" (UID: "4751f556-3fa7-40e8-8db7-3abebc9928f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:52:23.246989 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.246966    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b64d4fe-1c57-4689-8b27-351be6778469-kube-api-access-6rm4n" (OuterVolumeSpecName: "kube-api-access-6rm4n") pod "1b64d4fe-1c57-4689-8b27-351be6778469" (UID: "1b64d4fe-1c57-4689-8b27-351be6778469"). InnerVolumeSpecName "kube-api-access-6rm4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:52:23.247075 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.247054    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bcdea04-be25-4e6a-8519-15435259ed4a" (UID: "1bcdea04-be25-4e6a-8519-15435259ed4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:52:23.247390 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.247364    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4751f556-3fa7-40e8-8db7-3abebc9928f9-kube-api-access-cghcw" (OuterVolumeSpecName: "kube-api-access-cghcw") pod "4751f556-3fa7-40e8-8db7-3abebc9928f9" (UID: "4751f556-3fa7-40e8-8db7-3abebc9928f9"). InnerVolumeSpecName "kube-api-access-cghcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:52:23.247390 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.247375    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bcdea04-be25-4e6a-8519-15435259ed4a-kube-api-access-ggrpj" (OuterVolumeSpecName: "kube-api-access-ggrpj") pod "1bcdea04-be25-4e6a-8519-15435259ed4a" (UID: "1bcdea04-be25-4e6a-8519-15435259ed4a"). InnerVolumeSpecName "kube-api-access-ggrpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:52:23.346111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.346017    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bcdea04-be25-4e6a-8519-15435259ed4a-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:52:23.346111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.346060    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cghcw\" (UniqueName: \"kubernetes.io/projected/4751f556-3fa7-40e8-8db7-3abebc9928f9-kube-api-access-cghcw\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:52:23.346111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.346072    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcdea04-be25-4e6a-8519-15435259ed4a-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:52:23.346111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.346081    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggrpj\" (UniqueName: \"kubernetes.io/projected/1bcdea04-be25-4e6a-8519-15435259ed4a-kube-api-access-ggrpj\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:52:23.346111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.346089    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rm4n\" (UniqueName: \"kubernetes.io/projected/1b64d4fe-1c57-4689-8b27-351be6778469-kube-api-access-6rm4n\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:52:23.346111 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.346100    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4751f556-3fa7-40e8-8db7-3abebc9928f9-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:52:23.522299 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.522266    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"]
Jul 27 19:52:23.531487 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.531457    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx"]
Jul 27 19:52:23.548710 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.548682    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"]
Jul 27 19:52:23.550821 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.550800    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef75af22-84cbc748d5-pqqvv"]
Jul 27 19:52:23.571963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.571940    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"]
Jul 27 19:52:23.578826 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.578801    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm"]
Jul 27 19:52:23.823418 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.823375    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b64d4fe-1c57-4689-8b27-351be6778469" path="/var/lib/kubelet/pods/1b64d4fe-1c57-4689-8b27-351be6778469/volumes"
Jul 27 19:52:23.823974 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.823954    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bcdea04-be25-4e6a-8519-15435259ed4a" path="/var/lib/kubelet/pods/1bcdea04-be25-4e6a-8519-15435259ed4a/volumes"
Jul 27 19:52:23.824333 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:23.824315    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4751f556-3fa7-40e8-8db7-3abebc9928f9" path="/var/lib/kubelet/pods/4751f556-3fa7-40e8-8db7-3abebc9928f9/volumes"
Jul 27 19:52:27.280938 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:27.280904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:52:30.287715 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:30.287681    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:52:30.448261 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:30.448233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:52:35.480306 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:52:35.480271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:04.435967 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:04.435935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:12.162275 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:12.162222    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:13.177261 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:13.177227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:19.682075 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:19.682020    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:25.553546 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:25.553493    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:25.664735 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:25.664697    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:25.820029 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:25.819926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:26.059644 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:26.059607    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:29.779142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:29.779113    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:53:33.594398 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:33.594365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:35.553875 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:35.553836    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:35.666533 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:35.666482    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:36.255110 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:36.255065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:42.543080 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:42.543049    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:42.597815 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:42.597779    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:53:42.766680 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:42.766645    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:42.896047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:42.895970    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:53.237183 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:53.237147    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:53.486157 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:53:53.486120    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:14.408440 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:14.408406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:21.901830 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:21.901796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:22.005156 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:22.005129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:22.278230 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:22.278195    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:22.614339 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:22.614257    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:23.030607 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:23.030576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:25.284436 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.284397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:25.411728 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.411690    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:25.486106 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.486074    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"]
Jul 27 19:54:25.487047 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487019    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bcdea04-be25-4e6a-8519-15435259ed4a" containerName="maas-api"
Jul 27 19:54:25.487192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487181    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bcdea04-be25-4e6a-8519-15435259ed4a" containerName="maas-api"
Jul 27 19:54:25.487312 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487301    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4751f556-3fa7-40e8-8db7-3abebc9928f9" containerName="payload-processing"
Jul 27 19:54:25.487388 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487379    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4751f556-3fa7-40e8-8db7-3abebc9928f9" containerName="payload-processing"
Jul 27 19:54:25.487528 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487517    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b64d4fe-1c57-4689-8b27-351be6778469" containerName="payload-pre-processing"
Jul 27 19:54:25.487610 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487601    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b64d4fe-1c57-4689-8b27-351be6778469" containerName="payload-pre-processing"
Jul 27 19:54:25.487825 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487813    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bcdea04-be25-4e6a-8519-15435259ed4a" containerName="maas-api"
Jul 27 19:54:25.487906 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487896    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4751f556-3fa7-40e8-8db7-3abebc9928f9" containerName="payload-processing"
Jul 27 19:54:25.487983 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.487974    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b64d4fe-1c57-4689-8b27-351be6778469" containerName="payload-pre-processing"
Jul 27 19:54:25.491667 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.491644    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.494305 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.494272    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7bbd07-serving-cert\""
Jul 27 19:54:25.494409 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.494284    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:54:25.494409 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.494342    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:54:25.494956 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.494942    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:54:25.500443 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.500421    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"]
Jul 27 19:54:25.551027 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.550953    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.551027 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.550990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsqnx\" (UniqueName: \"kubernetes.io/projected/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-kube-api-access-vsqnx\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.551027 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.551017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.591704 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.591674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:25.651836 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.651804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.651993 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.651845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsqnx\" (UniqueName: \"kubernetes.io/projected/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-kube-api-access-vsqnx\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.651993 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.651868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.651993 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:54:25.651972    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-serving-cert: secret "maas-api-e2e-inf-a-7bbd07-serving-cert" not found
Jul 27 19:54:25.652143 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:54:25.652065    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls podName:5bc45eae-7e30-4e75-9578-f4717f0dc9ad nodeName:}" failed. No retries permitted until 2026-07-27 19:54:26.152040556 +0000 UTC m=+2200.891596141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls") pod "maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479" (UID: "5bc45eae-7e30-4e75-9578-f4717f0dc9ad") : secret "maas-api-e2e-inf-a-7bbd07-serving-cert" not found
Jul 27 19:54:25.652491 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.652473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.660945 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.660924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsqnx\" (UniqueName: \"kubernetes.io/projected/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-kube-api-access-vsqnx\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:25.836125 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:25.836042    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:26.094804 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.094716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:26.156372 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.156334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:26.158797 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.158769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls\") pod \"maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:26.182081 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.182049    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"]
Jul 27 19:54:26.185461 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.185446    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:26.190159 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.190143    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-7bbd07\""
Jul 27 19:54:26.190656 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.190642    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-7bbd07-dockercfg-95f6s\""
Jul 27 19:54:26.204460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.204433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"]
Jul 27 19:54:26.224927 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.224899    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"]
Jul 27 19:54:26.228032 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.228014    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:26.236952 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.236927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:26.240360 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.240339    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"]
Jul 27 19:54:26.256916 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.256882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9\" (UID: \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:26.257118 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.256940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgwm5\" (UniqueName: \"kubernetes.io/projected/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-kube-api-access-pgwm5\") pod \"payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9\" (UID: \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:26.358255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.358171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9\" (UID: \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:26.358255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.358226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgwm5\" (UniqueName: \"kubernetes.io/projected/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-kube-api-access-pgwm5\") pod \"payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9\" (UID: \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:26.358255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.358251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4mfj\" (UniqueName: \"kubernetes.io/projected/17a13d42-fe7d-49ba-8d7b-57e20080e19f-kube-api-access-g4mfj\") pod \"payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl\" (UID: \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:26.358718 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.358276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a13d42-fe7d-49ba-8d7b-57e20080e19f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl\" (UID: \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:26.359041 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.359023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9\" (UID: \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:26.367961 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.367936    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgwm5\" (UniqueName: \"kubernetes.io/projected/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-kube-api-access-pgwm5\") pod \"payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9\" (UID: \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:26.402837 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.402803    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:26.458925 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.458893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4mfj\" (UniqueName: \"kubernetes.io/projected/17a13d42-fe7d-49ba-8d7b-57e20080e19f-kube-api-access-g4mfj\") pod \"payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl\" (UID: \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:26.459088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.458945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a13d42-fe7d-49ba-8d7b-57e20080e19f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl\" (UID: \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:26.459654 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.459635    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a13d42-fe7d-49ba-8d7b-57e20080e19f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl\" (UID: \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:26.470729 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.470702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4mfj\" (UniqueName: \"kubernetes.io/projected/17a13d42-fe7d-49ba-8d7b-57e20080e19f-kube-api-access-g4mfj\") pod \"payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl\" (UID: \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:26.495838 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.495809    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:26.534163 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.534139    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"]
Jul 27 19:54:26.537136 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:54:26.537102    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc45eae_7e30_4e75_9578_f4717f0dc9ad.slice/crio-4b4cfbb95542cc8ec0d2d0c9a3e01377b3f25b7d5e3fc03e252727377d7a8f81 WatchSource:0}: Error finding container 4b4cfbb95542cc8ec0d2d0c9a3e01377b3f25b7d5e3fc03e252727377d7a8f81: Status 404 returned error can't find the container with id 4b4cfbb95542cc8ec0d2d0c9a3e01377b3f25b7d5e3fc03e252727377d7a8f81
Jul 27 19:54:26.538409 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.538325    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:26.636966 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.636926    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"]
Jul 27 19:54:26.640426 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:54:26.640396    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe34dfa_42e3_43c1_9a68_f17a0d87301f.slice/crio-ca8105a53c20df76c68737a4b9c38e7be42c44b0148ac1c0c76a154cdd4e6232 WatchSource:0}: Error finding container ca8105a53c20df76c68737a4b9c38e7be42c44b0148ac1c0c76a154cdd4e6232: Status 404 returned error can't find the container with id ca8105a53c20df76c68737a4b9c38e7be42c44b0148ac1c0c76a154cdd4e6232
Jul 27 19:54:26.681920 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.681891    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"]
Jul 27 19:54:26.687577 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:54:26.687547    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a13d42_fe7d_49ba_8d7b_57e20080e19f.slice/crio-ba606b524e3ac921c7d15e21f88f95c20df2b8880e4e20c81b522145066a6453 WatchSource:0}: Error finding container ba606b524e3ac921c7d15e21f88f95c20df2b8880e4e20c81b522145066a6453: Status 404 returned error can't find the container with id ba606b524e3ac921c7d15e21f88f95c20df2b8880e4e20c81b522145066a6453
Jul 27 19:54:26.715860 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.715679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9" event={"ID":"cbe34dfa-42e3-43c1-9a68-f17a0d87301f","Type":"ContainerStarted","Data":"ca8105a53c20df76c68737a4b9c38e7be42c44b0148ac1c0c76a154cdd4e6232"}
Jul 27 19:54:26.717201 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.717147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl" event={"ID":"17a13d42-fe7d-49ba-8d7b-57e20080e19f","Type":"ContainerStarted","Data":"ba606b524e3ac921c7d15e21f88f95c20df2b8880e4e20c81b522145066a6453"}
Jul 27 19:54:26.718625 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:26.718493    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479" event={"ID":"5bc45eae-7e30-4e75-9578-f4717f0dc9ad","Type":"ContainerStarted","Data":"4b4cfbb95542cc8ec0d2d0c9a3e01377b3f25b7d5e3fc03e252727377d7a8f81"}
Jul 27 19:54:27.724694 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.724647    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9" event={"ID":"cbe34dfa-42e3-43c1-9a68-f17a0d87301f","Type":"ContainerStarted","Data":"9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4"}
Jul 27 19:54:27.725255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.724725    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:27.726237 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.726209    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl" event={"ID":"17a13d42-fe7d-49ba-8d7b-57e20080e19f","Type":"ContainerStarted","Data":"b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106"}
Jul 27 19:54:27.726374 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.726289    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:27.727633 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.727606    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479" event={"ID":"5bc45eae-7e30-4e75-9578-f4717f0dc9ad","Type":"ContainerStarted","Data":"9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5"}
Jul 27 19:54:27.727774 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.727753    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:27.744807 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.744763    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9" podStartSLOduration=1.744749286 podStartE2EDuration="1.744749286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:27.743204551 +0000 UTC m=+2202.482760157" watchObservedRunningTime="2026-07-27 19:54:27.744749286 +0000 UTC m=+2202.484304868"
Jul 27 19:54:27.759086 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.759032    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479" podStartSLOduration=2.394986685 podStartE2EDuration="2.759015287s" totalImagesPullingTime="364.028602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:27.758718662 +0000 UTC m=+2202.498274268" watchObservedRunningTime="2026-07-27 19:54:27.759015287 +0000 UTC m=+2202.498570892"
Jul 27 19:54:27.774805 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:27.774764    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl" podStartSLOduration=1.774750064 podStartE2EDuration="1.774750064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:27.773640681 +0000 UTC m=+2202.513196289" watchObservedRunningTime="2026-07-27 19:54:27.774750064 +0000 UTC m=+2202.514305672"
Jul 27 19:54:29.782801 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:29.782767    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:30.092644 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:30.092566    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:30.417151 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:30.417074    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:30.688382 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:30.688351    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:31.505942 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:31.505910    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:54:33.451872 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.451840    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"]
Jul 27 19:54:33.455988 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.455969    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.458231 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.458209    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4ce65d-serving-cert\""
Jul 27 19:54:33.466220 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.466198    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"]
Jul 27 19:54:33.513140 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.513111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.513268 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.513142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d50a32-eb3d-4a27-a04a-d199158be707-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.513268 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.513168    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv7mh\" (UniqueName: \"kubernetes.io/projected/a2d50a32-eb3d-4a27-a04a-d199158be707-kube-api-access-cv7mh\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.613985 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.613952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.613985 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.613991    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d50a32-eb3d-4a27-a04a-d199158be707-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.614175 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.614010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv7mh\" (UniqueName: \"kubernetes.io/projected/a2d50a32-eb3d-4a27-a04a-d199158be707-kube-api-access-cv7mh\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.614175 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:54:33.614110    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-serving-cert: secret "maas-api-e2e-inf-b-4ce65d-serving-cert" not found
Jul 27 19:54:33.614247 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:54:33.614180    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls podName:a2d50a32-eb3d-4a27-a04a-d199158be707 nodeName:}" failed. No retries permitted until 2026-07-27 19:54:34.114159528 +0000 UTC m=+2208.853715126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls") pod "maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w" (UID: "a2d50a32-eb3d-4a27-a04a-d199158be707") : secret "maas-api-e2e-inf-b-4ce65d-serving-cert" not found
Jul 27 19:54:33.614738 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.614722    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d50a32-eb3d-4a27-a04a-d199158be707-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.627043 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.627020    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv7mh\" (UniqueName: \"kubernetes.io/projected/a2d50a32-eb3d-4a27-a04a-d199158be707-kube-api-access-cv7mh\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:33.737313 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:33.737248    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:54:34.119002 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.118918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:34.121372 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.121345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls\") pod \"maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:34.367242 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.367206    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:34.379770 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.379744    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"]
Jul 27 19:54:34.383206 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.383180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:34.385782 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.385756    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-4ce65d\""
Jul 27 19:54:34.385928 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.385763    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-4ce65d-dockercfg-lt85s\""
Jul 27 19:54:34.393267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.393236    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"]
Jul 27 19:54:34.469548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.463890    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"]
Jul 27 19:54:34.474097 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.474064    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"]
Jul 27 19:54:34.474319 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.474185    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:34.513443 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.513420    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"]
Jul 27 19:54:34.516014 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:54:34.515990    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d50a32_eb3d_4a27_a04a_d199158be707.slice/crio-615d5776b00f5da0ddb4d9e1db9dcabb8c2062686f9f2d5b62e36c08c4a4fc38 WatchSource:0}: Error finding container 615d5776b00f5da0ddb4d9e1db9dcabb8c2062686f9f2d5b62e36c08c4a4fc38: Status 404 returned error can't find the container with id 615d5776b00f5da0ddb4d9e1db9dcabb8c2062686f9f2d5b62e36c08c4a4fc38
Jul 27 19:54:34.523523 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.523475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq9qp\" (UniqueName: \"kubernetes.io/projected/b4cb7225-d212-46a9-9dac-816fb2f854ce-kube-api-access-dq9qp\") pod \"payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q\" (UID: \"b4cb7225-d212-46a9-9dac-816fb2f854ce\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:34.523640 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.523551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89dd2140-da13-4a04-bdaa-fdc701781e12-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw\" (UID: \"89dd2140-da13-4a04-bdaa-fdc701781e12\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:34.523640 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.523611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hch6d\" (UniqueName: \"kubernetes.io/projected/89dd2140-da13-4a04-bdaa-fdc701781e12-kube-api-access-hch6d\") pod \"payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw\" (UID: \"89dd2140-da13-4a04-bdaa-fdc701781e12\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:34.523745 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.523651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4cb7225-d212-46a9-9dac-816fb2f854ce-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q\" (UID: \"b4cb7225-d212-46a9-9dac-816fb2f854ce\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:34.566576 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.566546    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:34.624166 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.624075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hch6d\" (UniqueName: \"kubernetes.io/projected/89dd2140-da13-4a04-bdaa-fdc701781e12-kube-api-access-hch6d\") pod \"payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw\" (UID: \"89dd2140-da13-4a04-bdaa-fdc701781e12\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:34.624166 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.624118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4cb7225-d212-46a9-9dac-816fb2f854ce-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q\" (UID: \"b4cb7225-d212-46a9-9dac-816fb2f854ce\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:34.624407 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.624193    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq9qp\" (UniqueName: \"kubernetes.io/projected/b4cb7225-d212-46a9-9dac-816fb2f854ce-kube-api-access-dq9qp\") pod \"payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q\" (UID: \"b4cb7225-d212-46a9-9dac-816fb2f854ce\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:34.624407 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.624242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89dd2140-da13-4a04-bdaa-fdc701781e12-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw\" (UID: \"89dd2140-da13-4a04-bdaa-fdc701781e12\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:34.624957 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.624932    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4cb7225-d212-46a9-9dac-816fb2f854ce-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q\" (UID: \"b4cb7225-d212-46a9-9dac-816fb2f854ce\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:34.625052 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.624963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89dd2140-da13-4a04-bdaa-fdc701781e12-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw\" (UID: \"89dd2140-da13-4a04-bdaa-fdc701781e12\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:34.632629 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.632599    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq9qp\" (UniqueName: \"kubernetes.io/projected/b4cb7225-d212-46a9-9dac-816fb2f854ce-kube-api-access-dq9qp\") pod \"payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q\" (UID: \"b4cb7225-d212-46a9-9dac-816fb2f854ce\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:34.632770 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.632755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hch6d\" (UniqueName: \"kubernetes.io/projected/89dd2140-da13-4a04-bdaa-fdc701781e12-kube-api-access-hch6d\") pod \"payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw\" (UID: \"89dd2140-da13-4a04-bdaa-fdc701781e12\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:34.696007 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.695975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:34.702918 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.702895    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:34.758876 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.758846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w" event={"ID":"a2d50a32-eb3d-4a27-a04a-d199158be707","Type":"ContainerStarted","Data":"615d5776b00f5da0ddb4d9e1db9dcabb8c2062686f9f2d5b62e36c08c4a4fc38"}
Jul 27 19:54:34.786876 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.786852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:34.850983 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.850959    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"]
Jul 27 19:54:34.853448 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:54:34.853423    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89dd2140_da13_4a04_bdaa_fdc701781e12.slice/crio-861f06993919ea09c6d446daf556777f19bd9e93331431e833eb4b8d531d5274 WatchSource:0}: Error finding container 861f06993919ea09c6d446daf556777f19bd9e93331431e833eb4b8d531d5274: Status 404 returned error can't find the container with id 861f06993919ea09c6d446daf556777f19bd9e93331431e833eb4b8d531d5274
Jul 27 19:54:34.938619 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:34.938589    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"]
Jul 27 19:54:34.942332 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:54:34.942290    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cb7225_d212_46a9_9dac_816fb2f854ce.slice/crio-15c3b6da39bdbed37cc9715f14b619a3ddcf6cd6d6ad8fab3e2eefae694ece67 WatchSource:0}: Error finding container 15c3b6da39bdbed37cc9715f14b619a3ddcf6cd6d6ad8fab3e2eefae694ece67: Status 404 returned error can't find the container with id 15c3b6da39bdbed37cc9715f14b619a3ddcf6cd6d6ad8fab3e2eefae694ece67
Jul 27 19:54:35.766606 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.766570    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w" event={"ID":"a2d50a32-eb3d-4a27-a04a-d199158be707","Type":"ContainerStarted","Data":"1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22"}
Jul 27 19:54:35.767108 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.767087    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:35.768181 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.768151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw" event={"ID":"89dd2140-da13-4a04-bdaa-fdc701781e12","Type":"ContainerStarted","Data":"98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600"}
Jul 27 19:54:35.768298 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.768196    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:35.768298 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.768211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw" event={"ID":"89dd2140-da13-4a04-bdaa-fdc701781e12","Type":"ContainerStarted","Data":"861f06993919ea09c6d446daf556777f19bd9e93331431e833eb4b8d531d5274"}
Jul 27 19:54:35.769530 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.769484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q" event={"ID":"b4cb7225-d212-46a9-9dac-816fb2f854ce","Type":"ContainerStarted","Data":"b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03"}
Jul 27 19:54:35.769604 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.769538    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q" event={"ID":"b4cb7225-d212-46a9-9dac-816fb2f854ce","Type":"ContainerStarted","Data":"15c3b6da39bdbed37cc9715f14b619a3ddcf6cd6d6ad8fab3e2eefae694ece67"}
Jul 27 19:54:35.769604 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.769565    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:35.787938 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.787893    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w" podStartSLOduration=2.437428544 podStartE2EDuration="2.787877524s" totalImagesPullingTime="350.44898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:35.785944962 +0000 UTC m=+2210.525500580" watchObservedRunningTime="2026-07-27 19:54:35.787877524 +0000 UTC m=+2210.527433128"
Jul 27 19:54:35.804333 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.804291    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw" podStartSLOduration=1.804278761 podStartE2EDuration="1.804278761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:35.802364482 +0000 UTC m=+2210.541920086" watchObservedRunningTime="2026-07-27 19:54:35.804278761 +0000 UTC m=+2210.543834366"
Jul 27 19:54:35.823973 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:35.823929    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q" podStartSLOduration=1.823916337 podStartE2EDuration="1.823916337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:35.823320987 +0000 UTC m=+2210.562876593" watchObservedRunningTime="2026-07-27 19:54:35.823916337 +0000 UTC m=+2210.563471942"
Jul 27 19:54:37.876924 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:37.876841    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:38.734077 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:38.734045    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:54:38.734275 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:38.734253    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:54:41.780493 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:41.780465    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:54:46.776847 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:46.776814    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:54:46.777330 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:46.776970    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:54:47.971089 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:54:47.971057    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:55:01.875978 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:55:01.875941    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:05.069158 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:55:05.069122    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:55:17.121724 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:55:17.121685    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:55:23.129130 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:55:23.129095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:29.084297 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:55:29.084259    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:56:02.661209 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:02.661165    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:03.740730 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:03.740702    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:07.881775 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:07.881732    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:56:11.432985 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:11.432948    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:14.246401 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.246369    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"]
Jul 27 19:56:14.246797 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.246577    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479" podUID="5bc45eae-7e30-4e75-9578-f4717f0dc9ad" containerName="maas-api" containerID="cri-o://9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5" gracePeriod=30
Jul 27 19:56:14.324579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.324543    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"]
Jul 27 19:56:14.324833 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.324797    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl" podUID="17a13d42-fe7d-49ba-8d7b-57e20080e19f" containerName="payload-processing" containerID="cri-o://b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106" gracePeriod=30
Jul 27 19:56:14.329663 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.329603    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"]
Jul 27 19:56:14.329949 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.329864    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9" podUID="cbe34dfa-42e3-43c1-9a68-f17a0d87301f" containerName="payload-pre-processing" containerID="cri-o://9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4" gracePeriod=30
Jul 27 19:56:14.427094 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.427062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:14.572883 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.572857    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:56:14.574417 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.574378    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:14.602199 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.602171    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:56:14.613755 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.613732    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:56:14.678584 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.678551    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-plugins-config-volume\") pod \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\" (UID: \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\") "
Jul 27 19:56:14.678769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.678593    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsqnx\" (UniqueName: \"kubernetes.io/projected/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-kube-api-access-vsqnx\") pod \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") "
Jul 27 19:56:14.678769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.678618    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgwm5\" (UniqueName: \"kubernetes.io/projected/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-kube-api-access-pgwm5\") pod \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\" (UID: \"cbe34dfa-42e3-43c1-9a68-f17a0d87301f\") "
Jul 27 19:56:14.678769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.678650    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4mfj\" (UniqueName: \"kubernetes.io/projected/17a13d42-fe7d-49ba-8d7b-57e20080e19f-kube-api-access-g4mfj\") pod \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\" (UID: \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\") "
Jul 27 19:56:14.678769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.678700    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls\") pod \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") "
Jul 27 19:56:14.678769 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.678742    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-openshift-service-ca\") pod \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\" (UID: \"5bc45eae-7e30-4e75-9578-f4717f0dc9ad\") "
Jul 27 19:56:14.679054 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.678784    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a13d42-fe7d-49ba-8d7b-57e20080e19f-plugins-config-volume\") pod \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\" (UID: \"17a13d42-fe7d-49ba-8d7b-57e20080e19f\") "
Jul 27 19:56:14.679314 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.679284    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5bc45eae-7e30-4e75-9578-f4717f0dc9ad" (UID: "5bc45eae-7e30-4e75-9578-f4717f0dc9ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:14.679420 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.679341    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a13d42-fe7d-49ba-8d7b-57e20080e19f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17a13d42-fe7d-49ba-8d7b-57e20080e19f" (UID: "17a13d42-fe7d-49ba-8d7b-57e20080e19f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:14.679420 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.679407    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbe34dfa-42e3-43c1-9a68-f17a0d87301f" (UID: "cbe34dfa-42e3-43c1-9a68-f17a0d87301f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:14.680819 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.680790    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-kube-api-access-pgwm5" (OuterVolumeSpecName: "kube-api-access-pgwm5") pod "cbe34dfa-42e3-43c1-9a68-f17a0d87301f" (UID: "cbe34dfa-42e3-43c1-9a68-f17a0d87301f"). InnerVolumeSpecName "kube-api-access-pgwm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:14.680921 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.680831    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-kube-api-access-vsqnx" (OuterVolumeSpecName: "kube-api-access-vsqnx") pod "5bc45eae-7e30-4e75-9578-f4717f0dc9ad" (UID: "5bc45eae-7e30-4e75-9578-f4717f0dc9ad"). InnerVolumeSpecName "kube-api-access-vsqnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:14.681131 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.681109    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a13d42-fe7d-49ba-8d7b-57e20080e19f-kube-api-access-g4mfj" (OuterVolumeSpecName: "kube-api-access-g4mfj") pod "17a13d42-fe7d-49ba-8d7b-57e20080e19f" (UID: "17a13d42-fe7d-49ba-8d7b-57e20080e19f"). InnerVolumeSpecName "kube-api-access-g4mfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:14.681131 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.681114    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5bc45eae-7e30-4e75-9578-f4717f0dc9ad" (UID: "5bc45eae-7e30-4e75-9578-f4717f0dc9ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:56:14.780255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.780174    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:14.780255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.780201    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:14.780255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.780214    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a13d42-fe7d-49ba-8d7b-57e20080e19f-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:14.780255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.780222    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:14.780255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.780231    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsqnx\" (UniqueName: \"kubernetes.io/projected/5bc45eae-7e30-4e75-9578-f4717f0dc9ad-kube-api-access-vsqnx\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:14.780255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.780240    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgwm5\" (UniqueName: \"kubernetes.io/projected/cbe34dfa-42e3-43c1-9a68-f17a0d87301f-kube-api-access-pgwm5\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:14.780255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:14.780248    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4mfj\" (UniqueName: \"kubernetes.io/projected/17a13d42-fe7d-49ba-8d7b-57e20080e19f-kube-api-access-g4mfj\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:15.195888 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.195859    2558 generic.go:356] "Generic (PLEG): container finished" podID="cbe34dfa-42e3-43c1-9a68-f17a0d87301f" containerID="9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4" exitCode=0
Jul 27 19:56:15.196057 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.195904    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"
Jul 27 19:56:15.196057 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.195955    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9" event={"ID":"cbe34dfa-42e3-43c1-9a68-f17a0d87301f","Type":"ContainerDied","Data":"9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4"}
Jul 27 19:56:15.196057 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.196003    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9" event={"ID":"cbe34dfa-42e3-43c1-9a68-f17a0d87301f","Type":"ContainerDied","Data":"ca8105a53c20df76c68737a4b9c38e7be42c44b0148ac1c0c76a154cdd4e6232"}
Jul 27 19:56:15.196057 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.196031    2558 scope.go:117] "RemoveContainer" containerID="9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4"
Jul 27 19:56:15.197186 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.197154    2558 generic.go:356] "Generic (PLEG): container finished" podID="17a13d42-fe7d-49ba-8d7b-57e20080e19f" containerID="b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106" exitCode=0
Jul 27 19:56:15.197307 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.197194    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"
Jul 27 19:56:15.197307 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.197232    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl" event={"ID":"17a13d42-fe7d-49ba-8d7b-57e20080e19f","Type":"ContainerDied","Data":"b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106"}
Jul 27 19:56:15.197307 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.197278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl" event={"ID":"17a13d42-fe7d-49ba-8d7b-57e20080e19f","Type":"ContainerDied","Data":"ba606b524e3ac921c7d15e21f88f95c20df2b8880e4e20c81b522145066a6453"}
Jul 27 19:56:15.198483 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.198462    2558 generic.go:356] "Generic (PLEG): container finished" podID="5bc45eae-7e30-4e75-9578-f4717f0dc9ad" containerID="9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5" exitCode=0
Jul 27 19:56:15.198653 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.198488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479" event={"ID":"5bc45eae-7e30-4e75-9578-f4717f0dc9ad","Type":"ContainerDied","Data":"9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5"}
Jul 27 19:56:15.198653 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.198517    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"
Jul 27 19:56:15.198653 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.198549    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479" event={"ID":"5bc45eae-7e30-4e75-9578-f4717f0dc9ad","Type":"ContainerDied","Data":"4b4cfbb95542cc8ec0d2d0c9a3e01377b3f25b7d5e3fc03e252727377d7a8f81"}
Jul 27 19:56:15.204720 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.204689    2558 scope.go:117] "RemoveContainer" containerID="9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4"
Jul 27 19:56:15.204998 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:56:15.204975    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4\": container with ID starting with 9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4 not found: ID does not exist" containerID="9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4"
Jul 27 19:56:15.205068 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.205008    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4"} err="failed to get container status \"9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4\": rpc error: code = NotFound desc = could not find container \"9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4\": container with ID starting with 9cf2732b945d26e2ba4245108c525df3e4d990a1514fea6ad7b6a9966a348cc4 not found: ID does not exist"
Jul 27 19:56:15.205068 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.205029    2558 scope.go:117] "RemoveContainer" containerID="b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106"
Jul 27 19:56:15.214343 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.214326    2558 scope.go:117] "RemoveContainer" containerID="b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106"
Jul 27 19:56:15.214587 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:56:15.214567    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106\": container with ID starting with b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106 not found: ID does not exist" containerID="b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106"
Jul 27 19:56:15.214670 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.214597    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106"} err="failed to get container status \"b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106\": rpc error: code = NotFound desc = could not find container \"b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106\": container with ID starting with b1dd8fc8a51ebed691252ba5606b2c1a4e477f08de20966968c75be48d711106 not found: ID does not exist"
Jul 27 19:56:15.214670 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.214619    2558 scope.go:117] "RemoveContainer" containerID="9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5"
Jul 27 19:56:15.221653 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.221633    2558 scope.go:117] "RemoveContainer" containerID="9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5"
Jul 27 19:56:15.221951 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:56:15.221924    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5\": container with ID starting with 9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5 not found: ID does not exist" containerID="9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5"
Jul 27 19:56:15.222032 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.221956    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5"} err="failed to get container status \"9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5\": rpc error: code = NotFound desc = could not find container \"9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5\": container with ID starting with 9c865ba606b6879df5fc1a17cc85301b353c5f9df9c00c0f85a5c9b2137751c5 not found: ID does not exist"
Jul 27 19:56:15.223461 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.223443    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"]
Jul 27 19:56:15.229284 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.229263    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9"]
Jul 27 19:56:15.241315 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.241293    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"]
Jul 27 19:56:15.255255 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.255234    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl"]
Jul 27 19:56:15.270343 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.270319    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"]
Jul 27 19:56:15.274022 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.274002    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7bbd07-68bcd6d797-qk479"]
Jul 27 19:56:15.823311 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.823279    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17a13d42-fe7d-49ba-8d7b-57e20080e19f" path="/var/lib/kubelet/pods/17a13d42-fe7d-49ba-8d7b-57e20080e19f/volumes"
Jul 27 19:56:15.823691 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.823678    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc45eae-7e30-4e75-9578-f4717f0dc9ad" path="/var/lib/kubelet/pods/5bc45eae-7e30-4e75-9578-f4717f0dc9ad/volumes"
Jul 27 19:56:15.823989 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:15.823978    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbe34dfa-42e3-43c1-9a68-f17a0d87301f" path="/var/lib/kubelet/pods/cbe34dfa-42e3-43c1-9a68-f17a0d87301f/volumes"
Jul 27 19:56:18.892555 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:18.892523    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:19.256472 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:19.256429    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:24.276565 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:24.276526    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:56:25.441681 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:25.441636    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:25.711375 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:25.711289    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:25.814809 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:25.814761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:25.982151 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:25.982067    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:36.513121 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.513085    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"]
Jul 27 19:56:36.513688 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.513368    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w" podUID="a2d50a32-eb3d-4a27-a04a-d199158be707" containerName="maas-api" containerID="cri-o://1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22" gracePeriod=30
Jul 27 19:56:36.587880 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.587846    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"]
Jul 27 19:56:36.588128 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.588105    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q" podUID="b4cb7225-d212-46a9-9dac-816fb2f854ce" containerName="payload-processing" containerID="cri-o://b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03" gracePeriod=30
Jul 27 19:56:36.592363 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.592329    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"]
Jul 27 19:56:36.592632 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.592583    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw" podUID="89dd2140-da13-4a04-bdaa-fdc701781e12" containerName="payload-pre-processing" containerID="cri-o://98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600" gracePeriod=30
Jul 27 19:56:36.597432 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.596373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:36.748038 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.747956    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:36.775104 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.775013    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw" podUID="89dd2140-da13-4a04-bdaa-fdc701781e12" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.40:9004: connect: connection refused"
Jul 27 19:56:36.775253 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.775021    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q" podUID="b4cb7225-d212-46a9-9dac-816fb2f854ce" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.41:9004: connect: connection refused"
Jul 27 19:56:36.847120 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.847060    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:56:36.879819 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.879794    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:56:36.888960 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.888933    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:56:36.972950 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.972920    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq9qp\" (UniqueName: \"kubernetes.io/projected/b4cb7225-d212-46a9-9dac-816fb2f854ce-kube-api-access-dq9qp\") pod \"b4cb7225-d212-46a9-9dac-816fb2f854ce\" (UID: \"b4cb7225-d212-46a9-9dac-816fb2f854ce\") "
Jul 27 19:56:36.972950 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.972956    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv7mh\" (UniqueName: \"kubernetes.io/projected/a2d50a32-eb3d-4a27-a04a-d199158be707-kube-api-access-cv7mh\") pod \"a2d50a32-eb3d-4a27-a04a-d199158be707\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") "
Jul 27 19:56:36.973192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.972992    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hch6d\" (UniqueName: \"kubernetes.io/projected/89dd2140-da13-4a04-bdaa-fdc701781e12-kube-api-access-hch6d\") pod \"89dd2140-da13-4a04-bdaa-fdc701781e12\" (UID: \"89dd2140-da13-4a04-bdaa-fdc701781e12\") "
Jul 27 19:56:36.973192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.973013    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4cb7225-d212-46a9-9dac-816fb2f854ce-plugins-config-volume\") pod \"b4cb7225-d212-46a9-9dac-816fb2f854ce\" (UID: \"b4cb7225-d212-46a9-9dac-816fb2f854ce\") "
Jul 27 19:56:36.973192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.973044    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d50a32-eb3d-4a27-a04a-d199158be707-openshift-service-ca\") pod \"a2d50a32-eb3d-4a27-a04a-d199158be707\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") "
Jul 27 19:56:36.973192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.973073    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89dd2140-da13-4a04-bdaa-fdc701781e12-plugins-config-volume\") pod \"89dd2140-da13-4a04-bdaa-fdc701781e12\" (UID: \"89dd2140-da13-4a04-bdaa-fdc701781e12\") "
Jul 27 19:56:36.973192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.973110    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls\") pod \"a2d50a32-eb3d-4a27-a04a-d199158be707\" (UID: \"a2d50a32-eb3d-4a27-a04a-d199158be707\") "
Jul 27 19:56:36.973460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.973429    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2d50a32-eb3d-4a27-a04a-d199158be707-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2d50a32-eb3d-4a27-a04a-d199158be707" (UID: "a2d50a32-eb3d-4a27-a04a-d199158be707"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:36.973460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.973444    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4cb7225-d212-46a9-9dac-816fb2f854ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b4cb7225-d212-46a9-9dac-816fb2f854ce" (UID: "b4cb7225-d212-46a9-9dac-816fb2f854ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:36.973850 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.973814    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89dd2140-da13-4a04-bdaa-fdc701781e12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "89dd2140-da13-4a04-bdaa-fdc701781e12" (UID: "89dd2140-da13-4a04-bdaa-fdc701781e12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:36.975252 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.975228    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4cb7225-d212-46a9-9dac-816fb2f854ce-kube-api-access-dq9qp" (OuterVolumeSpecName: "kube-api-access-dq9qp") pod "b4cb7225-d212-46a9-9dac-816fb2f854ce" (UID: "b4cb7225-d212-46a9-9dac-816fb2f854ce"). InnerVolumeSpecName "kube-api-access-dq9qp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:36.975252 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.975247    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2d50a32-eb3d-4a27-a04a-d199158be707-kube-api-access-cv7mh" (OuterVolumeSpecName: "kube-api-access-cv7mh") pod "a2d50a32-eb3d-4a27-a04a-d199158be707" (UID: "a2d50a32-eb3d-4a27-a04a-d199158be707"). InnerVolumeSpecName "kube-api-access-cv7mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:36.975403 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.975272    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89dd2140-da13-4a04-bdaa-fdc701781e12-kube-api-access-hch6d" (OuterVolumeSpecName: "kube-api-access-hch6d") pod "89dd2140-da13-4a04-bdaa-fdc701781e12" (UID: "89dd2140-da13-4a04-bdaa-fdc701781e12"). InnerVolumeSpecName "kube-api-access-hch6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:36.975403 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:36.975349    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2d50a32-eb3d-4a27-a04a-d199158be707" (UID: "a2d50a32-eb3d-4a27-a04a-d199158be707"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:56:37.074586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.074481    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq9qp\" (UniqueName: \"kubernetes.io/projected/b4cb7225-d212-46a9-9dac-816fb2f854ce-kube-api-access-dq9qp\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:37.074586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.074533    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv7mh\" (UniqueName: \"kubernetes.io/projected/a2d50a32-eb3d-4a27-a04a-d199158be707-kube-api-access-cv7mh\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:37.074586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.074542    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hch6d\" (UniqueName: \"kubernetes.io/projected/89dd2140-da13-4a04-bdaa-fdc701781e12-kube-api-access-hch6d\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:37.074586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.074552    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4cb7225-d212-46a9-9dac-816fb2f854ce-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:37.074586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.074561    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d50a32-eb3d-4a27-a04a-d199158be707-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:37.074586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.074569    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89dd2140-da13-4a04-bdaa-fdc701781e12-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:37.074586 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.074577    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2d50a32-eb3d-4a27-a04a-d199158be707-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:56:37.293955 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.293918    2558 generic.go:356] "Generic (PLEG): container finished" podID="a2d50a32-eb3d-4a27-a04a-d199158be707" containerID="1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22" exitCode=0
Jul 27 19:56:37.294142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.293965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w" event={"ID":"a2d50a32-eb3d-4a27-a04a-d199158be707","Type":"ContainerDied","Data":"1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22"}
Jul 27 19:56:37.294142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.294025    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w" event={"ID":"a2d50a32-eb3d-4a27-a04a-d199158be707","Type":"ContainerDied","Data":"615d5776b00f5da0ddb4d9e1db9dcabb8c2062686f9f2d5b62e36c08c4a4fc38"}
Jul 27 19:56:37.294142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.293975    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"
Jul 27 19:56:37.294142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.294054    2558 scope.go:117] "RemoveContainer" containerID="1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22"
Jul 27 19:56:37.295401 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.295382    2558 generic.go:356] "Generic (PLEG): container finished" podID="89dd2140-da13-4a04-bdaa-fdc701781e12" containerID="98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600" exitCode=0
Jul 27 19:56:37.295541 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.295413    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw" event={"ID":"89dd2140-da13-4a04-bdaa-fdc701781e12","Type":"ContainerDied","Data":"98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600"}
Jul 27 19:56:37.295541 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.295435    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"
Jul 27 19:56:37.295541 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.295466    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw" event={"ID":"89dd2140-da13-4a04-bdaa-fdc701781e12","Type":"ContainerDied","Data":"861f06993919ea09c6d446daf556777f19bd9e93331431e833eb4b8d531d5274"}
Jul 27 19:56:37.296742 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.296722    2558 generic.go:356] "Generic (PLEG): container finished" podID="b4cb7225-d212-46a9-9dac-816fb2f854ce" containerID="b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03" exitCode=0
Jul 27 19:56:37.296849 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.296747    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q" event={"ID":"b4cb7225-d212-46a9-9dac-816fb2f854ce","Type":"ContainerDied","Data":"b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03"}
Jul 27 19:56:37.296849 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.296773    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"
Jul 27 19:56:37.296849 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.296800    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q" event={"ID":"b4cb7225-d212-46a9-9dac-816fb2f854ce","Type":"ContainerDied","Data":"15c3b6da39bdbed37cc9715f14b619a3ddcf6cd6d6ad8fab3e2eefae694ece67"}
Jul 27 19:56:37.302833 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.302812    2558 scope.go:117] "RemoveContainer" containerID="1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22"
Jul 27 19:56:37.303087 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:56:37.303067    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22\": container with ID starting with 1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22 not found: ID does not exist" containerID="1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22"
Jul 27 19:56:37.303169 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.303093    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22"} err="failed to get container status \"1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22\": rpc error: code = NotFound desc = could not find container \"1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22\": container with ID starting with 1dc0351072abdab6024476a32faacd9a066789951286c52b14d693cc914e1f22 not found: ID does not exist"
Jul 27 19:56:37.303169 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.303108    2558 scope.go:117] "RemoveContainer" containerID="98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600"
Jul 27 19:56:37.313303 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.313237    2558 scope.go:117] "RemoveContainer" containerID="98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600"
Jul 27 19:56:37.314076 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:56:37.314050    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600\": container with ID starting with 98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600 not found: ID does not exist" containerID="98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600"
Jul 27 19:56:37.314169 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.314087    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600"} err="failed to get container status \"98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600\": rpc error: code = NotFound desc = could not find container \"98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600\": container with ID starting with 98124d8ab79b2db9986affe7cce3450065bb2741d12332bf6d47ab769b58f600 not found: ID does not exist"
Jul 27 19:56:37.314169 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.314109    2558 scope.go:117] "RemoveContainer" containerID="b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03"
Jul 27 19:56:37.322102 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.322084    2558 scope.go:117] "RemoveContainer" containerID="b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03"
Jul 27 19:56:37.322349 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:56:37.322329    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03\": container with ID starting with b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03 not found: ID does not exist" containerID="b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03"
Jul 27 19:56:37.322403 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.322356    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03"} err="failed to get container status \"b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03\": rpc error: code = NotFound desc = could not find container \"b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03\": container with ID starting with b6a4d15e233fc7ce418cd10abf58d6a2a4143a78eaa9b05419e083cd97c5df03 not found: ID does not exist"
Jul 27 19:56:37.338992 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.338939    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"]
Jul 27 19:56:37.342475 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.342455    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w"]
Jul 27 19:56:37.354552 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.354531    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"]
Jul 27 19:56:37.362450 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.362431    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw"]
Jul 27 19:56:37.377409 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.377387    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"]
Jul 27 19:56:37.386112 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.386089    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q"]
Jul 27 19:56:37.822247 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.822214    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89dd2140-da13-4a04-bdaa-fdc701781e12" path="/var/lib/kubelet/pods/89dd2140-da13-4a04-bdaa-fdc701781e12/volumes"
Jul 27 19:56:37.822640 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.822606    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2d50a32-eb3d-4a27-a04a-d199158be707" path="/var/lib/kubelet/pods/a2d50a32-eb3d-4a27-a04a-d199158be707/volumes"
Jul 27 19:56:37.822919 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:37.822907    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4cb7225-d212-46a9-9dac-816fb2f854ce" path="/var/lib/kubelet/pods/b4cb7225-d212-46a9-9dac-816fb2f854ce/volumes"
Jul 27 19:56:39.478082 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:39.478048    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:56:39.775537 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:39.775425    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4ce65d-5c68d4fbc-7v78w" podUID="a2d50a32-eb3d-4a27-a04a-d199158be707" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:56:41.154455 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:41.154420    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:41.573095 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:41.573061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:48.215392 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:48.215361    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:48.373643 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:48.373610    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:48.556060 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:48.555975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:48.744697 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:48.744668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:49.088110 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:49.088081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:49.361609 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:49.361528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:49.523137 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:49.523099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:51.983374 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:51.983341    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:52.293200 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.293116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:52.395781 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.395747    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"]
Jul 27 19:56:52.396138 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396119    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89dd2140-da13-4a04-bdaa-fdc701781e12" containerName="payload-pre-processing"
Jul 27 19:56:52.396227 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396142    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="89dd2140-da13-4a04-bdaa-fdc701781e12" containerName="payload-pre-processing"
Jul 27 19:56:52.396227 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396165    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2d50a32-eb3d-4a27-a04a-d199158be707" containerName="maas-api"
Jul 27 19:56:52.396227 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396173    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2d50a32-eb3d-4a27-a04a-d199158be707" containerName="maas-api"
Jul 27 19:56:52.396227 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396190    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc45eae-7e30-4e75-9578-f4717f0dc9ad" containerName="maas-api"
Jul 27 19:56:52.396227 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396198    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc45eae-7e30-4e75-9578-f4717f0dc9ad" containerName="maas-api"
Jul 27 19:56:52.396227 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396210    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a13d42-fe7d-49ba-8d7b-57e20080e19f" containerName="payload-processing"
Jul 27 19:56:52.396227 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396219    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a13d42-fe7d-49ba-8d7b-57e20080e19f" containerName="payload-processing"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396238    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cb7225-d212-46a9-9dac-816fb2f854ce" containerName="payload-processing"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396246    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cb7225-d212-46a9-9dac-816fb2f854ce" containerName="payload-processing"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396259    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe34dfa-42e3-43c1-9a68-f17a0d87301f" containerName="payload-pre-processing"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396267    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe34dfa-42e3-43c1-9a68-f17a0d87301f" containerName="payload-pre-processing"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396333    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe34dfa-42e3-43c1-9a68-f17a0d87301f" containerName="payload-pre-processing"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396344    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc45eae-7e30-4e75-9578-f4717f0dc9ad" containerName="maas-api"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396356    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="17a13d42-fe7d-49ba-8d7b-57e20080e19f" containerName="payload-processing"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396367    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4cb7225-d212-46a9-9dac-816fb2f854ce" containerName="payload-processing"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396376    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2d50a32-eb3d-4a27-a04a-d199158be707" containerName="maas-api"
Jul 27 19:56:52.396579 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.396384    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="89dd2140-da13-4a04-bdaa-fdc701781e12" containerName="payload-pre-processing"
Jul 27 19:56:52.399228 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.399208    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.403467 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.403443    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:56:52.403597 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.403472    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:56:52.404260 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.404241    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2eb089-serving-cert\""
Jul 27 19:56:52.405306 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.405286    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:56:52.423559 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.423538    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"]
Jul 27 19:56:52.494165 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.494129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.494324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.494169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cb6d1-063d-456a-9add-a032a6b152c5-openshift-service-ca\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.494324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.494234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5r5p\" (UniqueName: \"kubernetes.io/projected/4c2cb6d1-063d-456a-9add-a032a6b152c5-kube-api-access-q5r5p\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.533991 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.533955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:52.595095 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.595016    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.595095 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.595049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cb6d1-063d-456a-9add-a032a6b152c5-openshift-service-ca\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.595095 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.595081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5r5p\" (UniqueName: \"kubernetes.io/projected/4c2cb6d1-063d-456a-9add-a032a6b152c5-kube-api-access-q5r5p\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.595311 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:56:52.595228    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-serving-cert: secret "maas-api-e2e-api-a-2eb089-serving-cert" not found
Jul 27 19:56:52.595347 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:56:52.595325    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls podName:4c2cb6d1-063d-456a-9add-a032a6b152c5 nodeName:}" failed. No retries permitted until 2026-07-27 19:56:53.095305635 +0000 UTC m=+2347.834861221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls") pod "maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9" (UID: "4c2cb6d1-063d-456a-9add-a032a6b152c5") : secret "maas-api-e2e-api-a-2eb089-serving-cert" not found
Jul 27 19:56:52.595729 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.595709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cb6d1-063d-456a-9add-a032a6b152c5-openshift-service-ca\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.609977 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.609953    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5r5p\" (UniqueName: \"kubernetes.io/projected/4c2cb6d1-063d-456a-9add-a032a6b152c5-kube-api-access-q5r5p\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:52.724384 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:52.724353    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:53.098241 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.098208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:53.100776 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.100749    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls\") pod \"maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:53.113033 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.113001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:53.309460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.309426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:53.349754 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.349679    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"]
Jul 27 19:56:53.353593 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.353572    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:53.355985 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.355956    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2eb089\""
Jul 27 19:56:53.356080 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.356011    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-2eb089-dockercfg-5hlf5\""
Jul 27 19:56:53.365804 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.365774    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:53.367092 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.367067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"]
Jul 27 19:56:53.400606 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.400464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm\" (UID: \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:53.400606 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.400530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg8t4\" (UniqueName: \"kubernetes.io/projected/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-kube-api-access-sg8t4\") pod \"payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm\" (UID: \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:53.405747 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.405719    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"]
Jul 27 19:56:53.409407 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.409387    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:53.423225 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.423159    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"]
Jul 27 19:56:53.457353 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.457322    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"]
Jul 27 19:56:53.460281 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:56:53.460250    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2cb6d1_063d_456a_9add_a032a6b152c5.slice/crio-16d406c389e01f25a9e72d673745f64d1297dc3ae9ae41cdaa4b1c1f99c4ae51 WatchSource:0}: Error finding container 16d406c389e01f25a9e72d673745f64d1297dc3ae9ae41cdaa4b1c1f99c4ae51: Status 404 returned error can't find the container with id 16d406c389e01f25a9e72d673745f64d1297dc3ae9ae41cdaa4b1c1f99c4ae51
Jul 27 19:56:53.461476 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.461456    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:56:53.500805 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.500779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh994\" (UniqueName: \"kubernetes.io/projected/d1584ee2-afd0-422f-87e6-5a3a6b22c605-kube-api-access-kh994\") pod \"payload-processing-e2e-api-a-2eb089-755f998d4-84qgn\" (UID: \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\") " pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:53.500945 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.500819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm\" (UID: \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:53.500945 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.500840    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg8t4\" (UniqueName: \"kubernetes.io/projected/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-kube-api-access-sg8t4\") pod \"payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm\" (UID: \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:53.500945 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.500913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1584ee2-afd0-422f-87e6-5a3a6b22c605-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2eb089-755f998d4-84qgn\" (UID: \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\") " pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:53.501455 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.501433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm\" (UID: \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:53.513982 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.513957    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg8t4\" (UniqueName: \"kubernetes.io/projected/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-kube-api-access-sg8t4\") pod \"payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm\" (UID: \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:53.601857 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.601761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1584ee2-afd0-422f-87e6-5a3a6b22c605-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2eb089-755f998d4-84qgn\" (UID: \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\") " pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:53.601857 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.601836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh994\" (UniqueName: \"kubernetes.io/projected/d1584ee2-afd0-422f-87e6-5a3a6b22c605-kube-api-access-kh994\") pod \"payload-processing-e2e-api-a-2eb089-755f998d4-84qgn\" (UID: \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\") " pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:53.602456 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.602436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1584ee2-afd0-422f-87e6-5a3a6b22c605-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2eb089-755f998d4-84qgn\" (UID: \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\") " pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:53.611299 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.611273    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh994\" (UniqueName: \"kubernetes.io/projected/d1584ee2-afd0-422f-87e6-5a3a6b22c605-kube-api-access-kh994\") pod \"payload-processing-e2e-api-a-2eb089-755f998d4-84qgn\" (UID: \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\") " pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:53.669308 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.669278    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:53.722467 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.722438    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:53.805732 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.805707    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"]
Jul 27 19:56:53.808306 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:56:53.808272    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd20ed4_50ca_4ff9_85b6_a81a6d645991.slice/crio-a6fe0d98d781efe4df67c72e7f347304096e92cac40d17d212b01ebe4130d8c1 WatchSource:0}: Error finding container a6fe0d98d781efe4df67c72e7f347304096e92cac40d17d212b01ebe4130d8c1: Status 404 returned error can't find the container with id a6fe0d98d781efe4df67c72e7f347304096e92cac40d17d212b01ebe4130d8c1
Jul 27 19:56:53.861374 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:53.861321    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"]
Jul 27 19:56:53.863900 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:56:53.863873    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1584ee2_afd0_422f_87e6_5a3a6b22c605.slice/crio-65dfbbd066974f519a455aa3324583039073a42de4a3dcdac366bcf2bd52e5c8 WatchSource:0}: Error finding container 65dfbbd066974f519a455aa3324583039073a42de4a3dcdac366bcf2bd52e5c8: Status 404 returned error can't find the container with id 65dfbbd066974f519a455aa3324583039073a42de4a3dcdac366bcf2bd52e5c8
Jul 27 19:56:54.376046 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.376012    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9" event={"ID":"4c2cb6d1-063d-456a-9add-a032a6b152c5","Type":"ContainerStarted","Data":"bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43"}
Jul 27 19:56:54.376478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.376077    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:56:54.376478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.376101    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9" event={"ID":"4c2cb6d1-063d-456a-9add-a032a6b152c5","Type":"ContainerStarted","Data":"16d406c389e01f25a9e72d673745f64d1297dc3ae9ae41cdaa4b1c1f99c4ae51"}
Jul 27 19:56:54.377626 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.377600    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn" event={"ID":"d1584ee2-afd0-422f-87e6-5a3a6b22c605","Type":"ContainerStarted","Data":"f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf"}
Jul 27 19:56:54.377764 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.377643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn" event={"ID":"d1584ee2-afd0-422f-87e6-5a3a6b22c605","Type":"ContainerStarted","Data":"65dfbbd066974f519a455aa3324583039073a42de4a3dcdac366bcf2bd52e5c8"}
Jul 27 19:56:54.377764 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.377670    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:56:54.379073 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.379054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm" event={"ID":"7dd20ed4-50ca-4ff9-85b6-a81a6d645991","Type":"ContainerStarted","Data":"37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560"}
Jul 27 19:56:54.379178 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.379086    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm" event={"ID":"7dd20ed4-50ca-4ff9-85b6-a81a6d645991","Type":"ContainerStarted","Data":"a6fe0d98d781efe4df67c72e7f347304096e92cac40d17d212b01ebe4130d8c1"}
Jul 27 19:56:54.379230 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.379181    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:56:54.394290 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.394241    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9" podStartSLOduration=1.924678837 podStartE2EDuration="2.394226344s" totalImagesPullingTime="469.547507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:54.393591276 +0000 UTC m=+2349.133146880" watchObservedRunningTime="2026-07-27 19:56:54.394226344 +0000 UTC m=+2349.133781978"
Jul 27 19:56:54.411798 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.411750    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm" podStartSLOduration=1.411733342 podStartE2EDuration="1.411733342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:54.409739369 +0000 UTC m=+2349.149294977" watchObservedRunningTime="2026-07-27 19:56:54.411733342 +0000 UTC m=+2349.151288953"
Jul 27 19:56:54.426537 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:54.426478    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn" podStartSLOduration=1.4264627509999999 podStartE2EDuration="1.426462751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:54.426062067 +0000 UTC m=+2349.165617673" watchObservedRunningTime="2026-07-27 19:56:54.426462751 +0000 UTC m=+2349.166018356"
Jul 27 19:56:56.647205 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:56.647172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:57.082183 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:57.082147    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:57.422762 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:57.422687    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:57.856293 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:56:57.856263    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:00.377551 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.377513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:00.388003 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.387952    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"]
Jul 27 19:57:00.391721 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.391702    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:57:00.391887 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.391869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:00.394182 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.394158    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-941fec-serving-cert\""
Jul 27 19:57:00.402645 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.402626    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"]
Jul 27 19:57:00.461344 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.461302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f8a02a-e9e0-47a2-ae57-129514acd417-openshift-service-ca\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:00.461548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.461404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:00.461548 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.461538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wj2b\" (UniqueName: \"kubernetes.io/projected/71f8a02a-e9e0-47a2-ae57-129514acd417-kube-api-access-9wj2b\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:00.479939 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.479905    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:00.506846 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.506805    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:57:00.562860 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.562827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f8a02a-e9e0-47a2-ae57-129514acd417-openshift-service-ca\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:00.563034 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.562889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:00.563103 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:00.563050    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-serving-cert: secret "maas-api-e2e-api-b-941fec-serving-cert" not found
Jul 27 19:57:00.563157 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:00.563144    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls podName:71f8a02a-e9e0-47a2-ae57-129514acd417 nodeName:}" failed. No retries permitted until 2026-07-27 19:57:01.063121942 +0000 UTC m=+2355.802677532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls") pod "maas-api-e2e-api-b-941fec-86dbc577f-5k8bc" (UID: "71f8a02a-e9e0-47a2-ae57-129514acd417") : secret "maas-api-e2e-api-b-941fec-serving-cert" not found
Jul 27 19:57:00.563217 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.563169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wj2b\" (UniqueName: \"kubernetes.io/projected/71f8a02a-e9e0-47a2-ae57-129514acd417-kube-api-access-9wj2b\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:00.563571 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.563552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f8a02a-e9e0-47a2-ae57-129514acd417-openshift-service-ca\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:00.574459 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:00.574437    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wj2b\" (UniqueName: \"kubernetes.io/projected/71f8a02a-e9e0-47a2-ae57-129514acd417-kube-api-access-9wj2b\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:01.067795 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.067760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:01.067980 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:01.067876    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-serving-cert: secret "maas-api-e2e-api-b-941fec-serving-cert" not found
Jul 27 19:57:01.067980 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:01.067938    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls podName:71f8a02a-e9e0-47a2-ae57-129514acd417 nodeName:}" failed. No retries permitted until 2026-07-27 19:57:02.067924046 +0000 UTC m=+2356.807479629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls") pod "maas-api-e2e-api-b-941fec-86dbc577f-5k8bc" (UID: "71f8a02a-e9e0-47a2-ae57-129514acd417") : secret "maas-api-e2e-api-b-941fec-serving-cert" not found
Jul 27 19:57:01.192397 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.192365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:01.310795 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.310733    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:01.434333 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.434274    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"]
Jul 27 19:57:01.437711 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.437695    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:01.440703 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.440675    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-941fec-dockercfg-fmdmh\""
Jul 27 19:57:01.440703 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.440675    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-941fec\""
Jul 27 19:57:01.461554 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.461526    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"]
Jul 27 19:57:01.471919 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.471896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tkzk\" (UniqueName: \"kubernetes.io/projected/745d4c30-dfd7-4a5a-98c3-be523514530b-kube-api-access-6tkzk\") pod \"payload-processing-e2e-api-b-941fec-57db54b78-gq6k5\" (UID: \"745d4c30-dfd7-4a5a-98c3-be523514530b\") " pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:01.472045 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.471935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/745d4c30-dfd7-4a5a-98c3-be523514530b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-941fec-57db54b78-gq6k5\" (UID: \"745d4c30-dfd7-4a5a-98c3-be523514530b\") " pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:01.573312 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.573281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tkzk\" (UniqueName: \"kubernetes.io/projected/745d4c30-dfd7-4a5a-98c3-be523514530b-kube-api-access-6tkzk\") pod \"payload-processing-e2e-api-b-941fec-57db54b78-gq6k5\" (UID: \"745d4c30-dfd7-4a5a-98c3-be523514530b\") " pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:01.573312 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.573313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/745d4c30-dfd7-4a5a-98c3-be523514530b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-941fec-57db54b78-gq6k5\" (UID: \"745d4c30-dfd7-4a5a-98c3-be523514530b\") " pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:01.574025 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.574006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/745d4c30-dfd7-4a5a-98c3-be523514530b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-941fec-57db54b78-gq6k5\" (UID: \"745d4c30-dfd7-4a5a-98c3-be523514530b\") " pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:01.582001 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.581974    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tkzk\" (UniqueName: \"kubernetes.io/projected/745d4c30-dfd7-4a5a-98c3-be523514530b-kube-api-access-6tkzk\") pod \"payload-processing-e2e-api-b-941fec-57db54b78-gq6k5\" (UID: \"745d4c30-dfd7-4a5a-98c3-be523514530b\") " pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:01.748845 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.748762    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:01.876992 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:01.876967    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"]
Jul 27 19:57:01.878960 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:57:01.878929    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745d4c30_dfd7_4a5a_98c3_be523514530b.slice/crio-5e067bbad1a735f84b1d7a5475769d92e542103b57761a461f4ce808db5c2e32 WatchSource:0}: Error finding container 5e067bbad1a735f84b1d7a5475769d92e542103b57761a461f4ce808db5c2e32: Status 404 returned error can't find the container with id 5e067bbad1a735f84b1d7a5475769d92e542103b57761a461f4ce808db5c2e32
Jul 27 19:57:02.078222 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.078141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:02.080248 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.080230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls\") pod \"maas-api-e2e-api-b-941fec-86dbc577f-5k8bc\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:02.203123 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.203088    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:02.334514 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:57:02.334466    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f8a02a_e9e0_47a2_ae57_129514acd417.slice/crio-b655163b85d7d2a9041a9ca6e969331f9ed9d037b6f25045f4a6bd993cbfb25e WatchSource:0}: Error finding container b655163b85d7d2a9041a9ca6e969331f9ed9d037b6f25045f4a6bd993cbfb25e: Status 404 returned error can't find the container with id b655163b85d7d2a9041a9ca6e969331f9ed9d037b6f25045f4a6bd993cbfb25e
Jul 27 19:57:02.339938 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.339917    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"]
Jul 27 19:57:02.415983 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.415955    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc" event={"ID":"71f8a02a-e9e0-47a2-ae57-129514acd417","Type":"ContainerStarted","Data":"b655163b85d7d2a9041a9ca6e969331f9ed9d037b6f25045f4a6bd993cbfb25e"}
Jul 27 19:57:02.417475 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.417451    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5" event={"ID":"745d4c30-dfd7-4a5a-98c3-be523514530b","Type":"ContainerStarted","Data":"1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866"}
Jul 27 19:57:02.417583 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.417492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5" event={"ID":"745d4c30-dfd7-4a5a-98c3-be523514530b","Type":"ContainerStarted","Data":"5e067bbad1a735f84b1d7a5475769d92e542103b57761a461f4ce808db5c2e32"}
Jul 27 19:57:02.417583 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.417551    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:02.444057 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:02.444011    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5" podStartSLOduration=1.4439965510000001 podStartE2EDuration="1.443996551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:02.44355993 +0000 UTC m=+2357.183115537" watchObservedRunningTime="2026-07-27 19:57:02.443996551 +0000 UTC m=+2357.183552186"
Jul 27 19:57:03.425897 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:03.425864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc" event={"ID":"71f8a02a-e9e0-47a2-ae57-129514acd417","Type":"ContainerStarted","Data":"d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112"}
Jul 27 19:57:03.446189 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:03.446142    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc" podStartSLOduration=3.071309658 podStartE2EDuration="3.446120773s" totalImagesPullingTime="374.811115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:03.444835296 +0000 UTC m=+2358.184390893" watchObservedRunningTime="2026-07-27 19:57:03.446120773 +0000 UTC m=+2358.185676379"
Jul 27 19:57:04.430911 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:04.430877    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:04.792466 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:04.792374    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:05.386114 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:05.386074    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:57:05.386276 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:05.386212    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:57:10.440729 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:10.440699    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:13.428319 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:13.428288    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:17.695479 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:17.695443    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:57:29.086942 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.086907    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"]
Jul 27 19:57:29.087351 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.087101    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9" podUID="4c2cb6d1-063d-456a-9add-a032a6b152c5" containerName="maas-api" containerID="cri-o://bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43" gracePeriod=30
Jul 27 19:57:29.139974 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.139933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:29.194611 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.194576    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"]
Jul 27 19:57:29.194887 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.194857    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn" podUID="d1584ee2-afd0-422f-87e6-5a3a6b22c605" containerName="payload-processing" containerID="cri-o://f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf" gracePeriod=30
Jul 27 19:57:29.203721 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.203698    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"]
Jul 27 19:57:29.203948 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.203922    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm" podUID="7dd20ed4-50ca-4ff9-85b6-a81a6d645991" containerName="payload-pre-processing" containerID="cri-o://37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560" gracePeriod=30
Jul 27 19:57:29.298900 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.298864    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:29.361196 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.361164    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:57:29.399186 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.399123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:29.439412 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.439389    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:57:29.480372 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.480342    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:57:29.518803 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.518773    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cb6d1-063d-456a-9add-a032a6b152c5-openshift-service-ca\") pod \"4c2cb6d1-063d-456a-9add-a032a6b152c5\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") "
Jul 27 19:57:29.518963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.518826    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5r5p\" (UniqueName: \"kubernetes.io/projected/4c2cb6d1-063d-456a-9add-a032a6b152c5-kube-api-access-q5r5p\") pod \"4c2cb6d1-063d-456a-9add-a032a6b152c5\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") "
Jul 27 19:57:29.518963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.518874    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls\") pod \"4c2cb6d1-063d-456a-9add-a032a6b152c5\" (UID: \"4c2cb6d1-063d-456a-9add-a032a6b152c5\") "
Jul 27 19:57:29.518963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.518911    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1584ee2-afd0-422f-87e6-5a3a6b22c605-plugins-config-volume\") pod \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\" (UID: \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\") "
Jul 27 19:57:29.518963 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.518946    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh994\" (UniqueName: \"kubernetes.io/projected/d1584ee2-afd0-422f-87e6-5a3a6b22c605-kube-api-access-kh994\") pod \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\" (UID: \"d1584ee2-afd0-422f-87e6-5a3a6b22c605\") "
Jul 27 19:57:29.519195 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.519165    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2cb6d1-063d-456a-9add-a032a6b152c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c2cb6d1-063d-456a-9add-a032a6b152c5" (UID: "4c2cb6d1-063d-456a-9add-a032a6b152c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:29.519397 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.519366    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1584ee2-afd0-422f-87e6-5a3a6b22c605-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1584ee2-afd0-422f-87e6-5a3a6b22c605" (UID: "d1584ee2-afd0-422f-87e6-5a3a6b22c605"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:29.521007 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.520983    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2cb6d1-063d-456a-9add-a032a6b152c5-kube-api-access-q5r5p" (OuterVolumeSpecName: "kube-api-access-q5r5p") pod "4c2cb6d1-063d-456a-9add-a032a6b152c5" (UID: "4c2cb6d1-063d-456a-9add-a032a6b152c5"). InnerVolumeSpecName "kube-api-access-q5r5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:29.521097 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.520997    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c2cb6d1-063d-456a-9add-a032a6b152c5" (UID: "4c2cb6d1-063d-456a-9add-a032a6b152c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:57:29.521097 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.521019    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1584ee2-afd0-422f-87e6-5a3a6b22c605-kube-api-access-kh994" (OuterVolumeSpecName: "kube-api-access-kh994") pod "d1584ee2-afd0-422f-87e6-5a3a6b22c605" (UID: "d1584ee2-afd0-422f-87e6-5a3a6b22c605"). InnerVolumeSpecName "kube-api-access-kh994". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:29.539249 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.539226    2558 generic.go:356] "Generic (PLEG): container finished" podID="4c2cb6d1-063d-456a-9add-a032a6b152c5" containerID="bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43" exitCode=0
Jul 27 19:57:29.539355 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.539273    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"
Jul 27 19:57:29.539355 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.539305    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9" event={"ID":"4c2cb6d1-063d-456a-9add-a032a6b152c5","Type":"ContainerDied","Data":"bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43"}
Jul 27 19:57:29.539463 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.539379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9" event={"ID":"4c2cb6d1-063d-456a-9add-a032a6b152c5","Type":"ContainerDied","Data":"16d406c389e01f25a9e72d673745f64d1297dc3ae9ae41cdaa4b1c1f99c4ae51"}
Jul 27 19:57:29.539463 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.539412    2558 scope.go:117] "RemoveContainer" containerID="bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43"
Jul 27 19:57:29.540671 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.540649    2558 generic.go:356] "Generic (PLEG): container finished" podID="d1584ee2-afd0-422f-87e6-5a3a6b22c605" containerID="f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf" exitCode=0
Jul 27 19:57:29.540778 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.540702    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"
Jul 27 19:57:29.540778 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.540741    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn" event={"ID":"d1584ee2-afd0-422f-87e6-5a3a6b22c605","Type":"ContainerDied","Data":"f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf"}
Jul 27 19:57:29.540905 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.540805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn" event={"ID":"d1584ee2-afd0-422f-87e6-5a3a6b22c605","Type":"ContainerDied","Data":"65dfbbd066974f519a455aa3324583039073a42de4a3dcdac366bcf2bd52e5c8"}
Jul 27 19:57:29.542095 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.542074    2558 generic.go:356] "Generic (PLEG): container finished" podID="7dd20ed4-50ca-4ff9-85b6-a81a6d645991" containerID="37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560" exitCode=0
Jul 27 19:57:29.542206 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.542118    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm" event={"ID":"7dd20ed4-50ca-4ff9-85b6-a81a6d645991","Type":"ContainerDied","Data":"37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560"}
Jul 27 19:57:29.542206 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.542155    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm" event={"ID":"7dd20ed4-50ca-4ff9-85b6-a81a6d645991","Type":"ContainerDied","Data":"a6fe0d98d781efe4df67c72e7f347304096e92cac40d17d212b01ebe4130d8c1"}
Jul 27 19:57:29.542206 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.542119    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"
Jul 27 19:57:29.549340 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.549275    2558 scope.go:117] "RemoveContainer" containerID="bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43"
Jul 27 19:57:29.549604 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:29.549583    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43\": container with ID starting with bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43 not found: ID does not exist" containerID="bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43"
Jul 27 19:57:29.549704 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.549613    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43"} err="failed to get container status \"bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43\": rpc error: code = NotFound desc = could not find container \"bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43\": container with ID starting with bf3b38660d261696e0a2f1c811ea3b8c8b29b82dcdfb078ffc1e22151a170f43 not found: ID does not exist"
Jul 27 19:57:29.549704 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.549637    2558 scope.go:117] "RemoveContainer" containerID="f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf"
Jul 27 19:57:29.559355 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.559318    2558 scope.go:117] "RemoveContainer" containerID="f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf"
Jul 27 19:57:29.561485 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:29.561461    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf\": container with ID starting with f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf not found: ID does not exist" containerID="f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf"
Jul 27 19:57:29.561678 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.561491    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf"} err="failed to get container status \"f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf\": rpc error: code = NotFound desc = could not find container \"f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf\": container with ID starting with f6e8257aec444337c731e7a479ac7788832a6d75d70502ef274673b24d73f0cf not found: ID does not exist"
Jul 27 19:57:29.561678 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.561533    2558 scope.go:117] "RemoveContainer" containerID="37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560"
Jul 27 19:57:29.562633 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.562613    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"]
Jul 27 19:57:29.565604 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.565582    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2eb089-78c494cbfd-r6hb9"]
Jul 27 19:57:29.569465 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.569445    2558 scope.go:117] "RemoveContainer" containerID="37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560"
Jul 27 19:57:29.569739 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:29.569718    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560\": container with ID starting with 37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560 not found: ID does not exist" containerID="37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560"
Jul 27 19:57:29.569799 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.569744    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560"} err="failed to get container status \"37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560\": rpc error: code = NotFound desc = could not find container \"37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560\": container with ID starting with 37a424bb815024e9a562a6c0edd5d5754988bf76ff7355700a11cdce8567d560 not found: ID does not exist"
Jul 27 19:57:29.576150 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.576128    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"]
Jul 27 19:57:29.579701 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.579683    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn"]
Jul 27 19:57:29.619934 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.619878    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-plugins-config-volume\") pod \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\" (UID: \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\") "
Jul 27 19:57:29.619934 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.619909    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg8t4\" (UniqueName: \"kubernetes.io/projected/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-kube-api-access-sg8t4\") pod \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\" (UID: \"7dd20ed4-50ca-4ff9-85b6-a81a6d645991\") "
Jul 27 19:57:29.620103 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.620091    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5r5p\" (UniqueName: \"kubernetes.io/projected/4c2cb6d1-063d-456a-9add-a032a6b152c5-kube-api-access-q5r5p\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:29.620154 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.620105    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2cb6d1-063d-456a-9add-a032a6b152c5-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:29.620154 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.620116    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1584ee2-afd0-422f-87e6-5a3a6b22c605-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:29.620154 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.620125    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh994\" (UniqueName: \"kubernetes.io/projected/d1584ee2-afd0-422f-87e6-5a3a6b22c605-kube-api-access-kh994\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:29.620154 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.620133    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cb6d1-063d-456a-9add-a032a6b152c5-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:29.620295 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.620187    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7dd20ed4-50ca-4ff9-85b6-a81a6d645991" (UID: "7dd20ed4-50ca-4ff9-85b6-a81a6d645991"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:29.621932 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.621914    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-kube-api-access-sg8t4" (OuterVolumeSpecName: "kube-api-access-sg8t4") pod "7dd20ed4-50ca-4ff9-85b6-a81a6d645991" (UID: "7dd20ed4-50ca-4ff9-85b6-a81a6d645991"). InnerVolumeSpecName "kube-api-access-sg8t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:29.721075 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.721041    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:29.721075 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.721070    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg8t4\" (UniqueName: \"kubernetes.io/projected/7dd20ed4-50ca-4ff9-85b6-a81a6d645991-kube-api-access-sg8t4\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:29.822990 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.822960    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c2cb6d1-063d-456a-9add-a032a6b152c5" path="/var/lib/kubelet/pods/4c2cb6d1-063d-456a-9add-a032a6b152c5/volumes"
Jul 27 19:57:29.823312 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.823298    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1584ee2-afd0-422f-87e6-5a3a6b22c605" path="/var/lib/kubelet/pods/d1584ee2-afd0-422f-87e6-5a3a6b22c605/volumes"
Jul 27 19:57:29.857623 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.857599    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"]
Jul 27 19:57:29.861731 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:29.861708    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm"]
Jul 27 19:57:31.821573 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:31.821542    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dd20ed4-50ca-4ff9-85b6-a81a6d645991" path="/var/lib/kubelet/pods/7dd20ed4-50ca-4ff9-85b6-a81a6d645991/volumes"
Jul 27 19:57:32.886952 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:32.886919    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:33.271910 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:33.271878    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:33.994814 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:33.994757    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:57:39.398603 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:39.398574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:39.502185 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:39.502151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:39.666094 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:39.666000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:39.875324 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:39.875291    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:55.551887 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.551849    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"]
Jul 27 19:57:55.552391 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.552087    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc" podUID="71f8a02a-e9e0-47a2-ae57-129514acd417" containerName="maas-api" containerID="cri-o://d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112" gracePeriod=30
Jul 27 19:57:55.619930 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.619895    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"]
Jul 27 19:57:55.620178 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.620147    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5" podUID="745d4c30-dfd7-4a5a-98c3-be523514530b" containerName="payload-processing" containerID="cri-o://1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866" gracePeriod=30
Jul 27 19:57:55.657938 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.657870    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:55.760686 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.760655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:55.871316 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.871291    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:55.894041 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.894017    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:55.935065 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.935034    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wj2b\" (UniqueName: \"kubernetes.io/projected/71f8a02a-e9e0-47a2-ae57-129514acd417-kube-api-access-9wj2b\") pod \"71f8a02a-e9e0-47a2-ae57-129514acd417\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") "
Jul 27 19:57:55.935220 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.935093    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tkzk\" (UniqueName: \"kubernetes.io/projected/745d4c30-dfd7-4a5a-98c3-be523514530b-kube-api-access-6tkzk\") pod \"745d4c30-dfd7-4a5a-98c3-be523514530b\" (UID: \"745d4c30-dfd7-4a5a-98c3-be523514530b\") "
Jul 27 19:57:55.935269 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.935229    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f8a02a-e9e0-47a2-ae57-129514acd417-openshift-service-ca\") pod \"71f8a02a-e9e0-47a2-ae57-129514acd417\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") "
Jul 27 19:57:55.935311 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.935297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls\") pod \"71f8a02a-e9e0-47a2-ae57-129514acd417\" (UID: \"71f8a02a-e9e0-47a2-ae57-129514acd417\") "
Jul 27 19:57:55.935353 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.935322    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/745d4c30-dfd7-4a5a-98c3-be523514530b-plugins-config-volume\") pod \"745d4c30-dfd7-4a5a-98c3-be523514530b\" (UID: \"745d4c30-dfd7-4a5a-98c3-be523514530b\") "
Jul 27 19:57:55.935768 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.935642    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f8a02a-e9e0-47a2-ae57-129514acd417-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71f8a02a-e9e0-47a2-ae57-129514acd417" (UID: "71f8a02a-e9e0-47a2-ae57-129514acd417"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:55.935901 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.935795    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745d4c30-dfd7-4a5a-98c3-be523514530b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "745d4c30-dfd7-4a5a-98c3-be523514530b" (UID: "745d4c30-dfd7-4a5a-98c3-be523514530b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:55.937401 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.937361    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71f8a02a-e9e0-47a2-ae57-129514acd417" (UID: "71f8a02a-e9e0-47a2-ae57-129514acd417"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:57:55.937697 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.937676    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/745d4c30-dfd7-4a5a-98c3-be523514530b-kube-api-access-6tkzk" (OuterVolumeSpecName: "kube-api-access-6tkzk") pod "745d4c30-dfd7-4a5a-98c3-be523514530b" (UID: "745d4c30-dfd7-4a5a-98c3-be523514530b"). InnerVolumeSpecName "kube-api-access-6tkzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:55.937758 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:55.937727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f8a02a-e9e0-47a2-ae57-129514acd417-kube-api-access-9wj2b" (OuterVolumeSpecName: "kube-api-access-9wj2b") pod "71f8a02a-e9e0-47a2-ae57-129514acd417" (UID: "71f8a02a-e9e0-47a2-ae57-129514acd417"). InnerVolumeSpecName "kube-api-access-9wj2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:56.036271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.036228    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f8a02a-e9e0-47a2-ae57-129514acd417-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:56.036271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.036265    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/745d4c30-dfd7-4a5a-98c3-be523514530b-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:56.036271 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.036278    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wj2b\" (UniqueName: \"kubernetes.io/projected/71f8a02a-e9e0-47a2-ae57-129514acd417-kube-api-access-9wj2b\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:56.036547 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.036290    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tkzk\" (UniqueName: \"kubernetes.io/projected/745d4c30-dfd7-4a5a-98c3-be523514530b-kube-api-access-6tkzk\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:56.036547 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.036305    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f8a02a-e9e0-47a2-ae57-129514acd417-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 19:57:56.658675 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.658638    2558 generic.go:356] "Generic (PLEG): container finished" podID="71f8a02a-e9e0-47a2-ae57-129514acd417" containerID="d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112" exitCode=0
Jul 27 19:57:56.659085 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.658685    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"
Jul 27 19:57:56.659085 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.658715    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc" event={"ID":"71f8a02a-e9e0-47a2-ae57-129514acd417","Type":"ContainerDied","Data":"d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112"}
Jul 27 19:57:56.659085 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.658763    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc" event={"ID":"71f8a02a-e9e0-47a2-ae57-129514acd417","Type":"ContainerDied","Data":"b655163b85d7d2a9041a9ca6e969331f9ed9d037b6f25045f4a6bd993cbfb25e"}
Jul 27 19:57:56.659085 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.658792    2558 scope.go:117] "RemoveContainer" containerID="d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112"
Jul 27 19:57:56.660176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.660014    2558 generic.go:356] "Generic (PLEG): container finished" podID="745d4c30-dfd7-4a5a-98c3-be523514530b" containerID="1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866" exitCode=0
Jul 27 19:57:56.660176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.660055    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"
Jul 27 19:57:56.660176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.660060    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5" event={"ID":"745d4c30-dfd7-4a5a-98c3-be523514530b","Type":"ContainerDied","Data":"1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866"}
Jul 27 19:57:56.660176 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.660098    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5" event={"ID":"745d4c30-dfd7-4a5a-98c3-be523514530b","Type":"ContainerDied","Data":"5e067bbad1a735f84b1d7a5475769d92e542103b57761a461f4ce808db5c2e32"}
Jul 27 19:57:56.667199 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.667180    2558 scope.go:117] "RemoveContainer" containerID="d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112"
Jul 27 19:57:56.667452 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:56.667430    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112\": container with ID starting with d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112 not found: ID does not exist" containerID="d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112"
Jul 27 19:57:56.667637 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.667462    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112"} err="failed to get container status \"d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112\": rpc error: code = NotFound desc = could not find container \"d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112\": container with ID starting with d448022d3415d29c242a4ddfcdbe4dda4f37a633623aa5c5166209f53f1cd112 not found: ID does not exist"
Jul 27 19:57:56.667637 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.667484    2558 scope.go:117] "RemoveContainer" containerID="1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866"
Jul 27 19:57:56.674743 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.674723    2558 scope.go:117] "RemoveContainer" containerID="1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866"
Jul 27 19:57:56.675012 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:57:56.674995    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866\": container with ID starting with 1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866 not found: ID does not exist" containerID="1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866"
Jul 27 19:57:56.675074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.675017    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866"} err="failed to get container status \"1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866\": rpc error: code = NotFound desc = could not find container \"1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866\": container with ID starting with 1a9b41b3f332b35333db570efc51ed153ff2bfb23a68ca041f0f8948c8c4e866 not found: ID does not exist"
Jul 27 19:57:56.689405 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.689381    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"]
Jul 27 19:57:56.693297 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.693278    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5"]
Jul 27 19:57:56.714374 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.714354    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"]
Jul 27 19:57:56.719463 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:56.719443    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-941fec-86dbc577f-5k8bc"]
Jul 27 19:57:57.822621 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:57.822586    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71f8a02a-e9e0-47a2-ae57-129514acd417" path="/var/lib/kubelet/pods/71f8a02a-e9e0-47a2-ae57-129514acd417/volumes"
Jul 27 19:57:57.822992 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:57:57.822937    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="745d4c30-dfd7-4a5a-98c3-be523514530b" path="/var/lib/kubelet/pods/745d4c30-dfd7-4a5a-98c3-be523514530b/volumes"
Jul 27 19:58:00.090931 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:00.090874    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:00.469214 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:00.469174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:00.775864 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:00.775786    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:58:06.502337 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:06.502294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:06.620363 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:06.620329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:06.807210 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:06.807119    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:07.043175 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:07.043143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:07.348451 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:07.348401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:07.673848 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:07.673735    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:07.826425 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:07.826375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:10.720589 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.720549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:10.861673 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.861641    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:10.880142 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880106    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"]
Jul 27 19:58:10.880470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880453    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2cb6d1-063d-456a-9add-a032a6b152c5" containerName="maas-api"
Jul 27 19:58:10.880470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880471    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2cb6d1-063d-456a-9add-a032a6b152c5" containerName="maas-api"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880483    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1584ee2-afd0-422f-87e6-5a3a6b22c605" containerName="payload-processing"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880490    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1584ee2-afd0-422f-87e6-5a3a6b22c605" containerName="payload-processing"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880520    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd20ed4-50ca-4ff9-85b6-a81a6d645991" containerName="payload-pre-processing"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880526    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd20ed4-50ca-4ff9-85b6-a81a6d645991" containerName="payload-pre-processing"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880537    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="745d4c30-dfd7-4a5a-98c3-be523514530b" containerName="payload-processing"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880542    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="745d4c30-dfd7-4a5a-98c3-be523514530b" containerName="payload-processing"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880554    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f8a02a-e9e0-47a2-ae57-129514acd417" containerName="maas-api"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880560    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f8a02a-e9e0-47a2-ae57-129514acd417" containerName="maas-api"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880604    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1584ee2-afd0-422f-87e6-5a3a6b22c605" containerName="payload-processing"
Jul 27 19:58:10.880613 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880610    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f8a02a-e9e0-47a2-ae57-129514acd417" containerName="maas-api"
Jul 27 19:58:10.881032 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880618    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd20ed4-50ca-4ff9-85b6-a81a6d645991" containerName="payload-pre-processing"
Jul 27 19:58:10.881032 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880625    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2cb6d1-063d-456a-9add-a032a6b152c5" containerName="maas-api"
Jul 27 19:58:10.881032 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.880631    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="745d4c30-dfd7-4a5a-98c3-be523514530b" containerName="payload-processing"
Jul 27 19:58:10.885000 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.884981    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:10.888811 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.888779    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dclfl\""
Jul 27 19:58:10.889145 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.889118    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-4289a9-serving-cert\""
Jul 27 19:58:10.889531 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.889490    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:58:10.892012 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.891995    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:58:10.907952 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.907930    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"]
Jul 27 19:58:10.974158 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.974071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdf4g\" (UniqueName: \"kubernetes.io/projected/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-kube-api-access-qdf4g\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:10.974158 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.974149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:10.974339 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.974261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:10.989135 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:10.989106    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:11.075547 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.075492    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:11.075708 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.075633    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:11.075708 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:58:11.075653    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-serving-cert: secret "maas-api-e2e-shared-a-4289a9-serving-cert" not found
Jul 27 19:58:11.075708 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.075670    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdf4g\" (UniqueName: \"kubernetes.io/projected/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-kube-api-access-qdf4g\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:11.075813 ip-10-0-141-32 kubenswrapper[2558]: E0727 19:58:11.075731    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls podName:a8c2c184-18c4-4bc9-8c88-68af8c8c96fe nodeName:}" failed. No retries permitted until 2026-07-27 19:58:11.575707923 +0000 UTC m=+2426.315263507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls") pod "maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb" (UID: "a8c2c184-18c4-4bc9-8c88-68af8c8c96fe") : secret "maas-api-e2e-shared-a-4289a9-serving-cert" not found
Jul 27 19:58:11.076302 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.076281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:11.090026 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.089996    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdf4g\" (UniqueName: \"kubernetes.io/projected/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-kube-api-access-qdf4g\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:11.505796 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.505752    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:11.580508 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.580456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:11.583192 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.583167    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls\") pod \"maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:11.711421 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.711387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:11.797653 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.797582    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:11.860015 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.859955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:11.891649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.891617    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"]
Jul 27 19:58:11.895054 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.895028    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:11.897951 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.897930    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-4289a9-dockercfg-86kws\""
Jul 27 19:58:11.898069 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.897932    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-4289a9\""
Jul 27 19:58:11.908793 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.908756    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"]
Jul 27 19:58:11.938531 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.938509    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"]
Jul 27 19:58:11.959611 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.959586    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"]
Jul 27 19:58:11.967805 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.967783    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:11.978163 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.978139    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"]
Jul 27 19:58:11.985172 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.985150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7215290e-8749-44c3-b1f6-893ad774f9c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg\" (UID: \"7215290e-8749-44c3-b1f6-893ad774f9c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:11.985282 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:11.985200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf8nl\" (UniqueName: \"kubernetes.io/projected/7215290e-8749-44c3-b1f6-893ad774f9c6-kube-api-access-gf8nl\") pod \"payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg\" (UID: \"7215290e-8749-44c3-b1f6-893ad774f9c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:12.086817 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.086735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7215290e-8749-44c3-b1f6-893ad774f9c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg\" (UID: \"7215290e-8749-44c3-b1f6-893ad774f9c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:12.086817 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.086793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv9jv\" (UniqueName: \"kubernetes.io/projected/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-kube-api-access-bv9jv\") pod \"payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h\" (UID: \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:12.086817 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.086816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf8nl\" (UniqueName: \"kubernetes.io/projected/7215290e-8749-44c3-b1f6-893ad774f9c6-kube-api-access-gf8nl\") pod \"payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg\" (UID: \"7215290e-8749-44c3-b1f6-893ad774f9c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:12.087088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.086859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h\" (UID: \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:12.087617 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.087575    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7215290e-8749-44c3-b1f6-893ad774f9c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg\" (UID: \"7215290e-8749-44c3-b1f6-893ad774f9c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:12.100196 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.100163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf8nl\" (UniqueName: \"kubernetes.io/projected/7215290e-8749-44c3-b1f6-893ad774f9c6-kube-api-access-gf8nl\") pod \"payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg\" (UID: \"7215290e-8749-44c3-b1f6-893ad774f9c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:12.187460 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.187427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h\" (UID: \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:12.187667 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.187556    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv9jv\" (UniqueName: \"kubernetes.io/projected/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-kube-api-access-bv9jv\") pod \"payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h\" (UID: \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:12.188088 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.188069    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h\" (UID: \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:12.196545 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.196522    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv9jv\" (UniqueName: \"kubernetes.io/projected/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-kube-api-access-bv9jv\") pod \"payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h\" (UID: \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:12.207339 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.207317    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:12.279431 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.279403    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:12.347470 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.346393    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"]
Jul 27 19:58:12.349970 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:58:12.349935    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7215290e_8749_44c3_b1f6_893ad774f9c6.slice/crio-d07bfeb4ea61a52f0e457cbfd32ec2a5ded68c5b1220a6ddd5f39f72e306b774 WatchSource:0}: Error finding container d07bfeb4ea61a52f0e457cbfd32ec2a5ded68c5b1220a6ddd5f39f72e306b774: Status 404 returned error can't find the container with id d07bfeb4ea61a52f0e457cbfd32ec2a5ded68c5b1220a6ddd5f39f72e306b774
Jul 27 19:58:12.424273 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.424249    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"]
Jul 27 19:58:12.426644 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:58:12.426620    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdfe799_1b90_45c1_b2a9_0a0663c758f2.slice/crio-e01fdf15b2a5220eac17ffe03de60b86c00233dcc50b021262a68c503b4756b5 WatchSource:0}: Error finding container e01fdf15b2a5220eac17ffe03de60b86c00233dcc50b021262a68c503b4756b5: Status 404 returned error can't find the container with id e01fdf15b2a5220eac17ffe03de60b86c00233dcc50b021262a68c503b4756b5
Jul 27 19:58:12.728911 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.728860    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg" event={"ID":"7215290e-8749-44c3-b1f6-893ad774f9c6","Type":"ContainerStarted","Data":"418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9"}
Jul 27 19:58:12.729095 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.728933    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg" event={"ID":"7215290e-8749-44c3-b1f6-893ad774f9c6","Type":"ContainerStarted","Data":"d07bfeb4ea61a52f0e457cbfd32ec2a5ded68c5b1220a6ddd5f39f72e306b774"}
Jul 27 19:58:12.729095 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.728964    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:12.730347 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.730322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb" event={"ID":"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe","Type":"ContainerStarted","Data":"c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872"}
Jul 27 19:58:12.730478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.730371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb" event={"ID":"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe","Type":"ContainerStarted","Data":"70cf023b25c82315c7d79bebc766daa82d2acb72ea2e899b7302ec82c11b5fb6"}
Jul 27 19:58:12.730478 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.730404    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:12.731900 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.731876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h" event={"ID":"3bdfe799-1b90-45c1-b2a9-0a0663c758f2","Type":"ContainerStarted","Data":"4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8"}
Jul 27 19:58:12.731996 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.731924    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h" event={"ID":"3bdfe799-1b90-45c1-b2a9-0a0663c758f2","Type":"ContainerStarted","Data":"e01fdf15b2a5220eac17ffe03de60b86c00233dcc50b021262a68c503b4756b5"}
Jul 27 19:58:12.732081 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.732003    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:12.747067 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.747018    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg" podStartSLOduration=1.747001864 podStartE2EDuration="1.747001864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:58:12.744662458 +0000 UTC m=+2427.484218064" watchObservedRunningTime="2026-07-27 19:58:12.747001864 +0000 UTC m=+2427.486557470"
Jul 27 19:58:12.764643 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.764601    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb" podStartSLOduration=2.347589487 podStartE2EDuration="2.764589334s" totalImagesPullingTime="416.999847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:58:12.762226169 +0000 UTC m=+2427.501781783" watchObservedRunningTime="2026-07-27 19:58:12.764589334 +0000 UTC m=+2427.504144938"
Jul 27 19:58:12.779433 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:12.779390    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h" podStartSLOduration=1.779378831 podStartE2EDuration="1.779378831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:58:12.777763586 +0000 UTC m=+2427.517319192" watchObservedRunningTime="2026-07-27 19:58:12.779378831 +0000 UTC m=+2427.518934436"
Jul 27 19:58:15.274285 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:15.274248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:15.585716 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:15.585634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:15.899224 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:15.899151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:15.994074 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:15.994038    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:58:16.373441 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:16.373402    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:18.741903 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:18.741871    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 19:58:18.828778 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:18.828750    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:18.965201 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:18.965170    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:19.122689 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.122615    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"]
Jul 27 19:58:19.127175 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.127156    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.129627 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.129606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f99bfd-serving-cert\""
Jul 27 19:58:19.136979 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.136959    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"]
Jul 27 19:58:19.164410 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.164383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:19.251446 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.251411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28646956-e5b3-482b-a3ce-f88b28e194dc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.251626 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.251456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmwkx\" (UniqueName: \"kubernetes.io/projected/28646956-e5b3-482b-a3ce-f88b28e194dc-kube-api-access-bmwkx\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.251626 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.251486    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28646956-e5b3-482b-a3ce-f88b28e194dc-maas-api-tls\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.328692 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.328638    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:19.352854 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.352826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28646956-e5b3-482b-a3ce-f88b28e194dc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.352995 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.352868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmwkx\" (UniqueName: \"kubernetes.io/projected/28646956-e5b3-482b-a3ce-f88b28e194dc-kube-api-access-bmwkx\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.352995 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.352903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28646956-e5b3-482b-a3ce-f88b28e194dc-maas-api-tls\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.353493 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.353468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28646956-e5b3-482b-a3ce-f88b28e194dc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.355378 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.355360    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28646956-e5b3-482b-a3ce-f88b28e194dc-maas-api-tls\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.361472 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.361451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmwkx\" (UniqueName: \"kubernetes.io/projected/28646956-e5b3-482b-a3ce-f88b28e194dc-kube-api-access-bmwkx\") pod \"maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.437947 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.437912    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:19.568550 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.568521    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"]
Jul 27 19:58:19.746755 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.746674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:19.764990 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.764943    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h" event={"ID":"28646956-e5b3-482b-a3ce-f88b28e194dc","Type":"ContainerStarted","Data":"743b11a7c53e1207e88aa5eded0d87231138e53012643b48a0f7c90b3d63a6a3"}
Jul 27 19:58:19.905096 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.905069    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:19.917038 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.917008    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"]
Jul 27 19:58:19.922011 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.921992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:19.924212 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.924183    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-f99bfd\""
Jul 27 19:58:19.924649 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.924634    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-f99bfd-dockercfg-kfzjw\""
Jul 27 19:58:19.929890 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:19.929866    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"]
Jul 27 19:58:20.060727 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.060638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx7g8\" (UniqueName: \"kubernetes.io/projected/ed12b8ef-6f85-48d0-87ad-0614a464c077-kube-api-access-zx7g8\") pod \"payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4\" (UID: \"ed12b8ef-6f85-48d0-87ad-0614a464c077\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:20.060727 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.060681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed12b8ef-6f85-48d0-87ad-0614a464c077-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4\" (UID: \"ed12b8ef-6f85-48d0-87ad-0614a464c077\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:20.161950 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.161917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx7g8\" (UniqueName: \"kubernetes.io/projected/ed12b8ef-6f85-48d0-87ad-0614a464c077-kube-api-access-zx7g8\") pod \"payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4\" (UID: \"ed12b8ef-6f85-48d0-87ad-0614a464c077\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:20.162132 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.161963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed12b8ef-6f85-48d0-87ad-0614a464c077-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4\" (UID: \"ed12b8ef-6f85-48d0-87ad-0614a464c077\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:20.162656 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.162631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed12b8ef-6f85-48d0-87ad-0614a464c077-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4\" (UID: \"ed12b8ef-6f85-48d0-87ad-0614a464c077\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:20.170267 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.170242    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx7g8\" (UniqueName: \"kubernetes.io/projected/ed12b8ef-6f85-48d0-87ad-0614a464c077-kube-api-access-zx7g8\") pod \"payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4\" (UID: \"ed12b8ef-6f85-48d0-87ad-0614a464c077\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:20.233873 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.233839    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:20.362256 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.362233    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"]
Jul 27 19:58:20.365558 ip-10-0-141-32 kubenswrapper[2558]: W0727 19:58:20.365530    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded12b8ef_6f85_48d0_87ad_0614a464c077.slice/crio-93e7ed2a1fb0604a7ded042a05dd74e8be3367204ddb9084553697818156f3fc WatchSource:0}: Error finding container 93e7ed2a1fb0604a7ded042a05dd74e8be3367204ddb9084553697818156f3fc: Status 404 returned error can't find the container with id 93e7ed2a1fb0604a7ded042a05dd74e8be3367204ddb9084553697818156f3fc
Jul 27 19:58:20.770897 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.770864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h" event={"ID":"28646956-e5b3-482b-a3ce-f88b28e194dc","Type":"ContainerStarted","Data":"b5c1e65a4379094d3da6448eb55746a2e250031cd9df8b5b54651ec336111acc"}
Jul 27 19:58:20.771367 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.770973    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:20.772234 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.772213    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4" event={"ID":"ed12b8ef-6f85-48d0-87ad-0614a464c077","Type":"ContainerStarted","Data":"52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f"}
Jul 27 19:58:20.772331 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.772247    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4" event={"ID":"ed12b8ef-6f85-48d0-87ad-0614a464c077","Type":"ContainerStarted","Data":"93e7ed2a1fb0604a7ded042a05dd74e8be3367204ddb9084553697818156f3fc"}
Jul 27 19:58:20.772331 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.772283    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:20.791041 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.790994    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h" podStartSLOduration=1.482165149 podStartE2EDuration="1.790980824s" totalImagesPullingTime="308.815675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:58:20.789946747 +0000 UTC m=+2435.529502352" watchObservedRunningTime="2026-07-27 19:58:20.790980824 +0000 UTC m=+2435.530536431"
Jul 27 19:58:20.806338 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:20.806272    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4" podStartSLOduration=1.8062565830000001 podStartE2EDuration="1.806256583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:58:20.805649067 +0000 UTC m=+2435.545204673" watchObservedRunningTime="2026-07-27 19:58:20.806256583 +0000 UTC m=+2435.545812187"
Jul 27 19:58:23.289772 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:23.289738    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:23.739247 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:23.739208    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 19:58:23.739552 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:23.739531    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 19:58:26.783100 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:26.783062    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 19:58:31.779370 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:31.779340    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 19:58:32.673449 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:32.673415    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:58:33.322418 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:33.322385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:35.697274 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:35.697237    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:35.817160 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:35.817126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:43.289766 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:43.289728    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:44.303012 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:44.302975    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:58:54.502650 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:58:54.502617    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:59:08.326363 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:59:08.326326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 19:59:12.380442 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:59:12.380405    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:59:39.972877 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:59:39.972844    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 19:59:54.331657 ip-10-0-141-32 kubenswrapper[2558]: I0727 19:59:54.331617    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:00:07.574013 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:00:07.573975    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:00:26.085205 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:00:26.085166    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:00:38.232076 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:00:38.232035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:00:53.083382 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:00:53.083342    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:01:10.277929 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:01:10.277849    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:01:37.291009 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:01:37.290975    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:01:41.432441 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:01:41.432410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:01:41.532346 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:01:41.532314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:01:56.282113 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:01:56.282070    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:02:23.475278 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:02:23.475236    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:02:40.689553 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:02:40.689489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:03:07.181882 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:03:07.181843    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:03:25.904007 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:03:25.903966    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:03:32.520512 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:03:32.520473    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:03:53.681080 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:03:53.681045    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:03:55.383956 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:03:55.383920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:03:55.481050 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:03:55.481018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:03:58.289621 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:03:58.289586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:03:59.212974 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:03:59.212940    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:10.481270 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:04:10.481234    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:04:24.515992 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:04:24.515961    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:28.291904 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:04:28.291868    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:04:40.770061 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:04:40.770028    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:42.206466 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:04:42.206433    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:44.980320 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:04:44.980282    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:05:18.282448 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:05:18.282411    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:05:38.282610 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:05:38.282571    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:05:43.942739 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:05:43.942701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:46.195088 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:05:46.195053    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:54.084016 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:05:54.083976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:05:54.788078 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:05:54.788041    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:04.084622 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:06:04.084586    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:06:27.681794 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:06:27.681758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:31.888986 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:06:31.888948    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:06:59.855152 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:06:59.855115    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:13.788058 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:07:13.788018    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:07:36.496060 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:07:36.496024    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:07:42.676901 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:07:42.676838    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:43.727097 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:07:43.727067    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:54.790509 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:07:54.790465    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:08:02.500486 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:02.500450    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:03.288789 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:03.288752    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:03.468365 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:03.468320    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:08.810372 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:08.810338    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:08.915864 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:08.915831    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"]
Jul 27 20:08:08.919150 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:08.919126    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:08.921443 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:08.921427    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-58c998-serving-cert\""
Jul 27 20:08:08.940692 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:08.940663    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:08.941108 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:08.941090    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"]
Jul 27 20:08:09.059145 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.059106    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:09.064411 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.064352    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxcch\" (UniqueName: \"kubernetes.io/projected/113b0dda-34b7-42c3-aeea-af7fe5b984fc-kube-api-access-cxcch\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.064411 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.064403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113b0dda-34b7-42c3-aeea-af7fe5b984fc-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.064561 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.064445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113b0dda-34b7-42c3-aeea-af7fe5b984fc-maas-api-tls\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.165272 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.165241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxcch\" (UniqueName: \"kubernetes.io/projected/113b0dda-34b7-42c3-aeea-af7fe5b984fc-kube-api-access-cxcch\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.165484 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.165298    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113b0dda-34b7-42c3-aeea-af7fe5b984fc-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.165484 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.165333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113b0dda-34b7-42c3-aeea-af7fe5b984fc-maas-api-tls\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.166009 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.165988    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113b0dda-34b7-42c3-aeea-af7fe5b984fc-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.167739 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.167720    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113b0dda-34b7-42c3-aeea-af7fe5b984fc-maas-api-tls\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.175066 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.175044    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxcch\" (UniqueName: \"kubernetes.io/projected/113b0dda-34b7-42c3-aeea-af7fe5b984fc-kube-api-access-cxcch\") pod \"maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.187433 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.187404    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:09.229163 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.229129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:09.373824 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.373797    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"]
Jul 27 20:08:09.376006 ip-10-0-141-32 kubenswrapper[2558]: W0727 20:08:09.375975    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113b0dda_34b7_42c3_aeea_af7fe5b984fc.slice/crio-a4c7025dbdc39b930280de6afc953218b7d419562781d2102e9e981ff42c1db9 WatchSource:0}: Error finding container a4c7025dbdc39b930280de6afc953218b7d419562781d2102e9e981ff42c1db9: Status 404 returned error can't find the container with id a4c7025dbdc39b930280de6afc953218b7d419562781d2102e9e981ff42c1db9
Jul 27 20:08:09.377404 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.377383    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:08:09.628593 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.628513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:09.754685 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.754657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:09.850741 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.850710    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"]
Jul 27 20:08:09.855030 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.855012    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:09.860768 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.860750    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-58c998-dockercfg-x9vsq\""
Jul 27 20:08:09.864640 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.864623    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-58c998\""
Jul 27 20:08:09.875922 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.875899    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"]
Jul 27 20:08:09.918893 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.918818    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"]
Jul 27 20:08:09.922313 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.922291    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:09.956476 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.954151    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"]
Jul 27 20:08:09.973167 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.973132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72af1e15-e5a2-422e-8cfe-8925a59cf533-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n\" (UID: \"72af1e15-e5a2-422e-8cfe-8925a59cf533\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:09.973347 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:09.973303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmsrn\" (UniqueName: \"kubernetes.io/projected/72af1e15-e5a2-422e-8cfe-8925a59cf533-kube-api-access-lmsrn\") pod \"payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n\" (UID: \"72af1e15-e5a2-422e-8cfe-8925a59cf533\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:10.074142 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.074099    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54042379-55b0-46cb-8d2a-a1517c20d9b8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q\" (UID: \"54042379-55b0-46cb-8d2a-a1517c20d9b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:10.074337 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.074153    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmsrn\" (UniqueName: \"kubernetes.io/projected/72af1e15-e5a2-422e-8cfe-8925a59cf533-kube-api-access-lmsrn\") pod \"payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n\" (UID: \"72af1e15-e5a2-422e-8cfe-8925a59cf533\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:10.074337 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.074202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72af1e15-e5a2-422e-8cfe-8925a59cf533-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n\" (UID: \"72af1e15-e5a2-422e-8cfe-8925a59cf533\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:10.074337 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.074242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptjlg\" (UniqueName: \"kubernetes.io/projected/54042379-55b0-46cb-8d2a-a1517c20d9b8-kube-api-access-ptjlg\") pod \"payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q\" (UID: \"54042379-55b0-46cb-8d2a-a1517c20d9b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:10.074935 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.074915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72af1e15-e5a2-422e-8cfe-8925a59cf533-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n\" (UID: \"72af1e15-e5a2-422e-8cfe-8925a59cf533\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:10.089278 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.089244    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmsrn\" (UniqueName: \"kubernetes.io/projected/72af1e15-e5a2-422e-8cfe-8925a59cf533-kube-api-access-lmsrn\") pod \"payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n\" (UID: \"72af1e15-e5a2-422e-8cfe-8925a59cf533\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:10.165268 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.165233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:10.175540 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.175437    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptjlg\" (UniqueName: \"kubernetes.io/projected/54042379-55b0-46cb-8d2a-a1517c20d9b8-kube-api-access-ptjlg\") pod \"payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q\" (UID: \"54042379-55b0-46cb-8d2a-a1517c20d9b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:10.175685 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.175555    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54042379-55b0-46cb-8d2a-a1517c20d9b8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q\" (UID: \"54042379-55b0-46cb-8d2a-a1517c20d9b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:10.176680 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.176481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54042379-55b0-46cb-8d2a-a1517c20d9b8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q\" (UID: \"54042379-55b0-46cb-8d2a-a1517c20d9b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:10.185482 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.185449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptjlg\" (UniqueName: \"kubernetes.io/projected/54042379-55b0-46cb-8d2a-a1517c20d9b8-kube-api-access-ptjlg\") pod \"payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q\" (UID: \"54042379-55b0-46cb-8d2a-a1517c20d9b8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:10.232597 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.232567    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:10.297155 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.297121    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg" event={"ID":"113b0dda-34b7-42c3-aeea-af7fe5b984fc","Type":"ContainerStarted","Data":"16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0"}
Jul 27 20:08:10.297268 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.297188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg" event={"ID":"113b0dda-34b7-42c3-aeea-af7fe5b984fc","Type":"ContainerStarted","Data":"a4c7025dbdc39b930280de6afc953218b7d419562781d2102e9e981ff42c1db9"}
Jul 27 20:08:10.297852 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.297822    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:10.324836 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.324812    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"]
Jul 27 20:08:10.327254 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.327210    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg" podStartSLOduration=1.9058328850000001 podStartE2EDuration="2.327194787s" totalImagesPullingTime="421.361902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:10.325345101 +0000 UTC m=+3025.064900707" watchObservedRunningTime="2026-07-27 20:08:10.327194787 +0000 UTC m=+3025.066750391"
Jul 27 20:08:10.327746 ip-10-0-141-32 kubenswrapper[2558]: W0727 20:08:10.327650    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72af1e15_e5a2_422e_8cfe_8925a59cf533.slice/crio-1d3e2ca41550aab03d0187b5210e5c788b4559dd36364eb2dea6517f3a4051eb WatchSource:0}: Error finding container 1d3e2ca41550aab03d0187b5210e5c788b4559dd36364eb2dea6517f3a4051eb: Status 404 returned error can't find the container with id 1d3e2ca41550aab03d0187b5210e5c788b4559dd36364eb2dea6517f3a4051eb
Jul 27 20:08:10.402846 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:10.402821    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"]
Jul 27 20:08:10.406971 ip-10-0-141-32 kubenswrapper[2558]: W0727 20:08:10.406942    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54042379_55b0_46cb_8d2a_a1517c20d9b8.slice/crio-bcbe54f657b17f2c3abe0c6d7616999e0ddd6be27dd4d350f6cabe108d120f9f WatchSource:0}: Error finding container bcbe54f657b17f2c3abe0c6d7616999e0ddd6be27dd4d350f6cabe108d120f9f: Status 404 returned error can't find the container with id bcbe54f657b17f2c3abe0c6d7616999e0ddd6be27dd4d350f6cabe108d120f9f
Jul 27 20:08:11.303683 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:11.303634    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q" event={"ID":"54042379-55b0-46cb-8d2a-a1517c20d9b8","Type":"ContainerStarted","Data":"79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b"}
Jul 27 20:08:11.304157 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:11.303705    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q" event={"ID":"54042379-55b0-46cb-8d2a-a1517c20d9b8","Type":"ContainerStarted","Data":"bcbe54f657b17f2c3abe0c6d7616999e0ddd6be27dd4d350f6cabe108d120f9f"}
Jul 27 20:08:11.304157 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:11.303766    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:11.305213 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:11.305192    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n" event={"ID":"72af1e15-e5a2-422e-8cfe-8925a59cf533","Type":"ContainerStarted","Data":"f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6"}
Jul 27 20:08:11.305297 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:11.305230    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n" event={"ID":"72af1e15-e5a2-422e-8cfe-8925a59cf533","Type":"ContainerStarted","Data":"1d3e2ca41550aab03d0187b5210e5c788b4559dd36364eb2dea6517f3a4051eb"}
Jul 27 20:08:11.305457 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:11.305445    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:11.327023 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:11.326978    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q" podStartSLOduration=2.3269665 podStartE2EDuration="2.3269665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:11.325204006 +0000 UTC m=+3026.064759611" watchObservedRunningTime="2026-07-27 20:08:11.3269665 +0000 UTC m=+3026.066522083"
Jul 27 20:08:11.345587 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:11.345544    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n" podStartSLOduration=2.345531678 podStartE2EDuration="2.345531678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:11.344114616 +0000 UTC m=+3026.083670203" watchObservedRunningTime="2026-07-27 20:08:11.345531678 +0000 UTC m=+3026.085087282"
Jul 27 20:08:12.783813 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:12.783778    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:08:13.386835 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:13.386803    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:17.315323 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:17.315295    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:08:22.312695 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:22.312661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:08:22.313172 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:22.312749    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:08:24.253288 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:24.253259    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:24.568373 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:24.568295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:24.982419 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:24.982386    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:27.948056 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:27.948018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:28.073904 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:28.073865    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:28.277490 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:28.277406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:28.784103 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:28.784070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:28.928921 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:28.928892    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:29.023958 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.023899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:29.135078 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.134990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"]
Jul 27 20:08:29.138317 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.138295    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:29.140716 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.140697    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-791fb5\""
Jul 27 20:08:29.140923 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.140908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-791fb5-dockercfg-jj4wb\""
Jul 27 20:08:29.150053 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.150030    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"]
Jul 27 20:08:29.195474 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.195437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:29.236447 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.236417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlfzx\" (UniqueName: \"kubernetes.io/projected/1fb7e3a0-15c3-4794-8823-c885533bd8c1-kube-api-access-qlfzx\") pod \"payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck\" (UID: \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:29.236631 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.236513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb7e3a0-15c3-4794-8823-c885533bd8c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck\" (UID: \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:29.337335 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.337299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb7e3a0-15c3-4794-8823-c885533bd8c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck\" (UID: \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:29.337518 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.337347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlfzx\" (UniqueName: \"kubernetes.io/projected/1fb7e3a0-15c3-4794-8823-c885533bd8c1-kube-api-access-qlfzx\") pod \"payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck\" (UID: \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:29.338084 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.338064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb7e3a0-15c3-4794-8823-c885533bd8c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck\" (UID: \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:29.347707 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.347683    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlfzx\" (UniqueName: \"kubernetes.io/projected/1fb7e3a0-15c3-4794-8823-c885533bd8c1-kube-api-access-qlfzx\") pod \"payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck\" (UID: \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:29.449340 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.449308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:29.585449 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:29.585425    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"]
Jul 27 20:08:29.587299 ip-10-0-141-32 kubenswrapper[2558]: W0727 20:08:29.587261    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb7e3a0_15c3_4794_8823_c885533bd8c1.slice/crio-45504a34766371e5ea61f66a234961f2cdd060007a5f3d76db78dd3042884aca WatchSource:0}: Error finding container 45504a34766371e5ea61f66a234961f2cdd060007a5f3d76db78dd3042884aca: Status 404 returned error can't find the container with id 45504a34766371e5ea61f66a234961f2cdd060007a5f3d76db78dd3042884aca
Jul 27 20:08:30.392014 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:30.391981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck" event={"ID":"1fb7e3a0-15c3-4794-8823-c885533bd8c1","Type":"ContainerStarted","Data":"59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7"}
Jul 27 20:08:30.392380 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:30.392027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck" event={"ID":"1fb7e3a0-15c3-4794-8823-c885533bd8c1","Type":"ContainerStarted","Data":"45504a34766371e5ea61f66a234961f2cdd060007a5f3d76db78dd3042884aca"}
Jul 27 20:08:30.392380 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:30.392059    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:30.414788 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:30.414733    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck" podStartSLOduration=1.414718854 podStartE2EDuration="1.414718854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:30.411750397 +0000 UTC m=+3045.151306002" watchObservedRunningTime="2026-07-27 20:08:30.414718854 +0000 UTC m=+3045.154274459"
Jul 27 20:08:32.425341 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:32.425303    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:35.385695 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:35.385658    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:08:41.398829 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:41.398797    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:08:59.044682 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:08:59.044647    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:02.794370 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:02.794335    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:09:30.476192 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:30.476160    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:09:41.655646 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:41.655612    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q_54042379-55b0-46cb-8d2a-a1517c20d9b8/payload-processing/0.log"
Jul 27 20:09:42.197370 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:42.197338    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:42.627134 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:42.627046    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:42.754168 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:42.754132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:45.354090 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.354053    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:45.458607 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.458582    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:45.621948 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.621870    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"]
Jul 27 20:09:45.625250 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.625228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:45.628897 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.628876    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-d8e48b-serving-cert\""
Jul 27 20:09:45.642182 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.642162    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"]
Jul 27 20:09:45.693744 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.693716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:45.700983 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.700958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr2t5\" (UniqueName: \"kubernetes.io/projected/e243c4a5-e917-47a8-936c-40b9d84541c3-kube-api-access-xr2t5\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:45.701092 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.700998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:45.701092 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.701016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c4a5-e917-47a8-936c-40b9d84541c3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:45.802563 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.802528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr2t5\" (UniqueName: \"kubernetes.io/projected/e243c4a5-e917-47a8-936c-40b9d84541c3-kube-api-access-xr2t5\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:45.802563 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.802565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:45.802767 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.802582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c4a5-e917-47a8-936c-40b9d84541c3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:45.802767 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:09:45.802712    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-serving-cert: secret "maas-api-e2e-ipp-cleanup-d8e48b-serving-cert" not found
Jul 27 20:09:45.802838 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:09:45.802772    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls podName:e243c4a5-e917-47a8-936c-40b9d84541c3 nodeName:}" failed. No retries permitted until 2026-07-27 20:09:46.302754833 +0000 UTC m=+3121.042310417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw" (UID: "e243c4a5-e917-47a8-936c-40b9d84541c3") : secret "maas-api-e2e-ipp-cleanup-d8e48b-serving-cert" not found
Jul 27 20:09:45.803162 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.803144    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c4a5-e917-47a8-936c-40b9d84541c3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:45.817941 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:45.817912    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr2t5\" (UniqueName: \"kubernetes.io/projected/e243c4a5-e917-47a8-936c-40b9d84541c3-kube-api-access-xr2t5\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:46.038943 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.038910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:46.307477 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.307385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:46.310024 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.310003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:46.499331 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.499300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:46.535290 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.535252    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:46.607111 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.607080    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"]
Jul 27 20:09:46.610636 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.610613    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:46.613413 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.613396    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-d8e48b\""
Jul 27 20:09:46.630707 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.630679    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"]
Jul 27 20:09:46.674201 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.674160    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"]
Jul 27 20:09:46.677727 ip-10-0-141-32 kubenswrapper[2558]: W0727 20:09:46.677701    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode243c4a5_e917_47a8_936c_40b9d84541c3.slice/crio-01d96e5c87fcbfd7543de4b624c8ae47d7645f3d0105ae5c870af780bd2d741a WatchSource:0}: Error finding container 01d96e5c87fcbfd7543de4b624c8ae47d7645f3d0105ae5c870af780bd2d741a: Status 404 returned error can't find the container with id 01d96e5c87fcbfd7543de4b624c8ae47d7645f3d0105ae5c870af780bd2d741a
Jul 27 20:09:46.709941 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.709911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e9545d6-991b-4bfa-a624-4d27842fc653-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt\" (UID: \"2e9545d6-991b-4bfa-a624-4d27842fc653\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:46.710096 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.709963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr7ml\" (UniqueName: \"kubernetes.io/projected/2e9545d6-991b-4bfa-a624-4d27842fc653-kube-api-access-gr7ml\") pod \"payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt\" (UID: \"2e9545d6-991b-4bfa-a624-4d27842fc653\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:46.744230 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.744090    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw" event={"ID":"e243c4a5-e917-47a8-936c-40b9d84541c3","Type":"ContainerStarted","Data":"01d96e5c87fcbfd7543de4b624c8ae47d7645f3d0105ae5c870af780bd2d741a"}
Jul 27 20:09:46.745531 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.745481    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:46.811383 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.811347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr7ml\" (UniqueName: \"kubernetes.io/projected/2e9545d6-991b-4bfa-a624-4d27842fc653-kube-api-access-gr7ml\") pod \"payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt\" (UID: \"2e9545d6-991b-4bfa-a624-4d27842fc653\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:46.811561 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.811435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e9545d6-991b-4bfa-a624-4d27842fc653-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt\" (UID: \"2e9545d6-991b-4bfa-a624-4d27842fc653\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:46.812091 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.812073    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e9545d6-991b-4bfa-a624-4d27842fc653-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt\" (UID: \"2e9545d6-991b-4bfa-a624-4d27842fc653\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:46.822159 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.822133    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr7ml\" (UniqueName: \"kubernetes.io/projected/2e9545d6-991b-4bfa-a624-4d27842fc653-kube-api-access-gr7ml\") pod \"payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt\" (UID: \"2e9545d6-991b-4bfa-a624-4d27842fc653\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:46.922733 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:46.922657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:47.057585 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:47.057558    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"]
Jul 27 20:09:47.058811 ip-10-0-141-32 kubenswrapper[2558]: W0727 20:09:47.058781    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9545d6_991b_4bfa_a624_4d27842fc653.slice/crio-6d6e1e91e1e08cdc0bc239fdbada6603cc16a133413541d4d2548056f38dd3a8 WatchSource:0}: Error finding container 6d6e1e91e1e08cdc0bc239fdbada6603cc16a133413541d4d2548056f38dd3a8: Status 404 returned error can't find the container with id 6d6e1e91e1e08cdc0bc239fdbada6603cc16a133413541d4d2548056f38dd3a8
Jul 27 20:09:47.749827 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:47.749792    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt" event={"ID":"2e9545d6-991b-4bfa-a624-4d27842fc653","Type":"ContainerStarted","Data":"db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307"}
Jul 27 20:09:47.750283 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:47.749848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt" event={"ID":"2e9545d6-991b-4bfa-a624-4d27842fc653","Type":"ContainerStarted","Data":"6d6e1e91e1e08cdc0bc239fdbada6603cc16a133413541d4d2548056f38dd3a8"}
Jul 27 20:09:47.750283 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:47.749893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:09:47.751238 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:47.751215    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw" event={"ID":"e243c4a5-e917-47a8-936c-40b9d84541c3","Type":"ContainerStarted","Data":"fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e"}
Jul 27 20:09:47.751360 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:47.751263    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:47.769483 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:47.769432    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt" podStartSLOduration=1.7694197310000002 podStartE2EDuration="1.769419731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:09:47.767074145 +0000 UTC m=+3122.506629750" watchObservedRunningTime="2026-07-27 20:09:47.769419731 +0000 UTC m=+3122.508975336"
Jul 27 20:09:47.789757 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:47.789711    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw" podStartSLOduration=2.312241259 podStartE2EDuration="2.789697057s" totalImagesPullingTime="477.455798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:09:47.787016142 +0000 UTC m=+3122.526571748" watchObservedRunningTime="2026-07-27 20:09:47.789697057 +0000 UTC m=+3122.529252691"
Jul 27 20:09:49.848064 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:49.848032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:50.882956 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:50.882919    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:09:53.761065 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:53.761036    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:09:58.758057 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:09:58.758026    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:10:10.956591 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:10.956559    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"]
Jul 27 20:10:10.957007 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:10.956762    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw" podUID="e243c4a5-e917-47a8-936c-40b9d84541c3" containerName="maas-api" containerID="cri-o://fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e" gracePeriod=30
Jul 27 20:10:11.000734 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.000706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:11.082982 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.082950    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"]
Jul 27 20:10:11.083193 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.083170    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt" podUID="2e9545d6-991b-4bfa-a624-4d27842fc653" containerName="payload-processing" containerID="cri-o://db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307" gracePeriod=30
Jul 27 20:10:11.131943 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.131889    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:11.216176 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.216118    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:10:11.284053 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.284028    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:11.331630 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.331600    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c4a5-e917-47a8-936c-40b9d84541c3-openshift-service-ca\") pod \"e243c4a5-e917-47a8-936c-40b9d84541c3\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") "
Jul 27 20:10:11.331814 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.331698    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr2t5\" (UniqueName: \"kubernetes.io/projected/e243c4a5-e917-47a8-936c-40b9d84541c3-kube-api-access-xr2t5\") pod \"e243c4a5-e917-47a8-936c-40b9d84541c3\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") "
Jul 27 20:10:11.331814 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.331728    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls\") pod \"e243c4a5-e917-47a8-936c-40b9d84541c3\" (UID: \"e243c4a5-e917-47a8-936c-40b9d84541c3\") "
Jul 27 20:10:11.332017 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.331990    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e243c4a5-e917-47a8-936c-40b9d84541c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e243c4a5-e917-47a8-936c-40b9d84541c3" (UID: "e243c4a5-e917-47a8-936c-40b9d84541c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:10:11.333947 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.333925    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e243c4a5-e917-47a8-936c-40b9d84541c3-kube-api-access-xr2t5" (OuterVolumeSpecName: "kube-api-access-xr2t5") pod "e243c4a5-e917-47a8-936c-40b9d84541c3" (UID: "e243c4a5-e917-47a8-936c-40b9d84541c3"). InnerVolumeSpecName "kube-api-access-xr2t5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:10:11.334061 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.333965    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e243c4a5-e917-47a8-936c-40b9d84541c3" (UID: "e243c4a5-e917-47a8-936c-40b9d84541c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:10:11.351871 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.351847    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:10:11.432914 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.432888    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c4a5-e917-47a8-936c-40b9d84541c3-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:11.432914 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.432911    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr2t5\" (UniqueName: \"kubernetes.io/projected/e243c4a5-e917-47a8-936c-40b9d84541c3-kube-api-access-xr2t5\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:11.433095 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.432923    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e243c4a5-e917-47a8-936c-40b9d84541c3-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:11.534060 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.533983    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr7ml\" (UniqueName: \"kubernetes.io/projected/2e9545d6-991b-4bfa-a624-4d27842fc653-kube-api-access-gr7ml\") pod \"2e9545d6-991b-4bfa-a624-4d27842fc653\" (UID: \"2e9545d6-991b-4bfa-a624-4d27842fc653\") "
Jul 27 20:10:11.534197 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.534101    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e9545d6-991b-4bfa-a624-4d27842fc653-plugins-config-volume\") pod \"2e9545d6-991b-4bfa-a624-4d27842fc653\" (UID: \"2e9545d6-991b-4bfa-a624-4d27842fc653\") "
Jul 27 20:10:11.534448 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.534421    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e9545d6-991b-4bfa-a624-4d27842fc653-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e9545d6-991b-4bfa-a624-4d27842fc653" (UID: "2e9545d6-991b-4bfa-a624-4d27842fc653"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:10:11.536016 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.535990    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e9545d6-991b-4bfa-a624-4d27842fc653-kube-api-access-gr7ml" (OuterVolumeSpecName: "kube-api-access-gr7ml") pod "2e9545d6-991b-4bfa-a624-4d27842fc653" (UID: "2e9545d6-991b-4bfa-a624-4d27842fc653"). InnerVolumeSpecName "kube-api-access-gr7ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:10:11.635346 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.635304    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e9545d6-991b-4bfa-a624-4d27842fc653-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:11.635346 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.635341    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr7ml\" (UniqueName: \"kubernetes.io/projected/2e9545d6-991b-4bfa-a624-4d27842fc653-kube-api-access-gr7ml\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:11.868479 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.868450    2558 generic.go:356] "Generic (PLEG): container finished" podID="2e9545d6-991b-4bfa-a624-4d27842fc653" containerID="db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307" exitCode=0
Jul 27 20:10:11.868647 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.868509    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"
Jul 27 20:10:11.868647 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.868540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt" event={"ID":"2e9545d6-991b-4bfa-a624-4d27842fc653","Type":"ContainerDied","Data":"db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307"}
Jul 27 20:10:11.868647 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.868597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt" event={"ID":"2e9545d6-991b-4bfa-a624-4d27842fc653","Type":"ContainerDied","Data":"6d6e1e91e1e08cdc0bc239fdbada6603cc16a133413541d4d2548056f38dd3a8"}
Jul 27 20:10:11.868647 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.868616    2558 scope.go:117] "RemoveContainer" containerID="db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307"
Jul 27 20:10:11.869814 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.869785    2558 generic.go:356] "Generic (PLEG): container finished" podID="e243c4a5-e917-47a8-936c-40b9d84541c3" containerID="fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e" exitCode=0
Jul 27 20:10:11.869935 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.869820    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"
Jul 27 20:10:11.869935 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.869848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw" event={"ID":"e243c4a5-e917-47a8-936c-40b9d84541c3","Type":"ContainerDied","Data":"fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e"}
Jul 27 20:10:11.869935 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.869880    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw" event={"ID":"e243c4a5-e917-47a8-936c-40b9d84541c3","Type":"ContainerDied","Data":"01d96e5c87fcbfd7543de4b624c8ae47d7645f3d0105ae5c870af780bd2d741a"}
Jul 27 20:10:11.876958 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.876942    2558 scope.go:117] "RemoveContainer" containerID="db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307"
Jul 27 20:10:11.877203 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:10:11.877181    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307\": container with ID starting with db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307 not found: ID does not exist" containerID="db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307"
Jul 27 20:10:11.877295 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.877209    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307"} err="failed to get container status \"db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307\": rpc error: code = NotFound desc = could not find container \"db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307\": container with ID starting with db56b5a052d440cd0202a6fe9fa731b4c0ef9d89fc1e016265709d6657168307 not found: ID does not exist"
Jul 27 20:10:11.877295 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.877225    2558 scope.go:117] "RemoveContainer" containerID="fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e"
Jul 27 20:10:11.884406 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.884386    2558 scope.go:117] "RemoveContainer" containerID="fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e"
Jul 27 20:10:11.884676 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:10:11.884656    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e\": container with ID starting with fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e not found: ID does not exist" containerID="fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e"
Jul 27 20:10:11.884742 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.884683    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e"} err="failed to get container status \"fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e\": rpc error: code = NotFound desc = could not find container \"fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e\": container with ID starting with fe2972068b846b7d00b791b5fd67644eff1d0b429a625f29c69bb88864616e8e not found: ID does not exist"
Jul 27 20:10:11.896905 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.896881    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"]
Jul 27 20:10:11.905223 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.905204    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt"]
Jul 27 20:10:11.924198 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.924174    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"]
Jul 27 20:10:11.926376 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:11.926354    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d8e48b-8896c875c-d7gvw"]
Jul 27 20:10:13.822518 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:13.822467    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9545d6-991b-4bfa-a624-4d27842fc653" path="/var/lib/kubelet/pods/2e9545d6-991b-4bfa-a624-4d27842fc653/volumes"
Jul 27 20:10:13.822909 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:13.822873    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e243c4a5-e917-47a8-936c-40b9d84541c3" path="/var/lib/kubelet/pods/e243c4a5-e917-47a8-936c-40b9d84541c3/volumes"
Jul 27 20:10:15.839964 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:15.839932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:16.307351 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:16.307316    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:10:16.320077 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:16.320048    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:22.588809 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:22.588762    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:22.685824 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:22.685771    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:22.871646 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:22.871574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:23.145927 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:23.145847    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:41.578459 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:41.578423    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:10:42.287534 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.287483    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"]
Jul 27 20:10:42.287802 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.287756    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg" podUID="113b0dda-34b7-42c3-aeea-af7fe5b984fc" containerName="maas-api" containerID="cri-o://16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0" gracePeriod=30
Jul 27 20:10:42.311066 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.311031    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg" podUID="113b0dda-34b7-42c3-aeea-af7fe5b984fc" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.52:8443/health\": dial tcp 10.134.0.52:8443: connect: connection refused"
Jul 27 20:10:42.350138 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.350109    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:42.407270 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.407245    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"]
Jul 27 20:10:42.407468 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.407448    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q" podUID="54042379-55b0-46cb-8d2a-a1517c20d9b8" containerName="payload-processing" containerID="cri-o://79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b" gracePeriod=30
Jul 27 20:10:42.416425 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.416031    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"]
Jul 27 20:10:42.416648 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.416419    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n" podUID="72af1e15-e5a2-422e-8cfe-8925a59cf533" containerName="payload-pre-processing" containerID="cri-o://f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6" gracePeriod=30
Jul 27 20:10:42.462840 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.462786    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:42.564508 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.564471    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:10:42.587825 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.587784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:42.682955 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.682930    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:10:42.693442 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.693425    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:10:42.705747 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.705722    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxcch\" (UniqueName: \"kubernetes.io/projected/113b0dda-34b7-42c3-aeea-af7fe5b984fc-kube-api-access-cxcch\") pod \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") "
Jul 27 20:10:42.705858 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.705760    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113b0dda-34b7-42c3-aeea-af7fe5b984fc-openshift-service-ca\") pod \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") "
Jul 27 20:10:42.705858 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.705805    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113b0dda-34b7-42c3-aeea-af7fe5b984fc-maas-api-tls\") pod \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\" (UID: \"113b0dda-34b7-42c3-aeea-af7fe5b984fc\") "
Jul 27 20:10:42.706591 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.706544    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/113b0dda-34b7-42c3-aeea-af7fe5b984fc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "113b0dda-34b7-42c3-aeea-af7fe5b984fc" (UID: "113b0dda-34b7-42c3-aeea-af7fe5b984fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:10:42.708564 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.708538    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/113b0dda-34b7-42c3-aeea-af7fe5b984fc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "113b0dda-34b7-42c3-aeea-af7fe5b984fc" (UID: "113b0dda-34b7-42c3-aeea-af7fe5b984fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:10:42.708669 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.708635    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113b0dda-34b7-42c3-aeea-af7fe5b984fc-kube-api-access-cxcch" (OuterVolumeSpecName: "kube-api-access-cxcch") pod "113b0dda-34b7-42c3-aeea-af7fe5b984fc" (UID: "113b0dda-34b7-42c3-aeea-af7fe5b984fc"). InnerVolumeSpecName "kube-api-access-cxcch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:10:42.806430 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72af1e15-e5a2-422e-8cfe-8925a59cf533-plugins-config-volume\") pod \"72af1e15-e5a2-422e-8cfe-8925a59cf533\" (UID: \"72af1e15-e5a2-422e-8cfe-8925a59cf533\") "
Jul 27 20:10:42.806430 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806386    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54042379-55b0-46cb-8d2a-a1517c20d9b8-plugins-config-volume\") pod \"54042379-55b0-46cb-8d2a-a1517c20d9b8\" (UID: \"54042379-55b0-46cb-8d2a-a1517c20d9b8\") "
Jul 27 20:10:42.806664 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806460    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptjlg\" (UniqueName: \"kubernetes.io/projected/54042379-55b0-46cb-8d2a-a1517c20d9b8-kube-api-access-ptjlg\") pod \"54042379-55b0-46cb-8d2a-a1517c20d9b8\" (UID: \"54042379-55b0-46cb-8d2a-a1517c20d9b8\") "
Jul 27 20:10:42.806664 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806490    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmsrn\" (UniqueName: \"kubernetes.io/projected/72af1e15-e5a2-422e-8cfe-8925a59cf533-kube-api-access-lmsrn\") pod \"72af1e15-e5a2-422e-8cfe-8925a59cf533\" (UID: \"72af1e15-e5a2-422e-8cfe-8925a59cf533\") "
Jul 27 20:10:42.806833 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806815    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/113b0dda-34b7-42c3-aeea-af7fe5b984fc-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:42.806896 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806837    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxcch\" (UniqueName: \"kubernetes.io/projected/113b0dda-34b7-42c3-aeea-af7fe5b984fc-kube-api-access-cxcch\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:42.806896 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806847    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/113b0dda-34b7-42c3-aeea-af7fe5b984fc-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:42.806896 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806814    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72af1e15-e5a2-422e-8cfe-8925a59cf533-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72af1e15-e5a2-422e-8cfe-8925a59cf533" (UID: "72af1e15-e5a2-422e-8cfe-8925a59cf533"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:10:42.806896 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.806826    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54042379-55b0-46cb-8d2a-a1517c20d9b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54042379-55b0-46cb-8d2a-a1517c20d9b8" (UID: "54042379-55b0-46cb-8d2a-a1517c20d9b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:10:42.808574 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.808550    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54042379-55b0-46cb-8d2a-a1517c20d9b8-kube-api-access-ptjlg" (OuterVolumeSpecName: "kube-api-access-ptjlg") pod "54042379-55b0-46cb-8d2a-a1517c20d9b8" (UID: "54042379-55b0-46cb-8d2a-a1517c20d9b8"). InnerVolumeSpecName "kube-api-access-ptjlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:10:42.808638 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.808608    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72af1e15-e5a2-422e-8cfe-8925a59cf533-kube-api-access-lmsrn" (OuterVolumeSpecName: "kube-api-access-lmsrn") pod "72af1e15-e5a2-422e-8cfe-8925a59cf533" (UID: "72af1e15-e5a2-422e-8cfe-8925a59cf533"). InnerVolumeSpecName "kube-api-access-lmsrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:10:42.907244 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.907213    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptjlg\" (UniqueName: \"kubernetes.io/projected/54042379-55b0-46cb-8d2a-a1517c20d9b8-kube-api-access-ptjlg\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:42.907244 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.907238    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmsrn\" (UniqueName: \"kubernetes.io/projected/72af1e15-e5a2-422e-8cfe-8925a59cf533-kube-api-access-lmsrn\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:42.907244 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.907248    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72af1e15-e5a2-422e-8cfe-8925a59cf533-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:42.907473 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:42.907256    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54042379-55b0-46cb-8d2a-a1517c20d9b8-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:10:43.008373 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.008345    2558 generic.go:356] "Generic (PLEG): container finished" podID="54042379-55b0-46cb-8d2a-a1517c20d9b8" containerID="79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b" exitCode=0
Jul 27 20:10:43.008553 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.008387    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"
Jul 27 20:10:43.008553 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.008415    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q" event={"ID":"54042379-55b0-46cb-8d2a-a1517c20d9b8","Type":"ContainerDied","Data":"79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b"}
Jul 27 20:10:43.008553 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.008466    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q" event={"ID":"54042379-55b0-46cb-8d2a-a1517c20d9b8","Type":"ContainerDied","Data":"bcbe54f657b17f2c3abe0c6d7616999e0ddd6be27dd4d350f6cabe108d120f9f"}
Jul 27 20:10:43.008553 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.008524    2558 scope.go:117] "RemoveContainer" containerID="79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b"
Jul 27 20:10:43.009684 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.009664    2558 generic.go:356] "Generic (PLEG): container finished" podID="72af1e15-e5a2-422e-8cfe-8925a59cf533" containerID="f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6" exitCode=0
Jul 27 20:10:43.009775 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.009708    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"
Jul 27 20:10:43.009775 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.009747    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n" event={"ID":"72af1e15-e5a2-422e-8cfe-8925a59cf533","Type":"ContainerDied","Data":"f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6"}
Jul 27 20:10:43.009885 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.009805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n" event={"ID":"72af1e15-e5a2-422e-8cfe-8925a59cf533","Type":"ContainerDied","Data":"1d3e2ca41550aab03d0187b5210e5c788b4559dd36364eb2dea6517f3a4051eb"}
Jul 27 20:10:43.011064 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.011045    2558 generic.go:356] "Generic (PLEG): container finished" podID="113b0dda-34b7-42c3-aeea-af7fe5b984fc" containerID="16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0" exitCode=0
Jul 27 20:10:43.011173 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.011077    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg" event={"ID":"113b0dda-34b7-42c3-aeea-af7fe5b984fc","Type":"ContainerDied","Data":"16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0"}
Jul 27 20:10:43.011173 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.011086    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"
Jul 27 20:10:43.011173 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.011107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg" event={"ID":"113b0dda-34b7-42c3-aeea-af7fe5b984fc","Type":"ContainerDied","Data":"a4c7025dbdc39b930280de6afc953218b7d419562781d2102e9e981ff42c1db9"}
Jul 27 20:10:43.018108 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.018073    2558 scope.go:117] "RemoveContainer" containerID="79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b"
Jul 27 20:10:43.018371 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:10:43.018345    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b\": container with ID starting with 79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b not found: ID does not exist" containerID="79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b"
Jul 27 20:10:43.018455 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.018383    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b"} err="failed to get container status \"79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b\": rpc error: code = NotFound desc = could not find container \"79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b\": container with ID starting with 79fa751687c8d84ed7ce5097108b03aef13909cbf1dc9fbf2fab699c44224d3b not found: ID does not exist"
Jul 27 20:10:43.018455 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.018406    2558 scope.go:117] "RemoveContainer" containerID="f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6"
Jul 27 20:10:43.027235 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.027219    2558 scope.go:117] "RemoveContainer" containerID="f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6"
Jul 27 20:10:43.027468 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:10:43.027451    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6\": container with ID starting with f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6 not found: ID does not exist" containerID="f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6"
Jul 27 20:10:43.027541 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.027474    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6"} err="failed to get container status \"f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6\": rpc error: code = NotFound desc = could not find container \"f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6\": container with ID starting with f01da4656f8e618e2fc69efa66faa4fb6b024d63e9ebf25a87f89297ac8838b6 not found: ID does not exist"
Jul 27 20:10:43.027541 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.027491    2558 scope.go:117] "RemoveContainer" containerID="16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0"
Jul 27 20:10:43.034274 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.034260    2558 scope.go:117] "RemoveContainer" containerID="16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0"
Jul 27 20:10:43.034488 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:10:43.034472    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0\": container with ID starting with 16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0 not found: ID does not exist" containerID="16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0"
Jul 27 20:10:43.034557 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.034516    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0"} err="failed to get container status \"16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0\": rpc error: code = NotFound desc = could not find container \"16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0\": container with ID starting with 16817eb6d6fe20f22da0d86624206cdb79a27e267fd316ac09d05f50880b96e0 not found: ID does not exist"
Jul 27 20:10:43.050952 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.050933    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"]
Jul 27 20:10:43.055298 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.055231    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-58c998-9f667bdd7-spxrg"]
Jul 27 20:10:43.071162 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.071102    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"]
Jul 27 20:10:43.080564 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.080543    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q"]
Jul 27 20:10:43.110201 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.110180    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"]
Jul 27 20:10:43.111444 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.111427    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n"]
Jul 27 20:10:43.822628 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.822596    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="113b0dda-34b7-42c3-aeea-af7fe5b984fc" path="/var/lib/kubelet/pods/113b0dda-34b7-42c3-aeea-af7fe5b984fc/volumes"
Jul 27 20:10:43.823001 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.822960    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54042379-55b0-46cb-8d2a-a1517c20d9b8" path="/var/lib/kubelet/pods/54042379-55b0-46cb-8d2a-a1517c20d9b8/volumes"
Jul 27 20:10:43.823271 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:43.823258    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72af1e15-e5a2-422e-8cfe-8925a59cf533" path="/var/lib/kubelet/pods/72af1e15-e5a2-422e-8cfe-8925a59cf533/volumes"
Jul 27 20:10:46.765193 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:46.765161    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:48.209348 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:48.209315    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:52.212474 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:52.212444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:52.898421 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:10:52.898390    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:11:28.692749 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:28.692709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:29.472155 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:29.472120    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:35.213422 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:35.213387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:35.286368 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:35.286329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:35.515365 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:35.515273    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:35.729711 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:35.729678    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:45.101667 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:45.101628    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:45.173956 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:45.173923    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:46.445685 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.445653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:46.480057 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.480025    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"]
Jul 27 20:11:46.480284 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.480256    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck" podUID="1fb7e3a0-15c3-4794-8823-c885533bd8c1" containerName="payload-pre-processing" containerID="cri-o://59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7" gracePeriod=30
Jul 27 20:11:46.577834 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.577787    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:46.676894 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.676854    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:46.733351 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.733328    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:11:46.869237 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.869194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb7e3a0-15c3-4794-8823-c885533bd8c1-plugins-config-volume\") pod \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\" (UID: \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\") "
Jul 27 20:11:46.869431 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.869257    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlfzx\" (UniqueName: \"kubernetes.io/projected/1fb7e3a0-15c3-4794-8823-c885533bd8c1-kube-api-access-qlfzx\") pod \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\" (UID: \"1fb7e3a0-15c3-4794-8823-c885533bd8c1\") "
Jul 27 20:11:46.869617 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.869592    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb7e3a0-15c3-4794-8823-c885533bd8c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fb7e3a0-15c3-4794-8823-c885533bd8c1" (UID: "1fb7e3a0-15c3-4794-8823-c885533bd8c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:11:46.871331 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.871265    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb7e3a0-15c3-4794-8823-c885533bd8c1-kube-api-access-qlfzx" (OuterVolumeSpecName: "kube-api-access-qlfzx") pod "1fb7e3a0-15c3-4794-8823-c885533bd8c1" (UID: "1fb7e3a0-15c3-4794-8823-c885533bd8c1"). InnerVolumeSpecName "kube-api-access-qlfzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:11:46.970259 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.970178    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb7e3a0-15c3-4794-8823-c885533bd8c1-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:11:46.970259 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:46.970204    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlfzx\" (UniqueName: \"kubernetes.io/projected/1fb7e3a0-15c3-4794-8823-c885533bd8c1-kube-api-access-qlfzx\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:11:47.292184 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.292104    2558 generic.go:356] "Generic (PLEG): container finished" podID="1fb7e3a0-15c3-4794-8823-c885533bd8c1" containerID="59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7" exitCode=0
Jul 27 20:11:47.292184 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.292154    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"
Jul 27 20:11:47.292381 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.292193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck" event={"ID":"1fb7e3a0-15c3-4794-8823-c885533bd8c1","Type":"ContainerDied","Data":"59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7"}
Jul 27 20:11:47.292381 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.292250    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck" event={"ID":"1fb7e3a0-15c3-4794-8823-c885533bd8c1","Type":"ContainerDied","Data":"45504a34766371e5ea61f66a234961f2cdd060007a5f3d76db78dd3042884aca"}
Jul 27 20:11:47.292381 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.292277    2558 scope.go:117] "RemoveContainer" containerID="59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7"
Jul 27 20:11:47.301198 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.301180    2558 scope.go:117] "RemoveContainer" containerID="59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7"
Jul 27 20:11:47.301440 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:11:47.301422    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7\": container with ID starting with 59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7 not found: ID does not exist" containerID="59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7"
Jul 27 20:11:47.301525 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.301451    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7"} err="failed to get container status \"59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7\": rpc error: code = NotFound desc = could not find container \"59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7\": container with ID starting with 59f5265bb0ffddd9022687a65dc0e33655ac772a6318457867609b1563b747e7 not found: ID does not exist"
Jul 27 20:11:47.318861 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.318835    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"]
Jul 27 20:11:47.321768 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.321750    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck"]
Jul 27 20:11:47.822658 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:47.822628    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb7e3a0-15c3-4794-8823-c885533bd8c1" path="/var/lib/kubelet/pods/1fb7e3a0-15c3-4794-8823-c885533bd8c1/volumes"
Jul 27 20:11:49.982822 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:49.982781    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:11:50.948185 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:50.948149    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:51.356582 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:51.356451    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:57.643583 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:57.643538    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:57.780470 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:57.780408    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:57.896183 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:57.896081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:58.153278 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:11:58.153168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:08.769819 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.769780    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"]
Jul 27 20:12:08.770348 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.770085    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb" podUID="a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" containerName="maas-api" containerID="cri-o://c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872" gracePeriod=30
Jul 27 20:12:08.805687 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.805654    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:08.835382 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.835350    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"]
Jul 27 20:12:08.835610 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.835584    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h" podUID="3bdfe799-1b90-45c1-b2a9-0a0663c758f2" containerName="payload-processing" containerID="cri-o://4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8" gracePeriod=30
Jul 27 20:12:08.843595 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.843304    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"]
Jul 27 20:12:08.843595 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.843526    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg" podUID="7215290e-8749-44c3-b1f6-893ad774f9c6" containerName="payload-pre-processing" containerID="cri-o://418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9" gracePeriod=30
Jul 27 20:12:08.894552 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.894463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:08.984724 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:08.984687    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:09.090480 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.090455    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 20:12:09.132232 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.132203    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 20:12:09.135478 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.135453    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 20:12:09.167407 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.167370    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-openshift-service-ca\") pod \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") "
Jul 27 20:12:09.167634 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.167415    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf8nl\" (UniqueName: \"kubernetes.io/projected/7215290e-8749-44c3-b1f6-893ad774f9c6-kube-api-access-gf8nl\") pod \"7215290e-8749-44c3-b1f6-893ad774f9c6\" (UID: \"7215290e-8749-44c3-b1f6-893ad774f9c6\") "
Jul 27 20:12:09.168274 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.167799    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" (UID: "a8c2c184-18c4-4bc9-8c88-68af8c8c96fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:12:09.168274 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.167837    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-plugins-config-volume\") pod \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\" (UID: \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\") "
Jul 27 20:12:09.168761 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.168721    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3bdfe799-1b90-45c1-b2a9-0a0663c758f2" (UID: "3bdfe799-1b90-45c1-b2a9-0a0663c758f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:12:09.169124 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.168903    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7215290e-8749-44c3-b1f6-893ad774f9c6-plugins-config-volume\") pod \"7215290e-8749-44c3-b1f6-893ad774f9c6\" (UID: \"7215290e-8749-44c3-b1f6-893ad774f9c6\") "
Jul 27 20:12:09.169124 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.168986    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls\") pod \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") "
Jul 27 20:12:09.169262 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.169201    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdf4g\" (UniqueName: \"kubernetes.io/projected/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-kube-api-access-qdf4g\") pod \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\" (UID: \"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe\") "
Jul 27 20:12:09.169262 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.169235    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv9jv\" (UniqueName: \"kubernetes.io/projected/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-kube-api-access-bv9jv\") pod \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\" (UID: \"3bdfe799-1b90-45c1-b2a9-0a0663c758f2\") "
Jul 27 20:12:09.169734 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.169571    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:09.169734 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.169594    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:09.169893 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.169750    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7215290e-8749-44c3-b1f6-893ad774f9c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7215290e-8749-44c3-b1f6-893ad774f9c6" (UID: "7215290e-8749-44c3-b1f6-893ad774f9c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:12:09.171771 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.171743    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7215290e-8749-44c3-b1f6-893ad774f9c6-kube-api-access-gf8nl" (OuterVolumeSpecName: "kube-api-access-gf8nl") pod "7215290e-8749-44c3-b1f6-893ad774f9c6" (UID: "7215290e-8749-44c3-b1f6-893ad774f9c6"). InnerVolumeSpecName "kube-api-access-gf8nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:12:09.171922 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.171902    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" (UID: "a8c2c184-18c4-4bc9-8c88-68af8c8c96fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:12:09.172121 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.172098    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-kube-api-access-qdf4g" (OuterVolumeSpecName: "kube-api-access-qdf4g") pod "a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" (UID: "a8c2c184-18c4-4bc9-8c88-68af8c8c96fe"). InnerVolumeSpecName "kube-api-access-qdf4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:12:09.172326 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.172298    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-kube-api-access-bv9jv" (OuterVolumeSpecName: "kube-api-access-bv9jv") pod "3bdfe799-1b90-45c1-b2a9-0a0663c758f2" (UID: "3bdfe799-1b90-45c1-b2a9-0a0663c758f2"). InnerVolumeSpecName "kube-api-access-bv9jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:12:09.270794 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.270760    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7215290e-8749-44c3-b1f6-893ad774f9c6-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:09.270794 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.270789    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:09.270794 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.270801    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdf4g\" (UniqueName: \"kubernetes.io/projected/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe-kube-api-access-qdf4g\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:09.271028 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.270811    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv9jv\" (UniqueName: \"kubernetes.io/projected/3bdfe799-1b90-45c1-b2a9-0a0663c758f2-kube-api-access-bv9jv\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:09.271028 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.270819    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf8nl\" (UniqueName: \"kubernetes.io/projected/7215290e-8749-44c3-b1f6-893ad774f9c6-kube-api-access-gf8nl\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:09.389098 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.389013    2558 generic.go:356] "Generic (PLEG): container finished" podID="3bdfe799-1b90-45c1-b2a9-0a0663c758f2" containerID="4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8" exitCode=0
Jul 27 20:12:09.389098 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.389051    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"
Jul 27 20:12:09.389293 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.389100    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h" event={"ID":"3bdfe799-1b90-45c1-b2a9-0a0663c758f2","Type":"ContainerDied","Data":"4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8"}
Jul 27 20:12:09.389293 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.389156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h" event={"ID":"3bdfe799-1b90-45c1-b2a9-0a0663c758f2","Type":"ContainerDied","Data":"e01fdf15b2a5220eac17ffe03de60b86c00233dcc50b021262a68c503b4756b5"}
Jul 27 20:12:09.389293 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.389189    2558 scope.go:117] "RemoveContainer" containerID="4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8"
Jul 27 20:12:09.390371 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.390351    2558 generic.go:356] "Generic (PLEG): container finished" podID="7215290e-8749-44c3-b1f6-893ad774f9c6" containerID="418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9" exitCode=0
Jul 27 20:12:09.390491 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.390410    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"
Jul 27 20:12:09.390491 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.390412    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg" event={"ID":"7215290e-8749-44c3-b1f6-893ad774f9c6","Type":"ContainerDied","Data":"418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9"}
Jul 27 20:12:09.390644 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.390545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg" event={"ID":"7215290e-8749-44c3-b1f6-893ad774f9c6","Type":"ContainerDied","Data":"d07bfeb4ea61a52f0e457cbfd32ec2a5ded68c5b1220a6ddd5f39f72e306b774"}
Jul 27 20:12:09.391768 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.391732    2558 generic.go:356] "Generic (PLEG): container finished" podID="a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" containerID="c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872" exitCode=0
Jul 27 20:12:09.391889 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.391791    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"
Jul 27 20:12:09.391889 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.391803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb" event={"ID":"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe","Type":"ContainerDied","Data":"c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872"}
Jul 27 20:12:09.391889 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.391835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb" event={"ID":"a8c2c184-18c4-4bc9-8c88-68af8c8c96fe","Type":"ContainerDied","Data":"70cf023b25c82315c7d79bebc766daa82d2acb72ea2e899b7302ec82c11b5fb6"}
Jul 27 20:12:09.398604 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.398583    2558 scope.go:117] "RemoveContainer" containerID="4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8"
Jul 27 20:12:09.398937 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:12:09.398913    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8\": container with ID starting with 4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8 not found: ID does not exist" containerID="4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8"
Jul 27 20:12:09.399033 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.398948    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8"} err="failed to get container status \"4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8\": rpc error: code = NotFound desc = could not find container \"4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8\": container with ID starting with 4bd1e0fd1f11b4f6831bbe22f066dc62a2543b9af4ab25dd1e0fda51863202e8 not found: ID does not exist"
Jul 27 20:12:09.399033 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.398972    2558 scope.go:117] "RemoveContainer" containerID="418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9"
Jul 27 20:12:09.409492 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.409476    2558 scope.go:117] "RemoveContainer" containerID="418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9"
Jul 27 20:12:09.409752 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:12:09.409726    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9\": container with ID starting with 418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9 not found: ID does not exist" containerID="418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9"
Jul 27 20:12:09.409838 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.409758    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9"} err="failed to get container status \"418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9\": rpc error: code = NotFound desc = could not find container \"418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9\": container with ID starting with 418c865e3d1d260304fd1e9bda97f16890aa8941b7caefc7d6138e38d03e17f9 not found: ID does not exist"
Jul 27 20:12:09.409838 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.409780    2558 scope.go:117] "RemoveContainer" containerID="c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872"
Jul 27 20:12:09.417603 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.417571    2558 scope.go:117] "RemoveContainer" containerID="c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872"
Jul 27 20:12:09.417871 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:12:09.417853    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872\": container with ID starting with c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872 not found: ID does not exist" containerID="c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872"
Jul 27 20:12:09.417965 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.417876    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872"} err="failed to get container status \"c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872\": rpc error: code = NotFound desc = could not find container \"c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872\": container with ID starting with c32b346ee77b73c5e30464aac4955ff1d3bb08821b11d88619973cdbef9ea872 not found: ID does not exist"
Jul 27 20:12:09.418934 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.418914    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"]
Jul 27 20:12:09.422867 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.422846    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg"]
Jul 27 20:12:09.436436 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.436416    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"]
Jul 27 20:12:09.441945 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.441924    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h"]
Jul 27 20:12:09.452225 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.452205    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"]
Jul 27 20:12:09.456254 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.456237    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4289a9-5dbfd44fc6-qbhdb"]
Jul 27 20:12:09.822393 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.822365    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bdfe799-1b90-45c1-b2a9-0a0663c758f2" path="/var/lib/kubelet/pods/3bdfe799-1b90-45c1-b2a9-0a0663c758f2/volumes"
Jul 27 20:12:09.822752 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.822738    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7215290e-8749-44c3-b1f6-893ad774f9c6" path="/var/lib/kubelet/pods/7215290e-8749-44c3-b1f6-893ad774f9c6/volumes"
Jul 27 20:12:09.823094 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:09.823082    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" path="/var/lib/kubelet/pods/a8c2c184-18c4-4bc9-8c88-68af8c8c96fe/volumes"
Jul 27 20:12:11.977562 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:11.973716    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:12:13.367080 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:13.367051    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:13.700911 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:13.700875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:20.150216 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:20.150176    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:20.253213 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:20.253174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:20.425122 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:20.425047    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:20.672354 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:20.672323    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:26.301679 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:26.301620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:31.346984 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.346951    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"]
Jul 27 20:12:31.347437 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.347135    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h" podUID="28646956-e5b3-482b-a3ce-f88b28e194dc" containerName="maas-api" containerID="cri-o://b5c1e65a4379094d3da6448eb55746a2e250031cd9df8b5b54651ec336111acc" gracePeriod=30
Jul 27 20:12:31.417951 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.417914    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"]
Jul 27 20:12:31.418222 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.418197    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4" podUID="ed12b8ef-6f85-48d0-87ad-0614a464c077" containerName="payload-pre-processing" containerID="cri-o://52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f" gracePeriod=30
Jul 27 20:12:31.488032 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.488000    2558 generic.go:356] "Generic (PLEG): container finished" podID="28646956-e5b3-482b-a3ce-f88b28e194dc" containerID="b5c1e65a4379094d3da6448eb55746a2e250031cd9df8b5b54651ec336111acc" exitCode=0
Jul 27 20:12:31.488184 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.488070    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h" event={"ID":"28646956-e5b3-482b-a3ce-f88b28e194dc","Type":"ContainerDied","Data":"b5c1e65a4379094d3da6448eb55746a2e250031cd9df8b5b54651ec336111acc"}
Jul 27 20:12:31.658542 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.658518    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 20:12:31.695228 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.695206    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 20:12:31.761065 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.761036    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28646956-e5b3-482b-a3ce-f88b28e194dc-openshift-service-ca\") pod \"28646956-e5b3-482b-a3ce-f88b28e194dc\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") "
Jul 27 20:12:31.761240 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.761083    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28646956-e5b3-482b-a3ce-f88b28e194dc-maas-api-tls\") pod \"28646956-e5b3-482b-a3ce-f88b28e194dc\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") "
Jul 27 20:12:31.761240 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.761142    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmwkx\" (UniqueName: \"kubernetes.io/projected/28646956-e5b3-482b-a3ce-f88b28e194dc-kube-api-access-bmwkx\") pod \"28646956-e5b3-482b-a3ce-f88b28e194dc\" (UID: \"28646956-e5b3-482b-a3ce-f88b28e194dc\") "
Jul 27 20:12:31.761425 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.761403    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28646956-e5b3-482b-a3ce-f88b28e194dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28646956-e5b3-482b-a3ce-f88b28e194dc" (UID: "28646956-e5b3-482b-a3ce-f88b28e194dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:12:31.763212 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.763191    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28646956-e5b3-482b-a3ce-f88b28e194dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28646956-e5b3-482b-a3ce-f88b28e194dc" (UID: "28646956-e5b3-482b-a3ce-f88b28e194dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:12:31.763309 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.763269    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28646956-e5b3-482b-a3ce-f88b28e194dc-kube-api-access-bmwkx" (OuterVolumeSpecName: "kube-api-access-bmwkx") pod "28646956-e5b3-482b-a3ce-f88b28e194dc" (UID: "28646956-e5b3-482b-a3ce-f88b28e194dc"). InnerVolumeSpecName "kube-api-access-bmwkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:12:31.861872 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.861837    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx7g8\" (UniqueName: \"kubernetes.io/projected/ed12b8ef-6f85-48d0-87ad-0614a464c077-kube-api-access-zx7g8\") pod \"ed12b8ef-6f85-48d0-87ad-0614a464c077\" (UID: \"ed12b8ef-6f85-48d0-87ad-0614a464c077\") "
Jul 27 20:12:31.862016 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.861886    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed12b8ef-6f85-48d0-87ad-0614a464c077-plugins-config-volume\") pod \"ed12b8ef-6f85-48d0-87ad-0614a464c077\" (UID: \"ed12b8ef-6f85-48d0-87ad-0614a464c077\") "
Jul 27 20:12:31.862064 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.862041    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28646956-e5b3-482b-a3ce-f88b28e194dc-openshift-service-ca\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:31.862064 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.862054    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28646956-e5b3-482b-a3ce-f88b28e194dc-maas-api-tls\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:31.862130 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.862063    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmwkx\" (UniqueName: \"kubernetes.io/projected/28646956-e5b3-482b-a3ce-f88b28e194dc-kube-api-access-bmwkx\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:31.862259 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.862235    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed12b8ef-6f85-48d0-87ad-0614a464c077-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed12b8ef-6f85-48d0-87ad-0614a464c077" (UID: "ed12b8ef-6f85-48d0-87ad-0614a464c077"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:12:31.863948 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.863912    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed12b8ef-6f85-48d0-87ad-0614a464c077-kube-api-access-zx7g8" (OuterVolumeSpecName: "kube-api-access-zx7g8") pod "ed12b8ef-6f85-48d0-87ad-0614a464c077" (UID: "ed12b8ef-6f85-48d0-87ad-0614a464c077"). InnerVolumeSpecName "kube-api-access-zx7g8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:12:31.962869 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.962832    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx7g8\" (UniqueName: \"kubernetes.io/projected/ed12b8ef-6f85-48d0-87ad-0614a464c077-kube-api-access-zx7g8\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:31.962869 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:31.962866    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed12b8ef-6f85-48d0-87ad-0614a464c077-plugins-config-volume\") on node \"ip-10-0-141-32.ec2.internal\" DevicePath \"\""
Jul 27 20:12:32.074523 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.074469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:32.174399 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.174368    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:32.493287 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.493256    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"
Jul 27 20:12:32.493794 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.493253    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h" event={"ID":"28646956-e5b3-482b-a3ce-f88b28e194dc","Type":"ContainerDied","Data":"743b11a7c53e1207e88aa5eded0d87231138e53012643b48a0f7c90b3d63a6a3"}
Jul 27 20:12:32.493794 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.493402    2558 scope.go:117] "RemoveContainer" containerID="b5c1e65a4379094d3da6448eb55746a2e250031cd9df8b5b54651ec336111acc"
Jul 27 20:12:32.494809 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.494541    2558 generic.go:356] "Generic (PLEG): container finished" podID="ed12b8ef-6f85-48d0-87ad-0614a464c077" containerID="52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f" exitCode=0
Jul 27 20:12:32.494809 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.494577    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"
Jul 27 20:12:32.494809 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.494586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4" event={"ID":"ed12b8ef-6f85-48d0-87ad-0614a464c077","Type":"ContainerDied","Data":"52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f"}
Jul 27 20:12:32.494809 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.494640    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4" event={"ID":"ed12b8ef-6f85-48d0-87ad-0614a464c077","Type":"ContainerDied","Data":"93e7ed2a1fb0604a7ded042a05dd74e8be3367204ddb9084553697818156f3fc"}
Jul 27 20:12:32.501946 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.501909    2558 scope.go:117] "RemoveContainer" containerID="52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f"
Jul 27 20:12:32.509449 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.509432    2558 scope.go:117] "RemoveContainer" containerID="52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f"
Jul 27 20:12:32.509710 ip-10-0-141-32 kubenswrapper[2558]: E0727 20:12:32.509691    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f\": container with ID starting with 52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f not found: ID does not exist" containerID="52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f"
Jul 27 20:12:32.509765 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.509719    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f"} err="failed to get container status \"52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f\": rpc error: code = NotFound desc = could not find container \"52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f\": container with ID starting with 52bde2bb4a22bcec9004bc7c4ec4b6f71ca3d3c2d3beb0e47fe743599c189c4f not found: ID does not exist"
Jul 27 20:12:32.517274 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.512441    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"]
Jul 27 20:12:32.519916 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.519896    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f99bfd-6d77976856-dzn6h"]
Jul 27 20:12:32.529480 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.529452    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"]
Jul 27 20:12:32.535056 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:32.535037    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4"]
Jul 27 20:12:33.822663 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:33.822633    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28646956-e5b3-482b-a3ce-f88b28e194dc" path="/var/lib/kubelet/pods/28646956-e5b3-482b-a3ce-f88b28e194dc/volumes"
Jul 27 20:12:33.823033 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:33.822985    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed12b8ef-6f85-48d0-87ad-0614a464c077" path="/var/lib/kubelet/pods/ed12b8ef-6f85-48d0-87ad-0614a464c077/volumes"
Jul 27 20:12:34.066114 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:34.066080    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwvvr"]
Jul 27 20:12:35.848242 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:35.848209    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:36.201617 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:36.201589    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:42.884549 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:42.884493    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:42.985030 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:42.984984    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:43.178076 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:43.178040    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:43.385564 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:43.385529    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:49.984265 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:49.984236    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d79566f86-rjfb4_e9ad3a91-994d-4492-8f12-4b976667afe2/copy-manifests/0.log"
Jul 27 20:12:49.997399 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:49.997378    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d79566f86-rjfb4_e9ad3a91-994d-4492-8f12-4b976667afe2/manager/0.log"
Jul 27 20:12:52.778285 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:52.778256    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bwvvr_082a93f9-8f11-4ba4-928c-1f5450d814d9/limitador/0.log"
Jul 27 20:12:53.352778 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:53.352749    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pscbn_f99bcf23-8ab0-4b80-a7bb-49f2fb57b976/discovery/0.log"
Jul 27 20:12:54.465776 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:54.465750    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-r8rcg_3b63fec5-3537-4b78-a22e-1d93ec43f4b5/main/0.log"
Jul 27 20:12:54.791321 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:12:54.791239    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-md2rs_f8e28eb5-650e-476e-b6ab-0630547ffe19/main/0.log"
Jul 27 20:13:00.028703 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:00.028668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:00.125571 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:00.125533    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:03.213546 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:03.213516    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q6sw4_e9cd1241-c1ee-471f-b5f1-f737d365e640/global-pull-secret-syncer/0.log"
Jul 27 20:13:03.312969 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:03.312940    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6bcsv_80f9dec5-d65e-42ae-8641-11fe87aec515/konnectivity-agent/0.log"
Jul 27 20:13:03.490068 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:03.489993    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-32.ec2.internal_1c3dd1efb0481aca95d717590d57dbb6/haproxy/0.log"
Jul 27 20:13:09.610101 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:09.610076    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bwvvr_082a93f9-8f11-4ba4-928c-1f5450d814d9/limitador/0.log"
Jul 27 20:13:11.872638 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:11.872611    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mx4hp_bc5f7688-c028-4cc3-b66f-743712fd9993/node-exporter/0.log"
Jul 27 20:13:11.895247 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:11.895226    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mx4hp_bc5f7688-c028-4cc3-b66f-743712fd9993/kube-rbac-proxy/0.log"
Jul 27 20:13:11.915929 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:11.915905    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mx4hp_bc5f7688-c028-4cc3-b66f-743712fd9993/init-textfile/0.log"
Jul 27 20:13:12.104833 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.104803    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d3c1b0f-3703-4745-96ed-771ea2d623f7/prometheus/0.log"
Jul 27 20:13:12.126999 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.126932    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d3c1b0f-3703-4745-96ed-771ea2d623f7/config-reloader/0.log"
Jul 27 20:13:12.148613 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.148596    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d3c1b0f-3703-4745-96ed-771ea2d623f7/thanos-sidecar/0.log"
Jul 27 20:13:12.172641 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.172622    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d3c1b0f-3703-4745-96ed-771ea2d623f7/kube-rbac-proxy-web/0.log"
Jul 27 20:13:12.194445 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.194422    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d3c1b0f-3703-4745-96ed-771ea2d623f7/kube-rbac-proxy/0.log"
Jul 27 20:13:12.215892 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.215875    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d3c1b0f-3703-4745-96ed-771ea2d623f7/kube-rbac-proxy-thanos/0.log"
Jul 27 20:13:12.238107 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.238092    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d3c1b0f-3703-4745-96ed-771ea2d623f7/init-config-reloader/0.log"
Jul 27 20:13:12.423215 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.423145    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4d9d6-qvdk7_d529e5c3-9dea-48ce-8894-237579b0dc1c/thanos-query/0.log"
Jul 27 20:13:12.445792 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.445770    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4d9d6-qvdk7_d529e5c3-9dea-48ce-8894-237579b0dc1c/kube-rbac-proxy-web/0.log"
Jul 27 20:13:12.467994 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.467970    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4d9d6-qvdk7_d529e5c3-9dea-48ce-8894-237579b0dc1c/kube-rbac-proxy/0.log"
Jul 27 20:13:12.509701 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.509680    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4d9d6-qvdk7_d529e5c3-9dea-48ce-8894-237579b0dc1c/prom-label-proxy/0.log"
Jul 27 20:13:12.535943 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.535926    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4d9d6-qvdk7_d529e5c3-9dea-48ce-8894-237579b0dc1c/kube-rbac-proxy-rules/0.log"
Jul 27 20:13:12.559333 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:12.559315    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4d9d6-qvdk7_d529e5c3-9dea-48ce-8894-237579b0dc1c/kube-rbac-proxy-metrics/0.log"
Jul 27 20:13:13.208643 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.208606    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"]
Jul 27 20:13:13.209128 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209081    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" containerName="maas-api"
Jul 27 20:13:13.209128 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209100    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" containerName="maas-api"
Jul 27 20:13:13.209128 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209115    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb7e3a0-15c3-4794-8823-c885533bd8c1" containerName="payload-pre-processing"
Jul 27 20:13:13.209128 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209123    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb7e3a0-15c3-4794-8823-c885533bd8c1" containerName="payload-pre-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209135    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e243c4a5-e917-47a8-936c-40b9d84541c3" containerName="maas-api"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209144    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e243c4a5-e917-47a8-936c-40b9d84541c3" containerName="maas-api"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209165    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72af1e15-e5a2-422e-8cfe-8925a59cf533" containerName="payload-pre-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209174    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="72af1e15-e5a2-422e-8cfe-8925a59cf533" containerName="payload-pre-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209190    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed12b8ef-6f85-48d0-87ad-0614a464c077" containerName="payload-pre-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209198    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed12b8ef-6f85-48d0-87ad-0614a464c077" containerName="payload-pre-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209213    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7215290e-8749-44c3-b1f6-893ad774f9c6" containerName="payload-pre-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209221    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7215290e-8749-44c3-b1f6-893ad774f9c6" containerName="payload-pre-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209231    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28646956-e5b3-482b-a3ce-f88b28e194dc" containerName="maas-api"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209238    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="28646956-e5b3-482b-a3ce-f88b28e194dc" containerName="maas-api"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209250    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54042379-55b0-46cb-8d2a-a1517c20d9b8" containerName="payload-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209258    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="54042379-55b0-46cb-8d2a-a1517c20d9b8" containerName="payload-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209277    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bdfe799-1b90-45c1-b2a9-0a0663c758f2" containerName="payload-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209285    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bdfe799-1b90-45c1-b2a9-0a0663c758f2" containerName="payload-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209297    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113b0dda-34b7-42c3-aeea-af7fe5b984fc" containerName="maas-api"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209307    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="113b0dda-34b7-42c3-aeea-af7fe5b984fc" containerName="maas-api"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209315    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9545d6-991b-4bfa-a624-4d27842fc653" containerName="payload-processing"
Jul 27 20:13:13.209349 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209324    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9545d6-991b-4bfa-a624-4d27842fc653" containerName="payload-processing"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209399    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="28646956-e5b3-482b-a3ce-f88b28e194dc" containerName="maas-api"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209411    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7215290e-8749-44c3-b1f6-893ad774f9c6" containerName="payload-pre-processing"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209421    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb7e3a0-15c3-4794-8823-c885533bd8c1" containerName="payload-pre-processing"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209430    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed12b8ef-6f85-48d0-87ad-0614a464c077" containerName="payload-pre-processing"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209440    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="54042379-55b0-46cb-8d2a-a1517c20d9b8" containerName="payload-processing"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209449    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bdfe799-1b90-45c1-b2a9-0a0663c758f2" containerName="payload-processing"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209459    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="113b0dda-34b7-42c3-aeea-af7fe5b984fc" containerName="maas-api"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209468    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e9545d6-991b-4bfa-a624-4d27842fc653" containerName="payload-processing"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209478    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8c2c184-18c4-4bc9-8c88-68af8c8c96fe" containerName="maas-api"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209487    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="72af1e15-e5a2-422e-8cfe-8925a59cf533" containerName="payload-pre-processing"
Jul 27 20:13:13.210336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.209514    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e243c4a5-e917-47a8-936c-40b9d84541c3" containerName="maas-api"
Jul 27 20:13:13.212827 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.212809    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.215202 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.215178    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5b4zt\"/\"default-dockercfg-m29w6\""
Jul 27 20:13:13.215336 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.215178    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5b4zt\"/\"openshift-service-ca.crt\""
Jul 27 20:13:13.215964 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.215944    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5b4zt\"/\"kube-root-ca.crt\""
Jul 27 20:13:13.222997 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.222976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"]
Jul 27 20:13:13.307361 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.307331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-proc\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.307547 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.307401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrnjx\" (UniqueName: \"kubernetes.io/projected/848aab70-70d6-4885-8f30-946a0cd8ac4e-kube-api-access-jrnjx\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.307547 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.307451    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-lib-modules\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.307547 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.307484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-sys\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.307700 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.307569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-podres\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.407928 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.407900    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-podres\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.408083 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.407940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-proc\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.408083 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.407966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrnjx\" (UniqueName: \"kubernetes.io/projected/848aab70-70d6-4885-8f30-946a0cd8ac4e-kube-api-access-jrnjx\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.408083 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.407994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-lib-modules\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.408083 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.408016    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-sys\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.408083 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.408040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-proc\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.408083 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.408061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-podres\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.408341 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.408096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-sys\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.408341 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.408190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/848aab70-70d6-4885-8f30-946a0cd8ac4e-lib-modules\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.416720 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.416699    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrnjx\" (UniqueName: \"kubernetes.io/projected/848aab70-70d6-4885-8f30-946a0cd8ac4e-kube-api-access-jrnjx\") pod \"perf-node-gather-daemonset-ftmlw\" (UID: \"848aab70-70d6-4885-8f30-946a0cd8ac4e\") " pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.522364 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.522293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:13.656084 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.656062    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"]
Jul 27 20:13:13.658060 ip-10-0-141-32 kubenswrapper[2558]: W0727 20:13:13.658032    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod848aab70_70d6_4885_8f30_946a0cd8ac4e.slice/crio-619aee33027586d119a6d5a76712fd9b5e4ca6caff4eba8ba52ecf29c38b5d19 WatchSource:0}: Error finding container 619aee33027586d119a6d5a76712fd9b5e4ca6caff4eba8ba52ecf29c38b5d19: Status 404 returned error can't find the container with id 619aee33027586d119a6d5a76712fd9b5e4ca6caff4eba8ba52ecf29c38b5d19
Jul 27 20:13:13.665102 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:13.665063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw" event={"ID":"848aab70-70d6-4885-8f30-946a0cd8ac4e","Type":"ContainerStarted","Data":"619aee33027586d119a6d5a76712fd9b5e4ca6caff4eba8ba52ecf29c38b5d19"}
Jul 27 20:13:14.670393 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:14.670357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw" event={"ID":"848aab70-70d6-4885-8f30-946a0cd8ac4e","Type":"ContainerStarted","Data":"0fe19cbd18cd7e5d30b54fd46893e6522dd26fec08c6fb00dcab04699a5abd37"}
Jul 27 20:13:14.670805 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:14.670445    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:14.698794 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:14.698733    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw" podStartSLOduration=1.698714441 podStartE2EDuration="1.698714441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:13:14.696624909 +0000 UTC m=+3329.436180577" watchObservedRunningTime="2026-07-27 20:13:14.698714441 +0000 UTC m=+3329.438270026"
Jul 27 20:13:16.923732 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:16.923703    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6dq5c_909f8498-ca5a-4004-b5a3-c778d6d58202/dns/0.log"
Jul 27 20:13:16.946020 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:16.945993    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6dq5c_909f8498-ca5a-4004-b5a3-c778d6d58202/kube-rbac-proxy/0.log"
Jul 27 20:13:17.124792 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:17.124763    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mx22j_56cd5b92-5cfe-4fcd-a1d1-2841432248ee/dns-node-resolver/0.log"
Jul 27 20:13:17.900169 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:17.900139    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-strqs_25ab1d80-25fc-4b64-a542-7c2984a3c464/node-ca/0.log"
Jul 27 20:13:19.102787 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:19.102756    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pscbn_f99bcf23-8ab0-4b80-a7bb-49f2fb57b976/discovery/0.log"
Jul 27 20:13:20.169989 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:20.169958    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4m4sx_2bbb57cd-e50f-469b-a6fa-7f5454c57c3c/serve-healthcheck-canary/0.log"
Jul 27 20:13:20.683226 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:20.683198    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5b4zt/perf-node-gather-daemonset-ftmlw"
Jul 27 20:13:20.731042 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:20.731017    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44crp_45f282d3-e012-4a00-9554-63cead3527ba/kube-rbac-proxy/0.log"
Jul 27 20:13:20.755143 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:20.755119    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44crp_45f282d3-e012-4a00-9554-63cead3527ba/exporter/0.log"
Jul 27 20:13:20.779447 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:20.779408    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44crp_45f282d3-e012-4a00-9554-63cead3527ba/extractor/0.log"
Jul 27 20:13:23.993132 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:23.993053    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d79566f86-rjfb4_e9ad3a91-994d-4492-8f12-4b976667afe2/manager/0.log"
Jul 27 20:13:24.010468 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:24.010446    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d79566f86-rjfb4_e9ad3a91-994d-4492-8f12-4b976667afe2/copy-manifests/0.log"
Jul 27 20:13:24.781864 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:24.781830    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pscbn_f99bcf23-8ab0-4b80-a7bb-49f2fb57b976/discovery/0.log"
Jul 27 20:13:25.442958 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:25.442932    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6fd758c6bf-fqn4n_c1190ac2-5b9b-4d42-9c0c-b7f063b97d8f/manager/0.log"
Jul 27 20:13:26.576820 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:26.576786    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pscbn_f99bcf23-8ab0-4b80-a7bb-49f2fb57b976/discovery/0.log"
Jul 27 20:13:30.741471 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:30.741446    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-72s5t_1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a/migrator/0.log"
Jul 27 20:13:30.763046 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:30.763017    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-72s5t_1d5f2db3-bfc4-49ae-96d9-0da40e8ea03a/graceful-termination/0.log"
Jul 27 20:13:32.295366 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:32.295338    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-65888_0a890072-cc0b-45b4-b793-c2ed001ce0d7/kube-multus-additional-cni-plugins/0.log"
Jul 27 20:13:32.318054 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:32.318026    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-65888_0a890072-cc0b-45b4-b793-c2ed001ce0d7/egress-router-binary-copy/0.log"
Jul 27 20:13:32.341835 ip-10-0-141-32 kubenswrapper[2558]: I0727 20:13:32.341796    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-65888_0a890072-cc0b-45b4-b793-c2ed001ce0d7/cni-plugins/0.log"