Jul 28 13:57:43.848440 ip-10-0-137-91 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 13:57:43.848449 ip-10-0-137-91 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 13:57:43.848456 ip-10-0-137-91 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 13:57:43.848711 ip-10-0-137-91 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 13:57:53.960866 ip-10-0-137-91 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 13:57:53.960883 ip-10-0-137-91 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 362ebfc61c804c7292b0a9a262e8322e --
Jul 28 13:59:49.482620 ip-10-0-137-91 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 13:59:51.062828 ip-10-0-137-91 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 13:59:51.062828 ip-10-0-137-91 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 13:59:51.062828 ip-10-0-137-91 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 13:59:51.062828 ip-10-0-137-91 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 13:59:51.062828 ip-10-0-137-91 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 13:59:51.065156 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.065063    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 13:59:51.068646 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068629    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:51.068646 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068645    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068649    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068652    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068656    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068658    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068661    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068663    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068666    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068670    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068672    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068675    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068678    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068685    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068688    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068690    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068693    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068696    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068698    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068701    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068704    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:51.068710 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068706    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068709    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068711    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068714    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068717    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068720    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068723    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068726    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068728    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068731    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068734    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068737    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068739    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068742    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068745    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068747    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068750    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068752    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068755    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068757    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:51.069200 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068760    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068763    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068765    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068768    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068770    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068773    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068775    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068778    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068794    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068798    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068801    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068804    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068807    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068809    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068812    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068815    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068819    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068823    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068826    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:51.069718 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068829    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068832    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068835    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068838    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068840    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068843    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068845    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068848    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068850    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068853    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068856    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068858    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068861    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068864    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068866    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068869    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068872    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068874    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068877    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068879    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:51.070191 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068882    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068886    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068888    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068891    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068895    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068898    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068901    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068905    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068909    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068911    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068915    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068917    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068920    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068923    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068925    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068928    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068931    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068933    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.068935    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069635    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:51.070670 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069641    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069644    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069647    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069650    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069653    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069656    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069659    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069661    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069664    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069667    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069669    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069672    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069674    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069677    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069680    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069682    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069685    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069688    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069691    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069695    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069698    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:51.071167 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069701    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069703    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069706    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069709    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069712    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069715    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069718    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069721    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069724    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069727    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069729    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069733    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069736    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069739    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069742    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069745    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069747    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069750    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069753    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069755    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:51.071684 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069758    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069760    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069762    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069765    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069768    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069770    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069773    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069775    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069777    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069796    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069800    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069803    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069805    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069808    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069811    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069814    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069817    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069819    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069822    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:51.072215 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069824    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069827    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069830    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069832    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069835    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069837    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069840    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069843    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069845    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069849    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069851    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069854    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069857    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069862    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069865    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069868    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069871    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069874    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069877    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:51.072680 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069880    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069882    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069885    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069887    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069891    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069894    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069896    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069899    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069903    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069906    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069909    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069912    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069915    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069918    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069921    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069924    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069926    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069929    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.069931    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070296    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:51.073163 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070301    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070304    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070307    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070310    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070313    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070316    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070319    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070321    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070324    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070327    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070329    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070332    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070334    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070337    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070339    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070342    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070348    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070350    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070353    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070355    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:51.073634 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070358    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070360    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070363    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070365    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070368    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070371    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070373    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070376    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070378    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070381    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070383    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070386    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070388    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070391    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070394    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070397    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070400    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070402    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070405    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070408    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:51.074123 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070411    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070413    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070416    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070418    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070421    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070423    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070426    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070428    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070436    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070439    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070443    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070445    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070448    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070451    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070454    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070456    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070459    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070462    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070464    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:51.074601 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070467    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070469    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070472    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070475    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070478    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070482    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070485    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070488    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070490    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070493    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070497    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070499    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070502    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070505    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070507    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070510    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070512    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070514    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070517    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:51.075086 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070519    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070523    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070527    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070531    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070534    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070537    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070540    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070543    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070546    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070550    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070552    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070555    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070558    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070561    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070563    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070566    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070569    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070571    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070574    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.070576    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:51.075617 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070656    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070663    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070670    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070674    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070679    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070683    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070687    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070692    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070695    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070698    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070702    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070705    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070709    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070712    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070715    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070719    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070721    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070724    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070728    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070731    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070734    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070737    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070741    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070745    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 13:59:51.076131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070748    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070751    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070754    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070757    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070760    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070763    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070766    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070768    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070773    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070775    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070778    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070794    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070797    2571 flags.go:64] FLAG: --enable-server="true"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070801    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070806    2571 flags.go:64] FLAG: --event-burst="100"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070809    2571 flags.go:64] FLAG: --event-qps="50"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070812    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070815    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070818    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070822    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070825    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070828    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070831    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070834    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070837    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 13:59:51.076739 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070840    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070844    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070847    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070850    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070853    2571 flags.go:64] FLAG: --feature-gates=""
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070860    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070863    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070866    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070869    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070872    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070875    2571 flags.go:64] FLAG: --help="false"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070878    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070881    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070884    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070887    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070891    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070894    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070897    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070900    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070903    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070906    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070909    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070912    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070915    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 28 13:59:51.077418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070918    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070921    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070924    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070927    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070931    2571 flags.go:64] FLAG: --lock-file=""
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070934    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070937    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070940    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070945    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070948    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070951    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070954    2571 flags.go:64] FLAG: --logging-format="text"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070957    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070960    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070963    2571 flags.go:64] FLAG: --manifest-url=""
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070966    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070970    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070973    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070978    2571 flags.go:64] FLAG: --max-pods="110"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070981    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070984    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070987    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070990    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070993    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070996    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 13:59:51.078016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.070999    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071006    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071009    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071012    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071015    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071019    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071025    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071027    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071030    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071034    2571 flags.go:64] FLAG: --port="10250"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071037    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071040    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0abe6c8101e3900fc"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071043    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071046    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071049    2571 flags.go:64] FLAG: --register-node="true"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071052    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071055    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071058    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071061    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071064    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071067    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071071    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071074    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071077    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071079    2571 flags.go:64] FLAG: --runonce="false"
Jul 28 13:59:51.078628 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071082    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071085    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071088    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071091    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071094    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071097    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071100    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071103    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071105    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071108    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071111    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071114    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071117    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071121    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071124    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071129    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071132    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071137    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071141    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071143    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071146    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071149    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071152    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071155    2571 flags.go:64] FLAG: --v="2"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071159    2571 flags.go:64] FLAG: --version="false"
Jul 28 13:59:51.079258 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071163    2571 flags.go:64] FLAG: --vmodule=""
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071166    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071170    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071284    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071287    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071290    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071293    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071296    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071300    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071303    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071306    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071309    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071311    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071314    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071317    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071319    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071322    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071325    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071327    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:51.079878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071331    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071335    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071338    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071341    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071344    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071348    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071351    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071354    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071358    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071361    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071364    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071366    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071369    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071371    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071374    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071377    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071379    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071382    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071384    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:51.080348 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071388    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071392    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071397    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071400    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071403    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071406    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071408    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071411    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071413    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071416    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071419    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071421    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071424    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071427    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071429    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071432    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071435    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071437    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071441    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:51.080826 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071443    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071446    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071449    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071451    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071454    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071457    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071459    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071462    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071465    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071512    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071516    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071520    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071523    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071526    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071528    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071533    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071535    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071538    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071541    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071543    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:51.081316 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071546    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071548    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071551    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071554    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071557    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071560    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071562    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071565    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071567    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071570    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071573    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071577    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071580    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071583    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071585    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071588    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071590    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071593    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071595    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071598    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:51.081863 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071601    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071603    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071606    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071608    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.071611    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.071616    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.078278    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.078296    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.078314    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.078320    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078381    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078386    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078390    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078392    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078395    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:51.082349 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078398    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078401    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078404    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078406    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078409    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078411    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078414    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078417    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078419    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078422    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078424    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078427    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078430    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078432    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078435    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078437    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078440    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078442    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078445    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078447    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:51.082717 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078452    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078456    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078459    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078462    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078471    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078474    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078477    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078480    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078483    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078485    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078488    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078490    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078493    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078496    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078498    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078500    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078503    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078506    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078508    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078511    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:51.083275 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078513    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078516    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078519    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078521    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078523    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078526    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078528    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078531    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078534    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078536    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078539    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078541    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078544    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078547    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078551    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078554    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078557    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078565    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078569    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:51.083930 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078572    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078575    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078577    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078580    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078583    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078586    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078588    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078592    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078595    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078598    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078601    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078603    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078606    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078608    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078611    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078613    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078616    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078619    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078621    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:51.084418 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078623    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078626    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078629    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078632    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078634    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078637    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078640    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078643    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078646    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078649    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078651    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078654    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078664    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078666    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078669    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:51.084939 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078672    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.078677    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078842    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078847    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078850    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078853    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078857    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078861    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078864    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078867    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078870    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078873    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078876    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078878    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:51.085306 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078882    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078885    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078888    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078891    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078894    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078897    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078899    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078902    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078905    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078908    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078911    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078914    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078917    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078919    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078922    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078924    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078932    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078935    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078938    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078940    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:51.085648 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078942    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078945    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078948    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078950    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078953    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078955    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078958    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078960    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078962    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078965    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078968    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078970    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078973    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078975    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078978    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078980    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078983    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078985    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078988    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078990    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:51.086218 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078993    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078995    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.078998    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079001    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079004    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079006    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079009    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079011    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079013    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079021    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079024    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079027    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079029    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079032    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079034    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079037    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079039    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079041    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079044    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079046    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:51.087009 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079048    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079051    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079054    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079056    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079059    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079061    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079063    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079066    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079068    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079071    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079075    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079078    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079081    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079084    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079086    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079089    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079092    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079095    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079097    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:51.087619 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079099    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079102    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079105    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079113    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079116    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079118    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079120    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:51.079123    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.079128    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.079256    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.081309    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.082740    2571 server.go:1019] "Starting client certificate rotation"
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.082855    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 13:59:51.088293 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.083732    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 13:59:51.088639 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.088613    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 13:59:51.089827 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.089807    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 13:59:51.099978 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.099958    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 28 13:59:51.102131 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.102109    2571 log.go:25] "Validated CRI v1 image API"
Jul 28 13:59:51.105547 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.105526    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 13:59:51.109394 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.109369    2571 fs.go:135] Filesystem UUIDs: map[37565685-93c7-417f-9b7c-e4d4390cfaa7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f8568710-3497-433f-80c5-3470eb11a501:/dev/nvme0n1p3]
Jul 28 13:59:51.109521 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.109393    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 13:59:51.113640 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.113606    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 13:59:51.116299 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.116157    2571 manager.go:216] Machine: {Timestamp:2026-07-28 13:59:51.114635166 +0000 UTC m=+0.333437203 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092305 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4d983eaf1d89c9d91655aa4b827c SystemUUID:ec2a4d98-3eaf-1d89-c9d9-1655aa4b827c BootID:362ebfc6-1c80-4c72-92b0-a9a262e8322e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ec:d5:aa:1e:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ec:d5:aa:1e:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:13:07:27:c3:61 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 13:59:51.116299 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.116284    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 13:59:51.116486 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.116445    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 13:59:51.118282 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.118253    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 13:59:51.118439 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.118287    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 13:59:51.119047 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.119034    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 13:59:51.119081 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.119048    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 13:59:51.119081 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.119056    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 13:59:51.119728 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.119717    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 13:59:51.121018 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.121007    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 13:59:51.124115 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124101    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 13:59:51.124245 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124236    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 13:59:51.124275 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124265    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 13:59:51.124311 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124275    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 13:59:51.124311 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124294    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 13:59:51.124311 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124306    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 28 13:59:51.124398 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124328    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 13:59:51.124939 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124922    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 13:59:51.124993 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.124952    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 13:59:51.129284 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.129262    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 13:59:51.130723 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.130706    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 13:59:51.130821 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.130736    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 13:59:51.131327 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131316    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 13:59:51.131358 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131332    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 13:59:51.131358 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131339    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 13:59:51.131358 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131347    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 13:59:51.131438 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131361    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 13:59:51.131438 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131369    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 13:59:51.131608 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131599    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 13:59:51.131608 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131608    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 13:59:51.131668 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131615    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 13:59:51.131668 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131621    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 13:59:51.131668 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131629    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 13:59:51.131668 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.131637    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 13:59:51.132275 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.132264    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 13:59:51.132275 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.132275    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 13:59:51.135284 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.135259    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 13:59:51.135357 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.135324    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 13:59:51.135357 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.135335    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 13:59:51.135821 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.135807    2571 server.go:1268] "Started kubelet"
Jul 28 13:59:51.135950 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.135901    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 13:59:51.136003 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.135977    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 13:59:51.136052 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.136016    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 13:59:51.136865 ip-10-0-137-91 systemd[1]: Started Kubernetes Kubelet.
Jul 28 13:59:51.138589 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.138568    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 13:59:51.140449 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.140433    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 13:59:51.142261 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.141275    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-91.ec2.internal.18c678dc97e93b0f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-91.ec2.internal,UID:ip-10-0-137-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-91.ec2.internal,},FirstTimestamp:2026-07-28 13:59:51.135763215 +0000 UTC m=+0.354565306,LastTimestamp:2026-07-28 13:59:51.135763215 +0000 UTC m=+0.354565306,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-91.ec2.internal,}"
Jul 28 13:59:51.142651 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.142634    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 13:59:51.145466 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.145447    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8n9mg"
Jul 28 13:59:51.146627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.146609    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 13:59:51.146692 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.146626    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 13:59:51.146813 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.146775    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.147214 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.147199    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 13:59:51.147351 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.147340    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 13:59:51.147804 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.147243    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 13:59:51.147804 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.147584    2571 factory.go:55] Registering systemd factory
Jul 28 13:59:51.147804 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.147597    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 13:59:51.147804 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.147606    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 13:59:51.147804 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.147610    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 28 13:59:51.148150 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.147984    2571 factory.go:153] Registering CRI-O factory
Jul 28 13:59:51.148150 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.148019    2571 factory.go:223] Registration of the crio container factory successfully
Jul 28 13:59:51.148150 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.148067    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 13:59:51.148150 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.148083    2571 factory.go:103] Registering Raw factory
Jul 28 13:59:51.148150 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.148128    2571 manager.go:1196] Started watching for new ooms in manager
Jul 28 13:59:51.148609 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.148595    2571 manager.go:349] Starting recovery of all containers
Jul 28 13:59:51.149970 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.149934    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 13:59:51.150074 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.150046    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 13:59:51.153278 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.153256    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8n9mg"
Jul 28 13:59:51.160730 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.160528    2571 manager.go:354] Recovery completed
Jul 28 13:59:51.165553 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.165539    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:51.167536 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.167517    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:51.167587 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.167555    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:51.167587 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.167567    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:51.168153 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.168140    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 13:59:51.168153 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.168150    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:51.168262 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.168153    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 13:59:51.168262 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.168198    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 13:59:51.168839 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.168768    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:51.168896 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.168872    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:51.168896 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.168883    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:51.169321 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.169307    2571 policy_none.go:49] "None policy: Start"
Jul 28 13:59:51.169354 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.169326    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 13:59:51.169354 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.169340    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 13:59:51.170506 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.170496    2571 policy_none.go:47] "Start"
Jul 28 13:59:51.214388 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.214369    2571 manager.go:337] "Starting Device Plugin manager"
Jul 28 13:59:51.214518 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.214404    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 13:59:51.214518 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.214414    2571 server.go:87] "Starting device plugin registration server"
Jul 28 13:59:51.214693 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.214680    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 13:59:51.214797 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.214702    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 13:59:51.214797 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.214771    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 13:59:51.214887 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.214863    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 13:59:51.214887 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.214874    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 13:59:51.215407 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.215388    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 13:59:51.215480 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.215432    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.315088 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.315011    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:51.316216 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.315987    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:51.316216 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.316020    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:51.316216 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.316031    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:51.316216 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.316059    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.321817 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.321798    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.321919 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.321827    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-91.ec2.internal\": node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.335174 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.335142    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 13:59:51.336506 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.336490    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 13:59:51.336597 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.336525    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 13:59:51.336597 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.336554    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 13:59:51.336597 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.336592    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 13:59:51.338425 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.338407    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:51.339908 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.339885    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.437127 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.437089    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"]
Jul 28 13:59:51.437283 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.437197    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:51.438221 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.438204    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:51.438309 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.438233    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:51.438309 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.438243    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:51.439623 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.439610    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:51.439738 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.439723    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.439778 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.439759    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:51.440031 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.440012    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.440283 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.440268    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:51.440366 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.440294    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:51.440366 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.440308    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:51.440366 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.440313    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:51.440366 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.440329    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:51.440366 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.440341    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:51.441710 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.441692    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.441817 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.441718    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:51.442349 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.442331    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:51.442436 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.442358    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:51.442436 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.442374    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:51.449810 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.449778    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8c5819ec42f2283f44c768b3a7b9474-config\") pod \"kube-apiserver-proxy-ip-10-0-137-91.ec2.internal\" (UID: \"e8c5819ec42f2283f44c768b3a7b9474\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.449869 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.449823    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91e9905dc6437322a1d5488a6f379916-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal\" (UID: \"91e9905dc6437322a1d5488a6f379916\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.449869 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.449843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91e9905dc6437322a1d5488a6f379916-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal\" (UID: \"91e9905dc6437322a1d5488a6f379916\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.466395 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.466376    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-91.ec2.internal\" not found" node="ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.470734 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.470720    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-91.ec2.internal\" not found" node="ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.541055 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.541029    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.550608 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.550583    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8c5819ec42f2283f44c768b3a7b9474-config\") pod \"kube-apiserver-proxy-ip-10-0-137-91.ec2.internal\" (UID: \"e8c5819ec42f2283f44c768b3a7b9474\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.550681 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.550612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91e9905dc6437322a1d5488a6f379916-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal\" (UID: \"91e9905dc6437322a1d5488a6f379916\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.550681 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.550630    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91e9905dc6437322a1d5488a6f379916-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal\" (UID: \"91e9905dc6437322a1d5488a6f379916\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.550681 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.550661    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91e9905dc6437322a1d5488a6f379916-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal\" (UID: \"91e9905dc6437322a1d5488a6f379916\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.550681 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.550666    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8c5819ec42f2283f44c768b3a7b9474-config\") pod \"kube-apiserver-proxy-ip-10-0-137-91.ec2.internal\" (UID: \"e8c5819ec42f2283f44c768b3a7b9474\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.550839 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.550679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91e9905dc6437322a1d5488a6f379916-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal\" (UID: \"91e9905dc6437322a1d5488a6f379916\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.641555 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.641488    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.741946 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.741909    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.769496 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.769470    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.773944 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:51.773816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:51.842930 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.842895    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:51.943509 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:51.943434    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:52.043934 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:52.043902    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:52.082466 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.082424    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 13:59:52.083064 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.082573    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 13:59:52.144449 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:52.144415    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:52.158579 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.158547    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 13:54:51 +0000 UTC" deadline="2028-01-10 11:29:46.290464594 +0000 UTC"
Jul 28 13:59:52.158579 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.158575    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12741h29m54.131893292s"
Jul 28 13:59:52.245522 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:52.245444    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:52.286849 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:52.286800    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e9905dc6437322a1d5488a6f379916.slice/crio-8b03bdbddd19bd33acf85936323c8a7f43989503df35e149b5807c9df24772e8 WatchSource:0}: Error finding container 8b03bdbddd19bd33acf85936323c8a7f43989503df35e149b5807c9df24772e8: Status 404 returned error can't find the container with id 8b03bdbddd19bd33acf85936323c8a7f43989503df35e149b5807c9df24772e8
Jul 28 13:59:52.287225 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:52.287205    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c5819ec42f2283f44c768b3a7b9474.slice/crio-559e9e2bc10fdbeef094a412b6d4fbd1658cf5621f45e258a7e4f636c2ec0291 WatchSource:0}: Error finding container 559e9e2bc10fdbeef094a412b6d4fbd1658cf5621f45e258a7e4f636c2ec0291: Status 404 returned error can't find the container with id 559e9e2bc10fdbeef094a412b6d4fbd1658cf5621f45e258a7e4f636c2ec0291
Jul 28 13:59:52.292037 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.292020    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:59:52.340225 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.340173    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal" event={"ID":"e8c5819ec42f2283f44c768b3a7b9474","Type":"ContainerStarted","Data":"559e9e2bc10fdbeef094a412b6d4fbd1658cf5621f45e258a7e4f636c2ec0291"}
Jul 28 13:59:52.341180 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.341158    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal" event={"ID":"91e9905dc6437322a1d5488a6f379916","Type":"ContainerStarted","Data":"8b03bdbddd19bd33acf85936323c8a7f43989503df35e149b5807c9df24772e8"}
Jul 28 13:59:52.346369 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:52.346356    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:52.446958 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:52.446928    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:52.497030 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.496977    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:52.547376 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:52.547352    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:52.558038 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.558016    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:52.647763 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:52.647729    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-91.ec2.internal\" not found"
Jul 28 13:59:52.664315 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.664291    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:52.747590 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.747511    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:52.758606 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.758572    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 13:59:52.759643 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.759621    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal"
Jul 28 13:59:52.774074 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:52.774049    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 13:59:53.125826 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.125710    2571 apiserver.go:52] "Watching apiserver"
Jul 28 13:59:53.136569 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.136536    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 13:59:53.138691 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.138657    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-s24zx","openshift-multus/multus-additional-cni-plugins-jwqxk","openshift-network-diagnostics/network-check-target-j9tl9","openshift-network-operator/iptables-alerter-697rv","openshift-ovn-kubernetes/ovnkube-node-jz2bp","kube-system/global-pull-secret-syncer-2hw88","kube-system/konnectivity-agent-pw9sn","kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn","openshift-cluster-node-tuning-operator/tuned-g6tqx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal","openshift-multus/multus-vhhjr","openshift-multus/network-metrics-daemon-8wr48","openshift-dns/node-resolver-mhhcq"]
Jul 28 13:59:53.140491 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.140471    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 13:59:53.142436 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.142416    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:53.142536 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.142490    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 13:59:53.144007 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.143988    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:53.144105 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.144053    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 13:59:53.145925 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.145905    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.146975 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.146950    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 13:59:53.147188 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.147172    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 13:59:53.147259 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.147242    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 13:59:53.147379 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.147365    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kqh4m\""
Jul 28 13:59:53.148032 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.148012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.148639 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.148609    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.148741 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.148673    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 13:59:53.149016 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.148996    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 13:59:53.149251 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.149230    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 13:59:53.149345 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.149286    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vt9l8\""
Jul 28 13:59:53.149697 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.149233    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 13:59:53.151955 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.151935    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.152559 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.152541    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 13:59:53.153425 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.153393    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 13:59:53.153425 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.153405    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 13:59:53.153744 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.153725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.153998 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.153874    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 13:59:53.154085 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.154068    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 13:59:53.154196 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.154179    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gg45c\""
Jul 28 13:59:53.154552 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.154530    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 13:59:53.155068 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.155045    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 13:59:53.155200 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.155179    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5nkqh\""
Jul 28 13:59:53.155448 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.155430    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 13:59:53.155667 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.155650    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.155806 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.155756    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 13:59:53.156330 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.156308    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 13:59:53.156962 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.156944    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.157057 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.157048    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 13:59:53.158404 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.158385    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159292    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jr78q\""
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-systemd-units\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-etc-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-host-slash\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2705a3f5-fe74-472f-8de8-f7df5f91210a-kubelet-config\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84ddd743-7271-4c70-a157-605034c9df6a-agent-certs\") pod \"konnectivity-agent-pw9sn\" (UID: \"84ddd743-7271-4c70-a157-605034c9df6a\") " pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159576    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-run-netns\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovnkube-config\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.159694 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159668    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-env-overrides\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovnkube-script-lib\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovn-node-metrics-cert\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-slash\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159921    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-node-log\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159971    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nxx6\" (UniqueName: \"kubernetes.io/projected/c86ca955-dcf1-4788-9c18-3f52972f1f8c-kube-api-access-8nxx6\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160026    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160035    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-var-lib-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160164 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-cni-netd\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160221    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84ddd743-7271-4c70-a157-605034c9df6a-konnectivity-ca\") pod \"konnectivity-agent-pw9sn\" (UID: \"84ddd743-7271-4c70-a157-605034c9df6a\") " pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd546\" (UniqueName: \"kubernetes.io/projected/abf3ad4d-a32a-497a-adbe-db944bf11f3e-kube-api-access-zd546\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-kubelet\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160341    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-cni-bin\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-socket-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160430    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-device-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160525    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25js5\" (UniqueName: \"kubernetes.io/projected/f8fec13e-168f-4585-87b3-8ea6e3754ee7-kube-api-access-25js5\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-sys-fs\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.159924    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 13:59:53.160619 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160614    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-iptables-alerter-script\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160040    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160747    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-systemd\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-ovn\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160858    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160867    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-log-socket\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-registration-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.160964    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc6ts\" (UniqueName: \"kubernetes.io/projected/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-kube-api-access-sc6ts\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.161297 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.161004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2705a3f5-fe74-472f-8de8-f7df5f91210a-dbus\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.161826 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.161323    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zfsc2\""
Jul 28 13:59:53.161826 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.161573    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 13:59:53.161826 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.161648    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 13:59:53.161826 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.161743    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h4wkp\""
Jul 28 13:59:53.161826 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.161747    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 13:59:53.162050 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.161915    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qckb8\""
Jul 28 13:59:53.162050 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.161983    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 13:59:53.164185 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.163845    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 13:59:53.164185 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.164050    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 13:59:53.164185 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.164060    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9xbt9\""
Jul 28 13:59:53.186081 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.186040    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g2txl"
Jul 28 13:59:53.202106 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.202081    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g2txl"
Jul 28 13:59:53.249328 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.249301    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 13:59:53.261421 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261330    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-conf-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.261421 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-modprobe-d\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.261421 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261391    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-run\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261439    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4n6x\" (UniqueName: \"kubernetes.io/projected/5757786e-eb53-4070-a3cb-62434c03d2dd-kube-api-access-s4n6x\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261477    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-hostroot\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf5e24b2-e61d-4833-ad54-2b257498a0a5-host\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-lib-modules\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovnkube-config\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261572    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-env-overrides\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovnkube-script-lib\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-system-cni-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261641    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-cnibin\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261662    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-daemon-config\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-etc-kubernetes\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261713    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovn-node-metrics-cert\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-node-log\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.261819 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261803    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261880    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261895    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-node-log\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261937    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-system-cni-dir\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.261985    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-os-release\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84ddd743-7271-4c70-a157-605034c9df6a-konnectivity-ca\") pod \"konnectivity-agent-pw9sn\" (UID: \"84ddd743-7271-4c70-a157-605034c9df6a\") " pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-kubelet\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25js5\" (UniqueName: \"kubernetes.io/projected/f8fec13e-168f-4585-87b3-8ea6e3754ee7-kube-api-access-25js5\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-sys\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262164    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-iptables-alerter-script\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-cnibin\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.262627 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262223    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-env-overrides\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-k8s-cni-cncf-io\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262255    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovnkube-config\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-kubelet\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262289    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf5e24b2-e61d-4833-ad54-2b257498a0a5-serviceca\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262235    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262300    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-kubelet\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262312    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-var-lib-kubelet\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262434    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfknw\" (UniqueName: \"kubernetes.io/projected/337f5cea-d9c6-4d1c-b02a-0496f4166925-kube-api-access-xfknw\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-systemd\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc6ts\" (UniqueName: \"kubernetes.io/projected/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-kube-api-access-sc6ts\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262548    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262555    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84ddd743-7271-4c70-a157-605034c9df6a-konnectivity-ca\") pod \"konnectivity-agent-pw9sn\" (UID: \"84ddd743-7271-4c70-a157-605034c9df6a\") " pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262604    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovnkube-script-lib\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysconfig\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5757786e-eb53-4070-a3cb-62434c03d2dd-tmp\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.263401 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-systemd-units\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262741    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-etc-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262812    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-host-slash\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-iptables-alerter-script\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd4jq\" (UniqueName: \"kubernetes.io/projected/c6d067b4-0a52-45ee-b70d-f56724815e25-kube-api-access-jd4jq\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-systemd\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-host-slash\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-systemd-units\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262960    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2705a3f5-fe74-472f-8de8-f7df5f91210a-kubelet-config\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262985    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-etc-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.262994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84ddd743-7271-4c70-a157-605034c9df6a-agent-certs\") pod \"konnectivity-agent-pw9sn\" (UID: \"84ddd743-7271-4c70-a157-605034c9df6a\") " pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-run-netns\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2705a3f5-fe74-472f-8de8-f7df5f91210a-kubelet-config\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-run-netns\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-cni-binary-copy\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-cni-multus\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263143    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-multus-certs\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.264086 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysctl-d\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-slash\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263231    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-slash\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nxx6\" (UniqueName: \"kubernetes.io/projected/c86ca955-dcf1-4788-9c18-3f52972f1f8c-kube-api-access-8nxx6\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-netns\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263283    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-cni-bin\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263305    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-var-lib-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263367    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-var-lib-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263381    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-cni-netd\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-tuned\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.263413    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6d067b4-0a52-45ee-b70d-f56724815e25-hosts-file\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263437    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-cni-netd\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263408    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-openvswitch\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d067b4-0a52-45ee-b70d-f56724815e25-tmp-dir\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.264853 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.263492    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs podName:abf3ad4d-a32a-497a-adbe-db944bf11f3e nodeName:}" failed. No retries permitted until 2026-07-28 13:59:53.763469884 +0000 UTC m=+2.982271919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs") pod "network-metrics-daemon-8wr48" (UID: "abf3ad4d-a32a-497a-adbe-db944bf11f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263537    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd546\" (UniqueName: \"kubernetes.io/projected/abf3ad4d-a32a-497a-adbe-db944bf11f3e-kube-api-access-zd546\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-cni-bin\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263597    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-socket-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263618    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-device-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-host-cni-bin\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263641    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-cni-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-kubernetes\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263680    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-device-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-systemd\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263709    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-sys-fs\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263734    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-os-release\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263761    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-socket-dir-parent\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-socket-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263804    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-sys-fs\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263799    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysctl-conf\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263847    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-host\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.265604 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.263951    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.263991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-ovn\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.264016    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret podName:2705a3f5-fe74-472f-8de8-f7df5f91210a nodeName:}" failed. No retries permitted until 2026-07-28 13:59:53.763997302 +0000 UTC m=+2.982799331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret") pod "global-pull-secret-syncer-2hw88" (UID: "2705a3f5-fe74-472f-8de8-f7df5f91210a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-run-ovn\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264052    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-log-socket\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-registration-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264084    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264115    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk2hl\" (UniqueName: \"kubernetes.io/projected/feaca22c-ca4f-440f-a230-7c89afdfdcd3-kube-api-access-xk2hl\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-829qh\" (UniqueName: \"kubernetes.io/projected/cf5e24b2-e61d-4833-ad54-2b257498a0a5-kube-api-access-829qh\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264153    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2705a3f5-fe74-472f-8de8-f7df5f91210a-dbus\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264168    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264185    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feaca22c-ca4f-440f-a230-7c89afdfdcd3-cni-binary-copy\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264339    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8fec13e-168f-4585-87b3-8ea6e3754ee7-registration-dir\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264345    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2705a3f5-fe74-472f-8de8-f7df5f91210a-dbus\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.264382    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c86ca955-dcf1-4788-9c18-3f52972f1f8c-log-socket\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.266801    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c86ca955-dcf1-4788-9c18-3f52972f1f8c-ovn-node-metrics-cert\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.266981 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.266835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84ddd743-7271-4c70-a157-605034c9df6a-agent-certs\") pod \"konnectivity-agent-pw9sn\" (UID: \"84ddd743-7271-4c70-a157-605034c9df6a\") " pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 13:59:53.279030 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.278953    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25js5\" (UniqueName: \"kubernetes.io/projected/f8fec13e-168f-4585-87b3-8ea6e3754ee7-kube-api-access-25js5\") pod \"aws-ebs-csi-driver-node-5pgvn\" (UID: \"f8fec13e-168f-4585-87b3-8ea6e3754ee7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.279775 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.279751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nxx6\" (UniqueName: \"kubernetes.io/projected/c86ca955-dcf1-4788-9c18-3f52972f1f8c-kube-api-access-8nxx6\") pod \"ovnkube-node-jz2bp\" (UID: \"c86ca955-dcf1-4788-9c18-3f52972f1f8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.281496 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.281448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc6ts\" (UniqueName: \"kubernetes.io/projected/7208e5f2-45c3-4662-bd5e-8b1cc4af3c15-kube-api-access-sc6ts\") pod \"iptables-alerter-697rv\" (UID: \"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15\") " pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.285190 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.285165    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:53.285190 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.285190    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:53.285335 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.285204    2571 projected.go:196] Error preparing data for projected volume kube-api-access-bwfjs for pod openshift-network-diagnostics/network-check-target-j9tl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:53.285335 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.285284    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs podName:a1e1431b-4788-4cbf-8ce2-f88f4a17445c nodeName:}" failed. No retries permitted until 2026-07-28 13:59:53.785265745 +0000 UTC m=+3.004067792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bwfjs" (UniqueName: "kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs") pod "network-check-target-j9tl9" (UID: "a1e1431b-4788-4cbf-8ce2-f88f4a17445c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:53.287986 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.287966    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd546\" (UniqueName: \"kubernetes.io/projected/abf3ad4d-a32a-497a-adbe-db944bf11f3e-kube-api-access-zd546\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:53.365218 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-tuned\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.365218 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6d067b4-0a52-45ee-b70d-f56724815e25-hosts-file\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.365457 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365244    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d067b4-0a52-45ee-b70d-f56724815e25-tmp-dir\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.365457 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365424    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6d067b4-0a52-45ee-b70d-f56724815e25-hosts-file\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.365554 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-cni-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.365554 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365490    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-kubernetes\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.365554 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-systemd\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.365554 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-os-release\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-socket-dir-parent\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365567    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6d067b4-0a52-45ee-b70d-f56724815e25-tmp-dir\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-cni-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysctl-conf\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-systemd\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-kubernetes\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-host\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-socket-dir-parent\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365648    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-os-release\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365674    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-host\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365698    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk2hl\" (UniqueName: \"kubernetes.io/projected/feaca22c-ca4f-440f-a230-7c89afdfdcd3-kube-api-access-xk2hl\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365728    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-829qh\" (UniqueName: \"kubernetes.io/projected/cf5e24b2-e61d-4833-ad54-2b257498a0a5-kube-api-access-829qh\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.365743 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysctl-conf\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365754    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365796    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feaca22c-ca4f-440f-a230-7c89afdfdcd3-cni-binary-copy\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365823    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-conf-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365844    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-modprobe-d\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-run\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365886    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4n6x\" (UniqueName: \"kubernetes.io/projected/5757786e-eb53-4070-a3cb-62434c03d2dd-kube-api-access-s4n6x\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365905    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-hostroot\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf5e24b2-e61d-4833-ad54-2b257498a0a5-host\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365951    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-lib-modules\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.365982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-system-cni-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366012    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-cnibin\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366037    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-daemon-config\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-hostroot\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366054    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-system-cni-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-etc-kubernetes\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366095    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf5e24b2-e61d-4833-ad54-2b257498a0a5-host\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.366418 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-system-cni-dir\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-lib-modules\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366157    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-os-release\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366184    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-sys\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366187    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-modprobe-d\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-etc-kubernetes\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-cnibin\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366226    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-cnibin\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-run\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-k8s-cni-cncf-io\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-kubelet\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366281    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-system-cni-dir\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366300    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf5e24b2-e61d-4833-ad54-2b257498a0a5-serviceca\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-var-lib-kubelet\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366338    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366345    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-sys\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366303    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-conf-dir\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366365    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-os-release\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.367261 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366380    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-kubelet\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfknw\" (UniqueName: \"kubernetes.io/projected/337f5cea-d9c6-4d1c-b02a-0496f4166925-kube-api-access-xfknw\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-k8s-cni-cncf-io\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366420    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysconfig\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366482    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feaca22c-ca4f-440f-a230-7c89afdfdcd3-cni-binary-copy\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366491    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-cnibin\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5757786e-eb53-4070-a3cb-62434c03d2dd-tmp\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366553    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysconfig\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366553    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/337f5cea-d9c6-4d1c-b02a-0496f4166925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd4jq\" (UniqueName: \"kubernetes.io/projected/c6d067b4-0a52-45ee-b70d-f56724815e25-kube-api-access-jd4jq\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366599    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-cni-binary-copy\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366627    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-cni-multus\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-multus-certs\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysctl-d\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366687    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feaca22c-ca4f-440f-a230-7c89afdfdcd3-multus-daemon-config\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-netns\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368059 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-cni-bin\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366745    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-cni-multus\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-multus-certs\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-var-lib-cni-bin\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-var-lib-kubelet\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366842    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feaca22c-ca4f-440f-a230-7c89afdfdcd3-host-run-netns\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-sysctl-d\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.366982    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.367113    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf5e24b2-e61d-4833-ad54-2b257498a0a5-serviceca\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.367211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/337f5cea-d9c6-4d1c-b02a-0496f4166925-cni-binary-copy\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.368696 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.367976    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5757786e-eb53-4070-a3cb-62434c03d2dd-etc-tuned\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.369018 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.368755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5757786e-eb53-4070-a3cb-62434c03d2dd-tmp\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.378953 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.378753    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4n6x\" (UniqueName: \"kubernetes.io/projected/5757786e-eb53-4070-a3cb-62434c03d2dd-kube-api-access-s4n6x\") pod \"tuned-g6tqx\" (UID: \"5757786e-eb53-4070-a3cb-62434c03d2dd\") " pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.378953 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.378916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-829qh\" (UniqueName: \"kubernetes.io/projected/cf5e24b2-e61d-4833-ad54-2b257498a0a5-kube-api-access-829qh\") pod \"node-ca-s24zx\" (UID: \"cf5e24b2-e61d-4833-ad54-2b257498a0a5\") " pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.379426 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.379403    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd4jq\" (UniqueName: \"kubernetes.io/projected/c6d067b4-0a52-45ee-b70d-f56724815e25-kube-api-access-jd4jq\") pod \"node-resolver-mhhcq\" (UID: \"c6d067b4-0a52-45ee-b70d-f56724815e25\") " pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.380019 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.380002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk2hl\" (UniqueName: \"kubernetes.io/projected/feaca22c-ca4f-440f-a230-7c89afdfdcd3-kube-api-access-xk2hl\") pod \"multus-vhhjr\" (UID: \"feaca22c-ca4f-440f-a230-7c89afdfdcd3\") " pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.381330 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.381297    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfknw\" (UniqueName: \"kubernetes.io/projected/337f5cea-d9c6-4d1c-b02a-0496f4166925-kube-api-access-xfknw\") pod \"multus-additional-cni-plugins-jwqxk\" (UID: \"337f5cea-d9c6-4d1c-b02a-0496f4166925\") " pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.459011 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.458977    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:53.460577 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.460554    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 13:59:53.468421 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.468402    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-697rv"
Jul 28 13:59:53.485200 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.485173    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 13:59:53.492368 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.492349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn"
Jul 28 13:59:53.501089 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.501064    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s24zx"
Jul 28 13:59:53.508878 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.508857    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jwqxk"
Jul 28 13:59:53.516873 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.516851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g6tqx"
Jul 28 13:59:53.524715 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.524693    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mhhcq"
Jul 28 13:59:53.531466 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.531449    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vhhjr"
Jul 28 13:59:53.769941 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.769857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:53.769941 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.769919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:53.770143 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.770014    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:53.770143 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.770074    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret podName:2705a3f5-fe74-472f-8de8-f7df5f91210a nodeName:}" failed. No retries permitted until 2026-07-28 13:59:54.770056909 +0000 UTC m=+3.988858933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret") pod "global-pull-secret-syncer-2hw88" (UID: "2705a3f5-fe74-472f-8de8-f7df5f91210a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:53.770143 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.770111    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:53.770284 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.770181    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs podName:abf3ad4d-a32a-497a-adbe-db944bf11f3e nodeName:}" failed. No retries permitted until 2026-07-28 13:59:54.770162997 +0000 UTC m=+3.988965023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs") pod "network-metrics-daemon-8wr48" (UID: "abf3ad4d-a32a-497a-adbe-db944bf11f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:53.870679 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:53.870649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:53.870871 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.870779    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:53.870871 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.870816    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:53.870871 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.870828    2571 projected.go:196] Error preparing data for projected volume kube-api-access-bwfjs for pod openshift-network-diagnostics/network-check-target-j9tl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:53.870976 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:53.870878    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs podName:a1e1431b-4788-4cbf-8ce2-f88f4a17445c nodeName:}" failed. No retries permitted until 2026-07-28 13:59:54.870866156 +0000 UTC m=+4.089668180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bwfjs" (UniqueName: "kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs") pod "network-check-target-j9tl9" (UID: "a1e1431b-4788-4cbf-8ce2-f88f4a17445c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:54.166686 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:54.166659    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7208e5f2_45c3_4662_bd5e_8b1cc4af3c15.slice/crio-b357128945a970eb6e0cee269fb8362ec961f13fa002b6a288a16c083cf44406 WatchSource:0}: Error finding container b357128945a970eb6e0cee269fb8362ec961f13fa002b6a288a16c083cf44406: Status 404 returned error can't find the container with id b357128945a970eb6e0cee269fb8362ec961f13fa002b6a288a16c083cf44406
Jul 28 13:59:54.174709 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:54.174682    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fec13e_168f_4585_87b3_8ea6e3754ee7.slice/crio-a3762a07d687ce6b6a7c6a6e9f09f4dd5eba64b2aaff40f5346e2e101522d7c0 WatchSource:0}: Error finding container a3762a07d687ce6b6a7c6a6e9f09f4dd5eba64b2aaff40f5346e2e101522d7c0: Status 404 returned error can't find the container with id a3762a07d687ce6b6a7c6a6e9f09f4dd5eba64b2aaff40f5346e2e101522d7c0
Jul 28 13:59:54.175672 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:54.175649    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86ca955_dcf1_4788_9c18_3f52972f1f8c.slice/crio-8521246ef5350ffc14e841d36955e40a9744b54c5476c14de27fd3ef098fe58f WatchSource:0}: Error finding container 8521246ef5350ffc14e841d36955e40a9744b54c5476c14de27fd3ef098fe58f: Status 404 returned error can't find the container with id 8521246ef5350ffc14e841d36955e40a9744b54c5476c14de27fd3ef098fe58f
Jul 28 13:59:54.176074 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:54.176051    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ddd743_7271_4c70_a157_605034c9df6a.slice/crio-746234617b086a4994013a44eeb9f58d34a6dea08bdaf1517e508927fae2a12f WatchSource:0}: Error finding container 746234617b086a4994013a44eeb9f58d34a6dea08bdaf1517e508927fae2a12f: Status 404 returned error can't find the container with id 746234617b086a4994013a44eeb9f58d34a6dea08bdaf1517e508927fae2a12f
Jul 28 13:59:54.178383 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:54.177567    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeaca22c_ca4f_440f_a230_7c89afdfdcd3.slice/crio-0ff5c3fe844b98ced8077c72fe19a26889c703230fa8588be74986f573c4f08b WatchSource:0}: Error finding container 0ff5c3fe844b98ced8077c72fe19a26889c703230fa8588be74986f573c4f08b: Status 404 returned error can't find the container with id 0ff5c3fe844b98ced8077c72fe19a26889c703230fa8588be74986f573c4f08b
Jul 28 13:59:54.178878 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:54.178757    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d067b4_0a52_45ee_b70d_f56724815e25.slice/crio-d7e346d2748c08c20073bc455347aa5f0a277ae653b9054715308641a38f110e WatchSource:0}: Error finding container d7e346d2748c08c20073bc455347aa5f0a277ae653b9054715308641a38f110e: Status 404 returned error can't find the container with id d7e346d2748c08c20073bc455347aa5f0a277ae653b9054715308641a38f110e
Jul 28 13:59:54.179959 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:54.179932    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337f5cea_d9c6_4d1c_b02a_0496f4166925.slice/crio-af265de987bfd75459ee2727d96159f04212d49d88c27114860b49c9b4ad93a3 WatchSource:0}: Error finding container af265de987bfd75459ee2727d96159f04212d49d88c27114860b49c9b4ad93a3: Status 404 returned error can't find the container with id af265de987bfd75459ee2727d96159f04212d49d88c27114860b49c9b4ad93a3
Jul 28 13:59:54.182234 ip-10-0-137-91 kubenswrapper[2571]: W0728 13:59:54.181560    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5757786e_eb53_4070_a3cb_62434c03d2dd.slice/crio-07095ca1d9a1f517293c9cb2f2178674b3b8a0cb6a79b8856e097a46e519cbda WatchSource:0}: Error finding container 07095ca1d9a1f517293c9cb2f2178674b3b8a0cb6a79b8856e097a46e519cbda: Status 404 returned error can't find the container with id 07095ca1d9a1f517293c9cb2f2178674b3b8a0cb6a79b8856e097a46e519cbda
Jul 28 13:59:54.204626 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.204578    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:54:53 +0000 UTC" deadline="2028-01-03 22:12:27.600199306 +0000 UTC"
Jul 28 13:59:54.204626 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.204604    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12584h12m33.395598871s"
Jul 28 13:59:54.344747 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.344703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pw9sn" event={"ID":"84ddd743-7271-4c70-a157-605034c9df6a","Type":"ContainerStarted","Data":"746234617b086a4994013a44eeb9f58d34a6dea08bdaf1517e508927fae2a12f"}
Jul 28 13:59:54.345624 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.345604    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn" event={"ID":"f8fec13e-168f-4585-87b3-8ea6e3754ee7","Type":"ContainerStarted","Data":"a3762a07d687ce6b6a7c6a6e9f09f4dd5eba64b2aaff40f5346e2e101522d7c0"}
Jul 28 13:59:54.346476 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.346457    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s24zx" event={"ID":"cf5e24b2-e61d-4833-ad54-2b257498a0a5","Type":"ContainerStarted","Data":"250895993a4a8800be59e9442014fc1436f135a5d4192c726a0bd2489721a337"}
Jul 28 13:59:54.347339 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.347319    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mhhcq" event={"ID":"c6d067b4-0a52-45ee-b70d-f56724815e25","Type":"ContainerStarted","Data":"d7e346d2748c08c20073bc455347aa5f0a277ae653b9054715308641a38f110e"}
Jul 28 13:59:54.348395 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.348377    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"8521246ef5350ffc14e841d36955e40a9744b54c5476c14de27fd3ef098fe58f"}
Jul 28 13:59:54.349278 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.349260    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-697rv" event={"ID":"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15","Type":"ContainerStarted","Data":"b357128945a970eb6e0cee269fb8362ec961f13fa002b6a288a16c083cf44406"}
Jul 28 13:59:54.350750 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.350732    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal" event={"ID":"e8c5819ec42f2283f44c768b3a7b9474","Type":"ContainerStarted","Data":"f167c049510a913af114e67b1428fc84a58061e916069176b886e8c4b4415e4d"}
Jul 28 13:59:54.351639 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.351620    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g6tqx" event={"ID":"5757786e-eb53-4070-a3cb-62434c03d2dd","Type":"ContainerStarted","Data":"07095ca1d9a1f517293c9cb2f2178674b3b8a0cb6a79b8856e097a46e519cbda"}
Jul 28 13:59:54.352509 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.352492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" event={"ID":"337f5cea-d9c6-4d1c-b02a-0496f4166925","Type":"ContainerStarted","Data":"af265de987bfd75459ee2727d96159f04212d49d88c27114860b49c9b4ad93a3"}
Jul 28 13:59:54.353483 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.353465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vhhjr" event={"ID":"feaca22c-ca4f-440f-a230-7c89afdfdcd3","Type":"ContainerStarted","Data":"0ff5c3fe844b98ced8077c72fe19a26889c703230fa8588be74986f573c4f08b"}
Jul 28 13:59:54.367163 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.367115    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-91.ec2.internal" podStartSLOduration=2.3671028339999998 podStartE2EDuration="2.367102834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:59:54.366974286 +0000 UTC m=+3.585776332" watchObservedRunningTime="2026-07-28 13:59:54.367102834 +0000 UTC m=+3.585904880"
Jul 28 13:59:54.778390 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.778299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:54.778390 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.778362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:54.778616 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:54.778500    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:54.778616 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:54.778560    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret podName:2705a3f5-fe74-472f-8de8-f7df5f91210a nodeName:}" failed. No retries permitted until 2026-07-28 13:59:56.778543057 +0000 UTC m=+5.997345084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret") pod "global-pull-secret-syncer-2hw88" (UID: "2705a3f5-fe74-472f-8de8-f7df5f91210a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:54.778736 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:54.778622    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:54.778736 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:54.778657    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs podName:abf3ad4d-a32a-497a-adbe-db944bf11f3e nodeName:}" failed. No retries permitted until 2026-07-28 13:59:56.778645119 +0000 UTC m=+5.997447143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs") pod "network-metrics-daemon-8wr48" (UID: "abf3ad4d-a32a-497a-adbe-db944bf11f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:54.879556 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:54.879516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:54.879736 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:54.879689    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:54.879736 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:54.879707    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:54.879736 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:54.879718    2571 projected.go:196] Error preparing data for projected volume kube-api-access-bwfjs for pod openshift-network-diagnostics/network-check-target-j9tl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:54.879926 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:54.879776    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs podName:a1e1431b-4788-4cbf-8ce2-f88f4a17445c nodeName:}" failed. No retries permitted until 2026-07-28 13:59:56.879757899 +0000 UTC m=+6.098559942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bwfjs" (UniqueName: "kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs") pod "network-check-target-j9tl9" (UID: "a1e1431b-4788-4cbf-8ce2-f88f4a17445c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:55.205563 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:55.205497    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:54:53 +0000 UTC" deadline="2028-03-13 07:37:52.799961761 +0000 UTC"
Jul 28 13:59:55.205563 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:55.205561    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14249h37m57.594405068s"
Jul 28 13:59:55.339301 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:55.339268    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:55.339474 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:55.339399    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 13:59:55.339835 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:55.339816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:55.339940 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:55.339921    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 13:59:55.340009 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:55.339994    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:55.340122 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:55.340077    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 13:59:55.368249 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:55.368217    2571 generic.go:356] "Generic (PLEG): container finished" podID="91e9905dc6437322a1d5488a6f379916" containerID="4451e553c36c8677ca1f3cc63af99033bb76bc2c195261159133a9623beda95f" exitCode=0
Jul 28 13:59:55.369245 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:55.369219    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal" event={"ID":"91e9905dc6437322a1d5488a6f379916","Type":"ContainerDied","Data":"4451e553c36c8677ca1f3cc63af99033bb76bc2c195261159133a9623beda95f"}
Jul 28 13:59:56.383836 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:56.383566    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal" event={"ID":"91e9905dc6437322a1d5488a6f379916","Type":"ContainerStarted","Data":"906379776fc988d4647cc230e53ce83b183327fd9cf6924c447b2c3fef043edb"}
Jul 28 13:59:56.403166 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:56.403104    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-91.ec2.internal" podStartSLOduration=4.403064301 podStartE2EDuration="4.403064301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:59:56.402078289 +0000 UTC m=+5.620880338" watchObservedRunningTime="2026-07-28 13:59:56.403064301 +0000 UTC m=+5.621866346"
Jul 28 13:59:56.792467 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:56.792383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:56.792467 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:56.792451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:56.792687 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:56.792647    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:56.792738 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:56.792717    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret podName:2705a3f5-fe74-472f-8de8-f7df5f91210a nodeName:}" failed. No retries permitted until 2026-07-28 14:00:00.792697202 +0000 UTC m=+10.011499249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret") pod "global-pull-secret-syncer-2hw88" (UID: "2705a3f5-fe74-472f-8de8-f7df5f91210a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:56.792908 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:56.792829    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:56.792991 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:56.792882    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs podName:abf3ad4d-a32a-497a-adbe-db944bf11f3e nodeName:}" failed. No retries permitted until 2026-07-28 14:00:00.792869699 +0000 UTC m=+10.011671738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs") pod "network-metrics-daemon-8wr48" (UID: "abf3ad4d-a32a-497a-adbe-db944bf11f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:56.893713 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:56.893675    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:56.893913 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:56.893871    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:56.893913 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:56.893891    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:56.893913 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:56.893906    2571 projected.go:196] Error preparing data for projected volume kube-api-access-bwfjs for pod openshift-network-diagnostics/network-check-target-j9tl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:56.894074 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:56.893965    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs podName:a1e1431b-4788-4cbf-8ce2-f88f4a17445c nodeName:}" failed. No retries permitted until 2026-07-28 14:00:00.893946213 +0000 UTC m=+10.112748254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bwfjs" (UniqueName: "kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs") pod "network-check-target-j9tl9" (UID: "a1e1431b-4788-4cbf-8ce2-f88f4a17445c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:57.337698 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:57.337663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:57.337911 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:57.337824    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 13:59:57.338078 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:57.338057    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:57.338173 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:57.338078    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:57.338244 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:57.338163    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 13:59:57.338303 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:57.338254    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 13:59:59.337371 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:59.337289    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 13:59:59.337841 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:59.337437    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 13:59:59.337985 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:59.337908    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 13:59:59.337985 ip-10-0-137-91 kubenswrapper[2571]: I0728 13:59:59.337927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 13:59:59.338167 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:59.338026    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 13:59:59.338167 ip-10-0-137-91 kubenswrapper[2571]: E0728 13:59:59.338112    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:00.828295 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:00.827947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:00.828295 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:00.828010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:00.828295 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:00.828255    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:00.828954 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:00.828335    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs podName:abf3ad4d-a32a-497a-adbe-db944bf11f3e nodeName:}" failed. No retries permitted until 2026-07-28 14:00:08.828313808 +0000 UTC m=+18.047115836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs") pod "network-metrics-daemon-8wr48" (UID: "abf3ad4d-a32a-497a-adbe-db944bf11f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:00.828954 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:00.828257    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:00.828954 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:00.828416    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret podName:2705a3f5-fe74-472f-8de8-f7df5f91210a nodeName:}" failed. No retries permitted until 2026-07-28 14:00:08.828396449 +0000 UTC m=+18.047198492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret") pod "global-pull-secret-syncer-2hw88" (UID: "2705a3f5-fe74-472f-8de8-f7df5f91210a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:00.929572 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:00.929471    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:00.929775 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:00.929670    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 14:00:00.929775 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:00.929698    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 14:00:00.929775 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:00.929712    2571 projected.go:196] Error preparing data for projected volume kube-api-access-bwfjs for pod openshift-network-diagnostics/network-check-target-j9tl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:00.929775 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:00.929770    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs podName:a1e1431b-4788-4cbf-8ce2-f88f4a17445c nodeName:}" failed. No retries permitted until 2026-07-28 14:00:08.929751886 +0000 UTC m=+18.148553932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bwfjs" (UniqueName: "kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs") pod "network-check-target-j9tl9" (UID: "a1e1431b-4788-4cbf-8ce2-f88f4a17445c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:01.338058 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:01.337706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:01.338058 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:01.337820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:01.338058 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:01.337841    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:01.338058 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:01.337910    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:01.338058 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:01.337958    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:01.338058 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:01.338024    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:03.341105 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:03.341057    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:03.341105 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:03.341076    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:03.341621 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:03.341183    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:03.341621 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:03.341265    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:03.341621 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:03.341336    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:03.341621 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:03.341407    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:05.341085 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:05.341047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:05.341085 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:05.341090    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:05.341504 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:05.341090    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:05.341504 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:05.341184    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:05.341504 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:05.341268    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:05.341504 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:05.341325    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:07.337447 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:07.337407    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:07.337894 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:07.337417    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:07.337894 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:07.337556    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:07.337894 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:07.337422    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:07.337894 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:07.337625    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:07.337894 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:07.337709    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:08.894542 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:08.894504    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:08.895100 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:08.894567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:08.895100 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:08.894688    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:08.895100 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:08.894756    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs podName:abf3ad4d-a32a-497a-adbe-db944bf11f3e nodeName:}" failed. No retries permitted until 2026-07-28 14:00:24.894738036 +0000 UTC m=+34.113540063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs") pod "network-metrics-daemon-8wr48" (UID: "abf3ad4d-a32a-497a-adbe-db944bf11f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:08.895100 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:08.894693    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:08.895100 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:08.894851    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret podName:2705a3f5-fe74-472f-8de8-f7df5f91210a nodeName:}" failed. No retries permitted until 2026-07-28 14:00:24.89483162 +0000 UTC m=+34.113633644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret") pod "global-pull-secret-syncer-2hw88" (UID: "2705a3f5-fe74-472f-8de8-f7df5f91210a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:08.995138 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:08.995103    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:08.995313 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:08.995280    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 14:00:08.995313 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:08.995301    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 14:00:08.995313 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:08.995311    2571 projected.go:196] Error preparing data for projected volume kube-api-access-bwfjs for pod openshift-network-diagnostics/network-check-target-j9tl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:08.995437 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:08.995369    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs podName:a1e1431b-4788-4cbf-8ce2-f88f4a17445c nodeName:}" failed. No retries permitted until 2026-07-28 14:00:24.995350219 +0000 UTC m=+34.214152246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bwfjs" (UniqueName: "kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs") pod "network-check-target-j9tl9" (UID: "a1e1431b-4788-4cbf-8ce2-f88f4a17445c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:09.337152 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:09.337070    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:09.337311 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:09.337082    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:09.337311 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:09.337200    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:09.337311 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:09.337210    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:09.337432 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:09.337327    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:09.337432 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:09.337410    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:11.337871 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:11.337837    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:11.338354 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:11.337928    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:11.338354 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:11.337944    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:11.338354 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:11.337977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:11.338354 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:11.338061    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:11.338354 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:11.338168    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:13.337753 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.337448    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:13.338388 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.337448    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:13.338388 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:13.337858    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:13.338388 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.337510    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:13.338388 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:13.337911    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:13.338388 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:13.337990    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:13.433345 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.433307    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g6tqx" event={"ID":"5757786e-eb53-4070-a3cb-62434c03d2dd","Type":"ContainerStarted","Data":"1b908d658f27407126657f64327984b137c07563137963e6550f97afcf891496"}
Jul 28 14:00:13.435007 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.434980    2571 generic.go:356] "Generic (PLEG): container finished" podID="337f5cea-d9c6-4d1c-b02a-0496f4166925" containerID="b66d9a52bd26e48879997bdbfee0f270840288403b3dfb348503149d217f243b" exitCode=0
Jul 28 14:00:13.435109 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.435020    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" event={"ID":"337f5cea-d9c6-4d1c-b02a-0496f4166925","Type":"ContainerDied","Data":"b66d9a52bd26e48879997bdbfee0f270840288403b3dfb348503149d217f243b"}
Jul 28 14:00:13.436876 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.436855    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vhhjr" event={"ID":"feaca22c-ca4f-440f-a230-7c89afdfdcd3","Type":"ContainerStarted","Data":"c2dbd955d92d90f38e99775832765abceab96a1eb5721e564996284caeb29bd3"}
Jul 28 14:00:13.438600 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.438582    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pw9sn" event={"ID":"84ddd743-7271-4c70-a157-605034c9df6a","Type":"ContainerStarted","Data":"7ee1e470844f4752b291db0cf1aa5c24460a1dfd503299c4ff5fc83c409c19b6"}
Jul 28 14:00:13.440017 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.439996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn" event={"ID":"f8fec13e-168f-4585-87b3-8ea6e3754ee7","Type":"ContainerStarted","Data":"bcb5a44522664fd816649fd67a59a24ef89cbdf37e5b0f18f3c4ef0955c92fc3"}
Jul 28 14:00:13.441418 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.441397    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s24zx" event={"ID":"cf5e24b2-e61d-4833-ad54-2b257498a0a5","Type":"ContainerStarted","Data":"bbc205586b5bae8f6c02eb8dac0e92f60927409fba00eaa1018cf271dc91874b"}
Jul 28 14:00:13.442717 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.442693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mhhcq" event={"ID":"c6d067b4-0a52-45ee-b70d-f56724815e25","Type":"ContainerStarted","Data":"47563cddf5f5727d5a8b8c150535281b928b67e9b284a358f5802e2e791bac80"}
Jul 28 14:00:13.445588 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.445570    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"dbe6b6d526a16173e0584d02ccb9c576e3d9c6fd29491323b78c2b4a717cba42"}
Jul 28 14:00:13.445694 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.445640    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"e4461b6200de9c7279990e9613ca6eca46a2f71962b8c8b9d71935b1e5159cae"}
Jul 28 14:00:13.445755 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.445692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"110242251fdfd0ec26d4e7ad77a4efa0e1c45ff0ecfdf56e7c50fb226ef6af6d"}
Jul 28 14:00:13.445755 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.445740    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"09b32ab81a6f604481ebfd0af79a35bbc3656e293b0efdac6c2de75775bd7f39"}
Jul 28 14:00:13.445880 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.445848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"61edf695f22f4f14bb746511e193b320b0ea331912990f545c3bee65e3c4059f"}
Jul 28 14:00:13.451319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.451252    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g6tqx" podStartSLOduration=3.921324034 podStartE2EDuration="22.451241518s" totalImagesPullingTime="18.529917484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:13.451120293 +0000 UTC m=+22.669922339" watchObservedRunningTime="2026-07-28 14:00:13.451241518 +0000 UTC m=+22.670043566"
Jul 28 14:00:13.493148 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.493107    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mhhcq" podStartSLOduration=3.960730333 podStartE2EDuration="22.493091886s" totalImagesPullingTime="18.532361553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:13.492960329 +0000 UTC m=+22.711762377" watchObservedRunningTime="2026-07-28 14:00:13.493091886 +0000 UTC m=+22.711893944"
Jul 28 14:00:13.513083 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.513033    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vhhjr" podStartSLOduration=3.962049024 podStartE2EDuration="22.51301595s" totalImagesPullingTime="18.550966926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:13.51291983 +0000 UTC m=+22.731721880" watchObservedRunningTime="2026-07-28 14:00:13.51301595 +0000 UTC m=+22.731817996"
Jul 28 14:00:13.528799 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.528723    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pw9sn" podStartSLOduration=8.342077244 podStartE2EDuration="22.528705347s" totalImagesPullingTime="14.186628103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:13.528095804 +0000 UTC m=+22.746897854" watchObservedRunningTime="2026-07-28 14:00:13.528705347 +0000 UTC m=+22.747507398"
Jul 28 14:00:13.536842 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.536772    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 14:00:13.550572 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.550531    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s24zx" podStartSLOduration=4.012241567 podStartE2EDuration="22.550518419s" totalImagesPullingTime="18.538276852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:13.550240828 +0000 UTC m=+22.769042875" watchObservedRunningTime="2026-07-28 14:00:13.550518419 +0000 UTC m=+22.769320466"
Jul 28 14:00:13.606680 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.606651    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 14:00:13.607375 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:13.607356    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 14:00:14.451019 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:14.450940    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"8f407e4d4655bad94c5b91fb44cfb3272f4052589c73eba2de9db89abde2afc2"}
Jul 28 14:00:14.452468 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:14.452436    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-697rv" event={"ID":"7208e5f2-45c3-4662-bd5e-8b1cc4af3c15","Type":"ContainerStarted","Data":"edebf11109079f419a784958e599dc3968c8f9cc51b73d6ec385ec3eea43ccb9"}
Jul 28 14:00:14.453631 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:14.453609    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pw9sn"
Jul 28 14:00:14.471848 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:14.471774    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-697rv" podStartSLOduration=4.928722036 podStartE2EDuration="23.471761982s" totalImagesPullingTime="18.543039946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:14.471251998 +0000 UTC m=+23.690054046" watchObservedRunningTime="2026-07-28 14:00:14.471761982 +0000 UTC m=+23.690564074"
Jul 28 14:00:14.785694 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:14.785658    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 14:00:15.227754 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:15.227593    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T14:00:14.785684662Z","UUID":"e4ff084a-b44d-4c69-b0bf-fb507ff9e5c9","Handler":null,"Name":"","Endpoint":""}
Jul 28 14:00:15.229314 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:15.229289    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 14:00:15.229454 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:15.229337    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 14:00:15.337871 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:15.337842    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:15.338060 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:15.337982    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:15.338134 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:15.338097    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:15.338134 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:15.337977    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:15.338233 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:15.338166    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:15.338336 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:15.338247    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:15.457514 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:15.457478    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn" event={"ID":"f8fec13e-168f-4585-87b3-8ea6e3754ee7","Type":"ContainerStarted","Data":"7a8858b42ff2dc32e25c213a80d25770edafcabb6a62ec01b781d2b746b82352"}
Jul 28 14:00:16.462564 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:16.462314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn" event={"ID":"f8fec13e-168f-4585-87b3-8ea6e3754ee7","Type":"ContainerStarted","Data":"7df13cac2b5dbfa4845061a032b6d14711c5d5a0b569210f18487fe486cb647c"}
Jul 28 14:00:16.465940 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:16.465911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"015deafcb9327bcb4eaaad9f9c61bfb932976b28c5f589d4fc7b30b49ab57df7"}
Jul 28 14:00:17.337818 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:17.337764    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:17.338035 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:17.337770    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:17.338035 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:17.337931    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:17.338035 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:17.337770    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:17.338035 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:17.338023    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:17.338247 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:17.338095    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:18.474081 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:18.473829    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" event={"ID":"c86ca955-dcf1-4788-9c18-3f52972f1f8c","Type":"ContainerStarted","Data":"59cd76bd15f0b5db808d87a200079978c570c1e0d0a37b1b049dcefaf1aa992a"}
Jul 28 14:00:18.474855 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:18.474158    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 14:00:18.474855 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:18.474211    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 14:00:18.475607 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:18.475575    2571 generic.go:356] "Generic (PLEG): container finished" podID="337f5cea-d9c6-4d1c-b02a-0496f4166925" containerID="8508c3ffb4b943c4f83572b00c3bb50cefe968c0f1da4a67e44d2bdedd484d44" exitCode=0
Jul 28 14:00:18.475709 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:18.475622    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" event={"ID":"337f5cea-d9c6-4d1c-b02a-0496f4166925","Type":"ContainerDied","Data":"8508c3ffb4b943c4f83572b00c3bb50cefe968c0f1da4a67e44d2bdedd484d44"}
Jul 28 14:00:18.490189 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:18.490169    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 14:00:18.505287 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:18.505243    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pgvn" podStartSLOduration=6.169883371 podStartE2EDuration="27.505229677s" totalImagesPullingTime="21.335346306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:16.482884428 +0000 UTC m=+25.701686497" watchObservedRunningTime="2026-07-28 14:00:18.505229677 +0000 UTC m=+27.724031736"
Jul 28 14:00:18.505730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:18.505708    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp" podStartSLOduration=8.877697993 podStartE2EDuration="27.505702625s" totalImagesPullingTime="18.628004632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:18.504811309 +0000 UTC m=+27.723613355" watchObservedRunningTime="2026-07-28 14:00:18.505702625 +0000 UTC m=+27.724504671"
Jul 28 14:00:19.337801 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:19.337711    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:19.337972 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:19.337718    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:19.337972 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:19.337833    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:19.337972 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:19.337718    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:19.337972 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:19.337898    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:19.337972 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:19.337961    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:19.478681 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:19.478653    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 14:00:19.493071 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:19.493048    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 14:00:20.152985 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:20.152953    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2hw88"]
Jul 28 14:00:20.153142 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:20.153131    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:20.153265 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:20.153242    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:20.155682 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:20.155647    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j9tl9"]
Jul 28 14:00:20.155863 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:20.155759    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:20.155988 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:20.155892    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:20.156388 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:20.156365    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8wr48"]
Jul 28 14:00:20.156486 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:20.156472    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:20.156600 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:20.156562    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:20.482650 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:20.482563    2571 generic.go:356] "Generic (PLEG): container finished" podID="337f5cea-d9c6-4d1c-b02a-0496f4166925" containerID="3c076326690b4a3ae32c5c716e8a8d9706d86824551b30aeb0d48d68b1f9d545" exitCode=0
Jul 28 14:00:20.483012 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:20.482649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" event={"ID":"337f5cea-d9c6-4d1c-b02a-0496f4166925","Type":"ContainerDied","Data":"3c076326690b4a3ae32c5c716e8a8d9706d86824551b30aeb0d48d68b1f9d545"}
Jul 28 14:00:21.337924 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:21.337733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:21.338076 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:21.338054    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:21.486926 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:21.486897    2571 generic.go:356] "Generic (PLEG): container finished" podID="337f5cea-d9c6-4d1c-b02a-0496f4166925" containerID="e648fd085e695cad09c06aa66c34a88b2182fdfc474046eb7ec358047d1d4418" exitCode=0
Jul 28 14:00:21.487287 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:21.486991    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" event={"ID":"337f5cea-d9c6-4d1c-b02a-0496f4166925","Type":"ContainerDied","Data":"e648fd085e695cad09c06aa66c34a88b2182fdfc474046eb7ec358047d1d4418"}
Jul 28 14:00:22.337311 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:22.337235    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:22.337311 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:22.337288    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:22.337523 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:22.337362    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:22.337523 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:22.337485    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:23.337086 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:23.337056    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:23.337694 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:23.337202    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:24.337673 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:24.337646    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:24.338126 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:24.337651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:24.338126 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:24.337751    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hw88" podUID="2705a3f5-fe74-472f-8de8-f7df5f91210a"
Jul 28 14:00:24.338126 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:24.337834    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9tl9" podUID="a1e1431b-4788-4cbf-8ce2-f88f4a17445c"
Jul 28 14:00:24.915964 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:24.915932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:24.916149 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:24.915976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:24.916149 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:24.916083    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:24.916149 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:24.916144    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs podName:abf3ad4d-a32a-497a-adbe-db944bf11f3e nodeName:}" failed. No retries permitted until 2026-07-28 14:00:56.916128667 +0000 UTC m=+66.134930695 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs") pod "network-metrics-daemon-8wr48" (UID: "abf3ad4d-a32a-497a-adbe-db944bf11f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:24.916327 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:24.916083    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:24.916327 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:24.916219    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret podName:2705a3f5-fe74-472f-8de8-f7df5f91210a nodeName:}" failed. No retries permitted until 2026-07-28 14:00:56.916204912 +0000 UTC m=+66.135006939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret") pod "global-pull-secret-syncer-2hw88" (UID: "2705a3f5-fe74-472f-8de8-f7df5f91210a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:25.016344 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.016301    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:25.016511 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:25.016495    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 14:00:25.016566 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:25.016522    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 14:00:25.016566 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:25.016536    2571 projected.go:196] Error preparing data for projected volume kube-api-access-bwfjs for pod openshift-network-diagnostics/network-check-target-j9tl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:25.016647 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:25.016599    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs podName:a1e1431b-4788-4cbf-8ce2-f88f4a17445c nodeName:}" failed. No retries permitted until 2026-07-28 14:00:57.016580302 +0000 UTC m=+66.235382342 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bwfjs" (UniqueName: "kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs") pod "network-check-target-j9tl9" (UID: "a1e1431b-4788-4cbf-8ce2-f88f4a17445c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:25.337501 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.337468    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:25.337677 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:25.337620    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wr48" podUID="abf3ad4d-a32a-497a-adbe-db944bf11f3e"
Jul 28 14:00:25.637558 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.637478    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-91.ec2.internal" event="NodeReady"
Jul 28 14:00:25.638171 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.637636    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 14:00:25.686005 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.685975    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vq28l"]
Jul 28 14:00:25.722591 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.722539    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z9v4z"]
Jul 28 14:00:25.722759 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.722675    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.725901 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.725879    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 14:00:25.726118 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.726098    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 14:00:25.726219 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.726121    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4vfd5\""
Jul 28 14:00:25.736323 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.736299    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vq28l"]
Jul 28 14:00:25.736421 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.736337    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z9v4z"]
Jul 28 14:00:25.736421 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.736405    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z9v4z"
Jul 28 14:00:25.739162 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.739140    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 14:00:25.739270 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.739140    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 14:00:25.739455 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.739433    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wzr9c\""
Jul 28 14:00:25.739561 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.739508    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 14:00:25.822757 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.822715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-config-volume\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.822757 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.822764    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzbwp\" (UniqueName: \"kubernetes.io/projected/9b6a3082-d979-4da5-8c24-5ecf223b6086-kube-api-access-dzbwp\") pod \"ingress-canary-z9v4z\" (UID: \"9b6a3082-d979-4da5-8c24-5ecf223b6086\") " pod="openshift-ingress-canary/ingress-canary-z9v4z"
Jul 28 14:00:25.822999 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.822873    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.822999 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.822934    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-tmp-dir\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.822999 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.822959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6a3082-d979-4da5-8c24-5ecf223b6086-cert\") pod \"ingress-canary-z9v4z\" (UID: \"9b6a3082-d979-4da5-8c24-5ecf223b6086\") " pod="openshift-ingress-canary/ingress-canary-z9v4z"
Jul 28 14:00:25.822999 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.822980    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxzrx\" (UniqueName: \"kubernetes.io/projected/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-kube-api-access-mxzrx\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.923466 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.923433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxzrx\" (UniqueName: \"kubernetes.io/projected/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-kube-api-access-mxzrx\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.923625 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.923473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-config-volume\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.923625 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.923490    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzbwp\" (UniqueName: \"kubernetes.io/projected/9b6a3082-d979-4da5-8c24-5ecf223b6086-kube-api-access-dzbwp\") pod \"ingress-canary-z9v4z\" (UID: \"9b6a3082-d979-4da5-8c24-5ecf223b6086\") " pod="openshift-ingress-canary/ingress-canary-z9v4z"
Jul 28 14:00:25.923625 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.923574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.923625 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.923603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-tmp-dir\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.923625 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.923626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6a3082-d979-4da5-8c24-5ecf223b6086-cert\") pod \"ingress-canary-z9v4z\" (UID: \"9b6a3082-d979-4da5-8c24-5ecf223b6086\") " pod="openshift-ingress-canary/ingress-canary-z9v4z"
Jul 28 14:00:25.923914 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:25.923705    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:25.923914 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:25.923814    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls podName:fcd66c8a-67e3-4c18-bdb0-dd275f91b520 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:26.423770385 +0000 UTC m=+35.642572424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls") pod "dns-default-vq28l" (UID: "fcd66c8a-67e3-4c18-bdb0-dd275f91b520") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:25.924223 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.924201    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-config-volume\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.927803 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.927770    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6a3082-d979-4da5-8c24-5ecf223b6086-cert\") pod \"ingress-canary-z9v4z\" (UID: \"9b6a3082-d979-4da5-8c24-5ecf223b6086\") " pod="openshift-ingress-canary/ingress-canary-z9v4z"
Jul 28 14:00:25.933170 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.933148    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-tmp-dir\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.935142 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.935118    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxzrx\" (UniqueName: \"kubernetes.io/projected/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-kube-api-access-mxzrx\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:25.935246 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:25.935203    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzbwp\" (UniqueName: \"kubernetes.io/projected/9b6a3082-d979-4da5-8c24-5ecf223b6086-kube-api-access-dzbwp\") pod \"ingress-canary-z9v4z\" (UID: \"9b6a3082-d979-4da5-8c24-5ecf223b6086\") " pod="openshift-ingress-canary/ingress-canary-z9v4z"
Jul 28 14:00:26.045542 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.045504    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z9v4z"
Jul 28 14:00:26.337417 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.337244    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:26.337565 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.337260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:26.340371 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.340348    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 14:00:26.340483 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.340348    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vgxlf\""
Jul 28 14:00:26.340483 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.340348    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 14:00:26.341668 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.341647    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 14:00:26.345652 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.345628    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z9v4z"]
Jul 28 14:00:26.350541 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:00:26.350514    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6a3082_d979_4da5_8c24_5ecf223b6086.slice/crio-a28f880250f69b1550eb206dd3e52fcd163bf7044fff4ddc21951ad289131219 WatchSource:0}: Error finding container a28f880250f69b1550eb206dd3e52fcd163bf7044fff4ddc21951ad289131219: Status 404 returned error can't find the container with id a28f880250f69b1550eb206dd3e52fcd163bf7044fff4ddc21951ad289131219
Jul 28 14:00:26.426487 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.426450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:26.426608 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:26.426588    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:26.426665 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:26.426655    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls podName:fcd66c8a-67e3-4c18-bdb0-dd275f91b520 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:27.426640237 +0000 UTC m=+36.645442260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls") pod "dns-default-vq28l" (UID: "fcd66c8a-67e3-4c18-bdb0-dd275f91b520") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:26.502443 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.502319    2571 generic.go:356] "Generic (PLEG): container finished" podID="337f5cea-d9c6-4d1c-b02a-0496f4166925" containerID="af5f6279471ab564a4ff5894abf2b86279a2bd2ac4d8c6d0852548c3edf2ed76" exitCode=0
Jul 28 14:00:26.502443 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.502403    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" event={"ID":"337f5cea-d9c6-4d1c-b02a-0496f4166925","Type":"ContainerDied","Data":"af5f6279471ab564a4ff5894abf2b86279a2bd2ac4d8c6d0852548c3edf2ed76"}
Jul 28 14:00:26.503523 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:26.503500    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z9v4z" event={"ID":"9b6a3082-d979-4da5-8c24-5ecf223b6086","Type":"ContainerStarted","Data":"a28f880250f69b1550eb206dd3e52fcd163bf7044fff4ddc21951ad289131219"}
Jul 28 14:00:27.337132 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:27.337095    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:27.340214 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:27.340137    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 14:00:27.340214 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:27.340189    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96fnv\""
Jul 28 14:00:27.434895 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:27.434857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:27.435066 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:27.434997    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:27.435066 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:27.435064    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls podName:fcd66c8a-67e3-4c18-bdb0-dd275f91b520 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:29.435044494 +0000 UTC m=+38.653846536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls") pod "dns-default-vq28l" (UID: "fcd66c8a-67e3-4c18-bdb0-dd275f91b520") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:27.510388 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:27.510351    2571 generic.go:356] "Generic (PLEG): container finished" podID="337f5cea-d9c6-4d1c-b02a-0496f4166925" containerID="db2beeaea462feccf9e3da71caf494be4ada95693f4f7a99f465d5d3e32df87c" exitCode=0
Jul 28 14:00:27.510557 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:27.510448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" event={"ID":"337f5cea-d9c6-4d1c-b02a-0496f4166925","Type":"ContainerDied","Data":"db2beeaea462feccf9e3da71caf494be4ada95693f4f7a99f465d5d3e32df87c"}
Jul 28 14:00:28.517092 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:28.516900    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" event={"ID":"337f5cea-d9c6-4d1c-b02a-0496f4166925","Type":"ContainerStarted","Data":"1efceec8336d68b11adb7561690e13db03f8297fbcfcff11329f6b40d169aaa0"}
Jul 28 14:00:28.546180 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:28.546099    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jwqxk" podStartSLOduration=7.488676784 podStartE2EDuration="37.546082367s" totalImagesPullingTime="30.057405583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:28.544376627 +0000 UTC m=+37.763178673" watchObservedRunningTime="2026-07-28 14:00:28.546082367 +0000 UTC m=+37.764884413"
Jul 28 14:00:29.448026 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:29.447993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:29.448205 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:29.448110    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:29.448205 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:29.448165    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls podName:fcd66c8a-67e3-4c18-bdb0-dd275f91b520 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:33.448149324 +0000 UTC m=+42.666951348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls") pod "dns-default-vq28l" (UID: "fcd66c8a-67e3-4c18-bdb0-dd275f91b520") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:29.520670 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:29.520336    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z9v4z" event={"ID":"9b6a3082-d979-4da5-8c24-5ecf223b6086","Type":"ContainerStarted","Data":"bdf196381ff36fd4c680ab0aa94734ff7580b0ad7266d290182ef807c5c5c833"}
Jul 28 14:00:29.538651 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:29.538593    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z9v4z" podStartSLOduration=2.209560151 podStartE2EDuration="4.538576748s" totalImagesPullingTime="2.329016597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:29.538025911 +0000 UTC m=+38.756827970" watchObservedRunningTime="2026-07-28 14:00:29.538576748 +0000 UTC m=+38.757378772"
Jul 28 14:00:29.971991 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:29.971955    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6"]
Jul 28 14:00:29.996308 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:29.996279    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6"]
Jul 28 14:00:29.996434 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:29.996396    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6"
Jul 28 14:00:29.999077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:29.999051    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 14:00:29.999216 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:29.999104    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k4fcl\""
Jul 28 14:00:30.000500 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.000481    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 14:00:30.080501 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.080449    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qhv46"]
Jul 28 14:00:30.104755 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.104728    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qhv46"]
Jul 28 14:00:30.104919 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.104857    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.107652 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.107627    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 14:00:30.107652 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.107651    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7nzk\""
Jul 28 14:00:30.107922 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.107665    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 14:00:30.107922 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.107767    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 14:00:30.107922 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.107917    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 14:00:30.154151 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.154122    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scn5f\" (UniqueName: \"kubernetes.io/projected/da46c89a-a3ab-4549-bc82-3e07d3592c46-kube-api-access-scn5f\") pod \"migrator-6865c9967-9sng6\" (UID: \"da46c89a-a3ab-4549-bc82-3e07d3592c46\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6"
Jul 28 14:00:30.254694 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.254611    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-data-volume\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.254694 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.254652    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.254694 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.254673    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjdz\" (UniqueName: \"kubernetes.io/projected/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-api-access-5rjdz\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.254983 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.254802    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-crio-socket\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.254983 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.254888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scn5f\" (UniqueName: \"kubernetes.io/projected/da46c89a-a3ab-4549-bc82-3e07d3592c46-kube-api-access-scn5f\") pod \"migrator-6865c9967-9sng6\" (UID: \"da46c89a-a3ab-4549-bc82-3e07d3592c46\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6"
Jul 28 14:00:30.254983 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.254934    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.266756 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.266727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scn5f\" (UniqueName: \"kubernetes.io/projected/da46c89a-a3ab-4549-bc82-3e07d3592c46-kube-api-access-scn5f\") pod \"migrator-6865c9967-9sng6\" (UID: \"da46c89a-a3ab-4549-bc82-3e07d3592c46\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6"
Jul 28 14:00:30.308640 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.308608    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6"
Jul 28 14:00:30.355666 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.355637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.355828 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.355676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-data-volume\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.355828 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.355697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.355828 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.355724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjdz\" (UniqueName: \"kubernetes.io/projected/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-api-access-5rjdz\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.355828 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:30.355765    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 14:00:30.356021 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:30.355877    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:30.855855269 +0000 UTC m=+40.074657310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : configmap "kube-rbac-proxy" not found
Jul 28 14:00:30.356021 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.355768    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-crio-socket\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.356021 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:30.355940    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:30.356021 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.355975    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-crio-socket\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.356021 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:30.356000    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:30.855982798 +0000 UTC m=+40.074784842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:30.356190 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.356072    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-data-volume\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.365554 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.365527    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjdz\" (UniqueName: \"kubernetes.io/projected/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-api-access-5rjdz\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.465444 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.465210    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6"]
Jul 28 14:00:30.469108 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:00:30.469074    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda46c89a_a3ab_4549_bc82_3e07d3592c46.slice/crio-1c4cc68f6bb548ab8389158a3e72ff57c442b84eaa81a30ea5a977cacf2277c0 WatchSource:0}: Error finding container 1c4cc68f6bb548ab8389158a3e72ff57c442b84eaa81a30ea5a977cacf2277c0: Status 404 returned error can't find the container with id 1c4cc68f6bb548ab8389158a3e72ff57c442b84eaa81a30ea5a977cacf2277c0
Jul 28 14:00:30.524302 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.524181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6" event={"ID":"da46c89a-a3ab-4549-bc82-3e07d3592c46","Type":"ContainerStarted","Data":"1c4cc68f6bb548ab8389158a3e72ff57c442b84eaa81a30ea5a977cacf2277c0"}
Jul 28 14:00:30.860058 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.859966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.860058 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:30.860009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:30.860283 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:30.860106    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 14:00:30.860283 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:30.860121    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:30.860283 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:30.860175    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:31.860160865 +0000 UTC m=+41.078962890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:30.860283 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:30.860187    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:31.860181146 +0000 UTC m=+41.078983171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : configmap "kube-rbac-proxy" not found
Jul 28 14:00:31.867859 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:31.867823    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:31.867859 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:31.867868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:31.868299 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:31.867962    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 14:00:31.868299 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:31.867992    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:31.868299 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:31.868031    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:33.868013421 +0000 UTC m=+43.086815452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : configmap "kube-rbac-proxy" not found
Jul 28 14:00:31.868299 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:31.868045    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:33.868039574 +0000 UTC m=+43.086841598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:32.530474 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.530444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6" event={"ID":"da46c89a-a3ab-4549-bc82-3e07d3592c46","Type":"ContainerStarted","Data":"df1b26b315d8a69d71c78a4f7dac6f39ccc0070da4ad03a9139be52844339c78"}
Jul 28 14:00:32.849745 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.849720    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mhhcq_c6d067b4-0a52-45ee-b70d-f56724815e25/dns-node-resolver/0.log"
Jul 28 14:00:32.901489 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.901457    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8wb7f"]
Jul 28 14:00:32.938608 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.938577    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8wb7f"]
Jul 28 14:00:32.938760 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.938678    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:32.941776 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.941748    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 14:00:32.943106 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.943081    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 14:00:32.943229 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.943109    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 14:00:32.943229 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.943171    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 14:00:32.943229 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:32.943109    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kp789\""
Jul 28 14:00:33.078161 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.078123    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcfb2\" (UniqueName: \"kubernetes.io/projected/5739038c-1105-42db-9690-0111e2716906-kube-api-access-wcfb2\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.078161 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.078172    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5739038c-1105-42db-9690-0111e2716906-signing-key\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.078367 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.078231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5739038c-1105-42db-9690-0111e2716906-signing-cabundle\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.178888 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.178857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcfb2\" (UniqueName: \"kubernetes.io/projected/5739038c-1105-42db-9690-0111e2716906-kube-api-access-wcfb2\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.179002 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.178899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5739038c-1105-42db-9690-0111e2716906-signing-key\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.179002 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.178930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5739038c-1105-42db-9690-0111e2716906-signing-cabundle\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.179583 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.179554    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5739038c-1105-42db-9690-0111e2716906-signing-cabundle\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.182115 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.182099    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5739038c-1105-42db-9690-0111e2716906-signing-key\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.188032 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.188004    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcfb2\" (UniqueName: \"kubernetes.io/projected/5739038c-1105-42db-9690-0111e2716906-kube-api-access-wcfb2\") pod \"service-ca-658d7b7c78-8wb7f\" (UID: \"5739038c-1105-42db-9690-0111e2716906\") " pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.248288 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.248250    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f"
Jul 28 14:00:33.403666 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.403636    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8wb7f"]
Jul 28 14:00:33.406666 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:00:33.406637    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5739038c_1105_42db_9690_0111e2716906.slice/crio-30d3f8da926076b446f0fa5e313bdcd48f99594590ceb04b699394176b1e03e0 WatchSource:0}: Error finding container 30d3f8da926076b446f0fa5e313bdcd48f99594590ceb04b699394176b1e03e0: Status 404 returned error can't find the container with id 30d3f8da926076b446f0fa5e313bdcd48f99594590ceb04b699394176b1e03e0
Jul 28 14:00:33.481218 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.481123    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:33.481348 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:33.481265    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:33.481348 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:33.481334    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls podName:fcd66c8a-67e3-4c18-bdb0-dd275f91b520 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:41.481318361 +0000 UTC m=+50.700120384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls") pod "dns-default-vq28l" (UID: "fcd66c8a-67e3-4c18-bdb0-dd275f91b520") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:33.534437 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.534406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6" event={"ID":"da46c89a-a3ab-4549-bc82-3e07d3592c46","Type":"ContainerStarted","Data":"ebf54978f5a93d679b84f03d445d04f32e51e888e9dba5f1a55f3289832ad1ba"}
Jul 28 14:00:33.535502 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.535476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f" event={"ID":"5739038c-1105-42db-9690-0111e2716906","Type":"ContainerStarted","Data":"30d3f8da926076b446f0fa5e313bdcd48f99594590ceb04b699394176b1e03e0"}
Jul 28 14:00:33.558672 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.558627    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9sng6" podStartSLOduration=2.692057311 podStartE2EDuration="4.558612286s" totalImagesPullingTime="1.866554975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:33.557906529 +0000 UTC m=+42.776708574" watchObservedRunningTime="2026-07-28 14:00:33.558612286 +0000 UTC m=+42.777414331"
Jul 28 14:00:33.884602 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.884510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:33.884602 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:33.884562    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:33.884818 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:33.884641    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 14:00:33.884818 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:33.884714    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:37.884697599 +0000 UTC m=+47.103499645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : configmap "kube-rbac-proxy" not found
Jul 28 14:00:33.884818 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:33.884729    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:33.884818 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:33.884775    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:37.884763655 +0000 UTC m=+47.103565684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:34.047316 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:34.047290    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s24zx_cf5e24b2-e61d-4833-ad54-2b257498a0a5/node-ca/0.log"
Jul 28 14:00:34.847831 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:34.847804    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z9v4z_9b6a3082-d979-4da5-8c24-5ecf223b6086/serve-healthcheck-canary/0.log"
Jul 28 14:00:35.047570 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:35.047537    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9sng6_da46c89a-a3ab-4549-bc82-3e07d3592c46/migrator/0.log"
Jul 28 14:00:35.247175 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:35.247151    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9sng6_da46c89a-a3ab-4549-bc82-3e07d3592c46/graceful-termination/0.log"
Jul 28 14:00:36.544558 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:36.544462    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f" event={"ID":"5739038c-1105-42db-9690-0111e2716906","Type":"ContainerStarted","Data":"6426254924c6d201c6289748d2eae6a5e3fab8121122c9ee01b1e4347e3e9920"}
Jul 28 14:00:36.564801 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:36.564740    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-8wb7f" podStartSLOduration=1.738611069 podStartE2EDuration="4.564724054s" totalImagesPullingTime="2.826112985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:36.564033404 +0000 UTC m=+45.782835450" watchObservedRunningTime="2026-07-28 14:00:36.564724054 +0000 UTC m=+45.783526129"
Jul 28 14:00:37.918023 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:37.917971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:37.918441 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:37.918098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:37.918441 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:37.918152    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:37.918441 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:00:37.918229    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls podName:dda79aa5-6b8f-4e91-99b5-b88e7560bdb5 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:45.918211754 +0000 UTC m=+55.137013778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qhv46" (UID: "dda79aa5-6b8f-4e91-99b5-b88e7560bdb5") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:37.918594 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:37.918574    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:41.543742 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:41.543700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:41.546063 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:41.546038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd66c8a-67e3-4c18-bdb0-dd275f91b520-metrics-tls\") pod \"dns-default-vq28l\" (UID: \"fcd66c8a-67e3-4c18-bdb0-dd275f91b520\") " pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:41.633017 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:41.632981    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:41.775935 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:41.775898    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vq28l"]
Jul 28 14:00:41.779394 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:00:41.779367    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd66c8a_67e3_4c18_bdb0_dd275f91b520.slice/crio-d93dfc59992497dde4445d0c2040af92baa488e4b2f3c6bdd6b9c839dbf67bdf WatchSource:0}: Error finding container d93dfc59992497dde4445d0c2040af92baa488e4b2f3c6bdd6b9c839dbf67bdf: Status 404 returned error can't find the container with id d93dfc59992497dde4445d0c2040af92baa488e4b2f3c6bdd6b9c839dbf67bdf
Jul 28 14:00:42.560684 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:42.560649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq28l" event={"ID":"fcd66c8a-67e3-4c18-bdb0-dd275f91b520","Type":"ContainerStarted","Data":"d93dfc59992497dde4445d0c2040af92baa488e4b2f3c6bdd6b9c839dbf67bdf"}
Jul 28 14:00:44.568636 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:44.568546    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq28l" event={"ID":"fcd66c8a-67e3-4c18-bdb0-dd275f91b520","Type":"ContainerStarted","Data":"6d1a5f168d86eb0d6fc84668174453bc9134197b6421d0ca7bbb0db9c4cdfef0"}
Jul 28 14:00:44.568636 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:44.568595    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq28l" event={"ID":"fcd66c8a-67e3-4c18-bdb0-dd275f91b520","Type":"ContainerStarted","Data":"d66ffc5dd1732633eef3d8541aa566582b166ed1b278cd6d1179ba733c5920d9"}
Jul 28 14:00:44.568636 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:44.568634    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:44.590222 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:44.590158    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vq28l" podStartSLOduration=17.2101706 podStartE2EDuration="19.590136839s" totalImagesPullingTime="2.379966239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:44.589350256 +0000 UTC m=+53.808152311" watchObservedRunningTime="2026-07-28 14:00:44.590136839 +0000 UTC m=+53.808938887"
Jul 28 14:00:45.977414 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:45.977379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:45.979636 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:45.979615    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dda79aa5-6b8f-4e91-99b5-b88e7560bdb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhv46\" (UID: \"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5\") " pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:46.013865 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:46.013833    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qhv46"
Jul 28 14:00:46.145091 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:46.145057    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qhv46"]
Jul 28 14:00:46.148953 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:00:46.148909    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda79aa5_6b8f_4e91_99b5_b88e7560bdb5.slice/crio-11a5382866b5f4ef7c933b0548f49e085d3337c6f0018f43be887a9b1d7f172a WatchSource:0}: Error finding container 11a5382866b5f4ef7c933b0548f49e085d3337c6f0018f43be887a9b1d7f172a: Status 404 returned error can't find the container with id 11a5382866b5f4ef7c933b0548f49e085d3337c6f0018f43be887a9b1d7f172a
Jul 28 14:00:46.576690 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:46.576655    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhv46" event={"ID":"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5","Type":"ContainerStarted","Data":"11a5382866b5f4ef7c933b0548f49e085d3337c6f0018f43be887a9b1d7f172a"}
Jul 28 14:00:51.497480 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:51.497443    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jz2bp"
Jul 28 14:00:51.593619 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:51.593578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhv46" event={"ID":"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5","Type":"ContainerStarted","Data":"d058ffd8f965817efe4114bad6799698d7818c2abb8da2f6329193578cd8948d"}
Jul 28 14:00:53.777471 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.777434    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"]
Jul 28 14:00:53.788325 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.788296    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"]
Jul 28 14:00:53.788506 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.788450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"
Jul 28 14:00:53.790908 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.790882    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.791204 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.791089    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"]
Jul 28 14:00:53.791989 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.791796    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 14:00:53.793079 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.793023    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 14:00:53.793079 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.793043    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9hfbt\""
Jul 28 14:00:53.793323 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.793023    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 14:00:53.795133 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.795111    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 14:00:53.795233 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.795157    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 14:00:53.795343 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.795323    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 14:00:53.795711 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.795690    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 14:00:53.795915 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.795899    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 14:00:53.801725 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.801705    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"]
Jul 28 14:00:53.838829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.837362    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-hub\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.838829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.837407    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.838829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.837482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/301410e8-2e6b-4387-be29-23b1e67eed73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c578cd554-589mn\" (UID: \"301410e8-2e6b-4387-be29-23b1e67eed73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"
Jul 28 14:00:53.838829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.837511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgkm5\" (UniqueName: \"kubernetes.io/projected/301410e8-2e6b-4387-be29-23b1e67eed73-kube-api-access-fgkm5\") pod \"managed-serviceaccount-addon-agent-7c578cd554-589mn\" (UID: \"301410e8-2e6b-4387-be29-23b1e67eed73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"
Jul 28 14:00:53.838829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.837572    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.838829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.837598    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfabf1fa-f8f7-409a-940e-df660e0ff77e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.838829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.837632    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkzct\" (UniqueName: \"kubernetes.io/projected/bfabf1fa-f8f7-409a-940e-df660e0ff77e-kube-api-access-fkzct\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.838829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.837665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-ca\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.938240 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.938207    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/301410e8-2e6b-4387-be29-23b1e67eed73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c578cd554-589mn\" (UID: \"301410e8-2e6b-4387-be29-23b1e67eed73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"
Jul 28 14:00:53.938240 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.938247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgkm5\" (UniqueName: \"kubernetes.io/projected/301410e8-2e6b-4387-be29-23b1e67eed73-kube-api-access-fgkm5\") pod \"managed-serviceaccount-addon-agent-7c578cd554-589mn\" (UID: \"301410e8-2e6b-4387-be29-23b1e67eed73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"
Jul 28 14:00:53.938464 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.938415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.938464 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.938453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfabf1fa-f8f7-409a-940e-df660e0ff77e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.938615 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.938591    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkzct\" (UniqueName: \"kubernetes.io/projected/bfabf1fa-f8f7-409a-940e-df660e0ff77e-kube-api-access-fkzct\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.938676 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.938648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-ca\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.939442 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.938834    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-hub\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.939442 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.938884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.939442 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.939185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfabf1fa-f8f7-409a-940e-df660e0ff77e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.941568 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.941499    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/301410e8-2e6b-4387-be29-23b1e67eed73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c578cd554-589mn\" (UID: \"301410e8-2e6b-4387-be29-23b1e67eed73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"
Jul 28 14:00:53.941568 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.941515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-hub\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.941739 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.941713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.942525 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.941863    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-ca\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.942525 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.942079    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bfabf1fa-f8f7-409a-940e-df660e0ff77e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:53.949626 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.949600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgkm5\" (UniqueName: \"kubernetes.io/projected/301410e8-2e6b-4387-be29-23b1e67eed73-kube-api-access-fgkm5\") pod \"managed-serviceaccount-addon-agent-7c578cd554-589mn\" (UID: \"301410e8-2e6b-4387-be29-23b1e67eed73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"
Jul 28 14:00:53.949954 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:53.949938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkzct\" (UniqueName: \"kubernetes.io/projected/bfabf1fa-f8f7-409a-940e-df660e0ff77e-kube-api-access-fkzct\") pod \"cluster-proxy-proxy-agent-758dff447d-hgz2f\" (UID: \"bfabf1fa-f8f7-409a-940e-df660e0ff77e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:54.122760 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:54.122675    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"
Jul 28 14:00:54.129148 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:54.129117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"
Jul 28 14:00:54.574479 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:54.574453    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vq28l"
Jul 28 14:00:55.122762 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:55.122725    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn"]
Jul 28 14:00:55.126123 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:00:55.126090    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod301410e8_2e6b_4387_be29_23b1e67eed73.slice/crio-10b6008ff8e1ecc5b5b4717372bd6a5c8e74f755eae3769d2b79c9c75703bebb WatchSource:0}: Error finding container 10b6008ff8e1ecc5b5b4717372bd6a5c8e74f755eae3769d2b79c9c75703bebb: Status 404 returned error can't find the container with id 10b6008ff8e1ecc5b5b4717372bd6a5c8e74f755eae3769d2b79c9c75703bebb
Jul 28 14:00:55.139420 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:55.139396    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f"]
Jul 28 14:00:55.143277 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:00:55.143254    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfabf1fa_f8f7_409a_940e_df660e0ff77e.slice/crio-03186afb7cb2b46dff847b04798d0457bb82fb9f973a9f6c1620fd802363a202 WatchSource:0}: Error finding container 03186afb7cb2b46dff847b04798d0457bb82fb9f973a9f6c1620fd802363a202: Status 404 returned error can't find the container with id 03186afb7cb2b46dff847b04798d0457bb82fb9f973a9f6c1620fd802363a202
Jul 28 14:00:55.609334 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:55.609298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn" event={"ID":"301410e8-2e6b-4387-be29-23b1e67eed73","Type":"ContainerStarted","Data":"10b6008ff8e1ecc5b5b4717372bd6a5c8e74f755eae3769d2b79c9c75703bebb"}
Jul 28 14:00:55.613506 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:55.613473    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhv46" event={"ID":"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5","Type":"ContainerStarted","Data":"ad2a185d87dbe6fe2f6500121279a6c009d6cc8fb8813917dc224fee4244bc15"}
Jul 28 14:00:55.614510 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:55.614490    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f" event={"ID":"bfabf1fa-f8f7-409a-940e-df660e0ff77e","Type":"ContainerStarted","Data":"03186afb7cb2b46dff847b04798d0457bb82fb9f973a9f6c1620fd802363a202"}
Jul 28 14:00:56.966435 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:56.966398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:56.966960 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:56.966457    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:56.970065 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:56.969639    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 14:00:56.970065 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:56.969905    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 14:00:56.982287 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:56.982255    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2705a3f5-fe74-472f-8de8-f7df5f91210a-original-pull-secret\") pod \"global-pull-secret-syncer-2hw88\" (UID: \"2705a3f5-fe74-472f-8de8-f7df5f91210a\") " pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:56.982460 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:56.982260    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf3ad4d-a32a-497a-adbe-db944bf11f3e-metrics-certs\") pod \"network-metrics-daemon-8wr48\" (UID: \"abf3ad4d-a32a-497a-adbe-db944bf11f3e\") " pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:57.051527 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.051491    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96fnv\""
Jul 28 14:00:57.058628 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.058556    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wr48"
Jul 28 14:00:57.067675 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.067283    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:57.071105 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.070880    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 14:00:57.080486 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.080458    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 14:00:57.091305 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.091245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwfjs\" (UniqueName: \"kubernetes.io/projected/a1e1431b-4788-4cbf-8ce2-f88f4a17445c-kube-api-access-bwfjs\") pod \"network-check-target-j9tl9\" (UID: \"a1e1431b-4788-4cbf-8ce2-f88f4a17445c\") " pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:00:57.251226 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.251151    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vgxlf\""
Jul 28 14:00:57.253603 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.253579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hw88"
Jul 28 14:00:57.259077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:00:57.258990    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:01:01.523488 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.523454    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8wr48"]
Jul 28 14:01:01.527180 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:01:01.527146    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf3ad4d_a32a_497a_adbe_db944bf11f3e.slice/crio-4bc058ec514843d6be3239e77b21b42f2d913f8f5588ab081933cb10dc04113c WatchSource:0}: Error finding container 4bc058ec514843d6be3239e77b21b42f2d913f8f5588ab081933cb10dc04113c: Status 404 returned error can't find the container with id 4bc058ec514843d6be3239e77b21b42f2d913f8f5588ab081933cb10dc04113c
Jul 28 14:01:01.534125 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.534098    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2hw88"]
Jul 28 14:01:01.537606 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:01:01.537583    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2705a3f5_fe74_472f_8de8_f7df5f91210a.slice/crio-d008e1c165ecc2548817d057c0ab0013e73521d55eaa082edc352b290d059235 WatchSource:0}: Error finding container d008e1c165ecc2548817d057c0ab0013e73521d55eaa082edc352b290d059235: Status 404 returned error can't find the container with id d008e1c165ecc2548817d057c0ab0013e73521d55eaa082edc352b290d059235
Jul 28 14:01:01.550922 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.550895    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j9tl9"]
Jul 28 14:01:01.554770 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:01:01.554712    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e1431b_4788_4cbf_8ce2_f88f4a17445c.slice/crio-7138b40f8d96dbbf457d105580d717c11aa386fd77e921677190bc9e1bb97cd6 WatchSource:0}: Error finding container 7138b40f8d96dbbf457d105580d717c11aa386fd77e921677190bc9e1bb97cd6: Status 404 returned error can't find the container with id 7138b40f8d96dbbf457d105580d717c11aa386fd77e921677190bc9e1bb97cd6
Jul 28 14:01:01.638122 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.638032    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn" event={"ID":"301410e8-2e6b-4387-be29-23b1e67eed73","Type":"ContainerStarted","Data":"5bc6b13882df1ce5be310fbf071173621d3bf90f95cac5e7def64867cbda9d8f"}
Jul 28 14:01:01.639151 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.639127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j9tl9" event={"ID":"a1e1431b-4788-4cbf-8ce2-f88f4a17445c","Type":"ContainerStarted","Data":"7138b40f8d96dbbf457d105580d717c11aa386fd77e921677190bc9e1bb97cd6"}
Jul 28 14:01:01.641012 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.640992    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhv46" event={"ID":"dda79aa5-6b8f-4e91-99b5-b88e7560bdb5","Type":"ContainerStarted","Data":"2e8be36a80cad6d1978a9c13926e69a84257af57b546cad74c3c1b1ffc00b021"}
Jul 28 14:01:01.643096 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.643076    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f" event={"ID":"bfabf1fa-f8f7-409a-940e-df660e0ff77e","Type":"ContainerStarted","Data":"fc25d8c8cd24ad1abcd3f48e8917bfbf4ec3196bd491efbb795d8bb3276dfe34"}
Jul 28 14:01:01.643179 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.643108    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f" event={"ID":"bfabf1fa-f8f7-409a-940e-df660e0ff77e","Type":"ContainerStarted","Data":"44b46371f39a01134ef2f719eec683e47c5b3f01357a4c202021e41f5510288d"}
Jul 28 14:01:01.643179 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.643126    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f" event={"ID":"bfabf1fa-f8f7-409a-940e-df660e0ff77e","Type":"ContainerStarted","Data":"58b86e6fe85dcc7ba5f0dc282bfe69f7ad0eb04d2ebc11282425b5b718ef9df9"}
Jul 28 14:01:01.644208 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.644187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wr48" event={"ID":"abf3ad4d-a32a-497a-adbe-db944bf11f3e","Type":"ContainerStarted","Data":"4bc058ec514843d6be3239e77b21b42f2d913f8f5588ab081933cb10dc04113c"}
Jul 28 14:01:01.645124 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.645108    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2hw88" event={"ID":"2705a3f5-fe74-472f-8de8-f7df5f91210a","Type":"ContainerStarted","Data":"d008e1c165ecc2548817d057c0ab0013e73521d55eaa082edc352b290d059235"}
Jul 28 14:01:01.655775 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.655733    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c578cd554-589mn" podStartSLOduration=2.43172225 podStartE2EDuration="8.655718605s" totalImagesPullingTime="6.223996355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:01.655155142 +0000 UTC m=+70.873957273" watchObservedRunningTime="2026-07-28 14:01:01.655718605 +0000 UTC m=+70.874520648"
Jul 28 14:01:01.681616 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.681561    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-758dff447d-hgz2f" podStartSLOduration=2.450007909 podStartE2EDuration="8.68154121s" totalImagesPullingTime="6.231533301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:01.680900589 +0000 UTC m=+70.899702646" watchObservedRunningTime="2026-07-28 14:01:01.68154121 +0000 UTC m=+70.900343257"
Jul 28 14:01:01.700097 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:01.700049    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qhv46" podStartSLOduration=16.6312245 podStartE2EDuration="31.700032636s" totalImagesPullingTime="15.068808136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:00:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:01.699308517 +0000 UTC m=+70.918110565" watchObservedRunningTime="2026-07-28 14:01:01.700032636 +0000 UTC m=+70.918834681"
Jul 28 14:01:06.666056 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:06.666021    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j9tl9" event={"ID":"a1e1431b-4788-4cbf-8ce2-f88f4a17445c","Type":"ContainerStarted","Data":"cdda529c33a2ae66b7aa01efb829004cdbd61ee0ddb32c5e63a33782806e356c"}
Jul 28 14:01:06.666524 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:06.666144    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:01:06.667720 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:06.667693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wr48" event={"ID":"abf3ad4d-a32a-497a-adbe-db944bf11f3e","Type":"ContainerStarted","Data":"d121eae43711924515fecf3c5ce1b8c02965f1e2aae34c8c26bc2a5ade92d90e"}
Jul 28 14:01:06.667862 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:06.667745    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wr48" event={"ID":"abf3ad4d-a32a-497a-adbe-db944bf11f3e","Type":"ContainerStarted","Data":"7cea4d45671f46fd980d4c60cf551a8ffe4b815587e2b6c158e9c4f774e3b38a"}
Jul 28 14:01:06.669139 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:06.669118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2hw88" event={"ID":"2705a3f5-fe74-472f-8de8-f7df5f91210a","Type":"ContainerStarted","Data":"b7ba5e5743aad4108a4e2e4dbb03f1b1d31d40fa47149208788517bcab5bf0a9"}
Jul 28 14:01:06.688921 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:06.688870    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j9tl9" podStartSLOduration=71.277042864 podStartE2EDuration="1m15.68885394s" totalImagesPullingTime="4.411811076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:06.68834536 +0000 UTC m=+75.907147407" watchObservedRunningTime="2026-07-28 14:01:06.68885394 +0000 UTC m=+75.907655986"
Jul 28 14:01:06.713764 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:06.713712    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2hw88" podStartSLOduration=71.279106714 podStartE2EDuration="1m15.713690188s" totalImagesPullingTime="4.434583474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:06.712645764 +0000 UTC m=+75.931447812" watchObservedRunningTime="2026-07-28 14:01:06.713690188 +0000 UTC m=+75.932492234"
Jul 28 14:01:06.733855 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:06.733795    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8wr48" podStartSLOduration=73.817630237 podStartE2EDuration="1m15.733758876s" totalImagesPullingTime="1.916128639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:06.732906369 +0000 UTC m=+75.951708415" watchObservedRunningTime="2026-07-28 14:01:06.733758876 +0000 UTC m=+75.952560921"
Jul 28 14:01:13.949404 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.949263    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dqkl9"]
Jul 28 14:01:13.953491 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.953468    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.956288 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.956260    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 14:01:13.956485 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.956464    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 14:01:13.956832 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.956807    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 14:01:13.956832 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.956816    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 14:01:13.957993 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.957975    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nh4t2\""
Jul 28 14:01:13.958080 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.958008    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 14:01:13.958080 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.958019    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 14:01:13.993462 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4297804-de86-4c7b-adfc-e4964186ede8-metrics-client-ca\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.993462 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-tls\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.993667 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993488    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-root\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.993667 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993560    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-sys\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.993667 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-wtmp\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.993667 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.993667 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993656    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-textfile\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.993865 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993676    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg2w9\" (UniqueName: \"kubernetes.io/projected/b4297804-de86-4c7b-adfc-e4964186ede8-kube-api-access-dg2w9\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:13.993865 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:13.993722    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094060 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094026    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-wtmp\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094060 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094313 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094088    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-textfile\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094313 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2w9\" (UniqueName: \"kubernetes.io/projected/b4297804-de86-4c7b-adfc-e4964186ede8-kube-api-access-dg2w9\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094313 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-wtmp\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094313 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094242    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094313 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094286    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4297804-de86-4c7b-adfc-e4964186ede8-metrics-client-ca\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094313 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-tls\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094573 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-root\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094573 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-sys\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094573 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-root\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094573 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094465    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-textfile\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094573 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094469    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4297804-de86-4c7b-adfc-e4964186ede8-sys\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094890 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094869    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4297804-de86-4c7b-adfc-e4964186ede8-metrics-client-ca\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.094962 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.094882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.096500 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.096480    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.096667 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.096649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4297804-de86-4c7b-adfc-e4964186ede8-node-exporter-tls\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.106858 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.106829    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2w9\" (UniqueName: \"kubernetes.io/projected/b4297804-de86-4c7b-adfc-e4964186ede8-kube-api-access-dg2w9\") pod \"node-exporter-dqkl9\" (UID: \"b4297804-de86-4c7b-adfc-e4964186ede8\") " pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.266033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.265941    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dqkl9"
Jul 28 14:01:14.276329 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:01:14.276302    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4297804_de86_4c7b_adfc_e4964186ede8.slice/crio-de4a1961a27c64a88675a9728293a389291bd323a146e711974b8b5d27ca9e28 WatchSource:0}: Error finding container de4a1961a27c64a88675a9728293a389291bd323a146e711974b8b5d27ca9e28: Status 404 returned error can't find the container with id de4a1961a27c64a88675a9728293a389291bd323a146e711974b8b5d27ca9e28
Jul 28 14:01:14.698031 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:14.697992    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqkl9" event={"ID":"b4297804-de86-4c7b-adfc-e4964186ede8","Type":"ContainerStarted","Data":"de4a1961a27c64a88675a9728293a389291bd323a146e711974b8b5d27ca9e28"}
Jul 28 14:01:15.703021 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:15.702983    2571 generic.go:356] "Generic (PLEG): container finished" podID="b4297804-de86-4c7b-adfc-e4964186ede8" containerID="d595d782e1ac862f57c69bacbf85af8727bb4bc17981148061f518494f2b05a3" exitCode=0
Jul 28 14:01:15.703400 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:15.703031    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqkl9" event={"ID":"b4297804-de86-4c7b-adfc-e4964186ede8","Type":"ContainerDied","Data":"d595d782e1ac862f57c69bacbf85af8727bb4bc17981148061f518494f2b05a3"}
Jul 28 14:01:16.708936 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:16.708892    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqkl9" event={"ID":"b4297804-de86-4c7b-adfc-e4964186ede8","Type":"ContainerStarted","Data":"a9f2e77643b063eb75b025e072d3f2bf4a8caa90cc3a760922bcf29e497446e3"}
Jul 28 14:01:16.709332 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:16.709000    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqkl9" event={"ID":"b4297804-de86-4c7b-adfc-e4964186ede8","Type":"ContainerStarted","Data":"85eddd7ff2b1cfbb5262ee6f2b06c0c0e149b8f8bc1ace77fef3e06d715d0d06"}
Jul 28 14:01:16.732147 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:16.732095    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dqkl9" podStartSLOduration=2.704678932 podStartE2EDuration="3.73208032s" totalImagesPullingTime="962.009039ms" totalInitContainerRuntime="65.392349ms" isStatefulPod=true podCreationTimestamp="2026-07-28 14:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:16.730670831 +0000 UTC m=+85.949472878" watchObservedRunningTime="2026-07-28 14:01:16.73208032 +0000 UTC m=+85.950882344"
Jul 28 14:01:37.675483 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:01:37.675453    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j9tl9"
Jul 28 14:04:51.161554 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:04:51.161522    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 14:05:58.623027 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.622951    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"]
Jul 28 14:05:58.624986 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.624968    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"
Jul 28 14:05:58.630582 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.630558    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 14:05:58.645979 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.645952    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-86flx\""
Jul 28 14:05:58.646178 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.646066    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 14:05:58.647183 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.647165    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"]
Jul 28 14:05:58.724485 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.724450    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn65v\" (UniqueName: \"kubernetes.io/projected/ea03b04a-2178-4175-a860-2fec9965c985-kube-api-access-gn65v\") pod \"openshift-lws-operator-fd8ccff4c-cb5zc\" (UID: \"ea03b04a-2178-4175-a860-2fec9965c985\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"
Jul 28 14:05:58.724485 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.724485    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea03b04a-2178-4175-a860-2fec9965c985-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cb5zc\" (UID: \"ea03b04a-2178-4175-a860-2fec9965c985\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"
Jul 28 14:05:58.825146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.825114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn65v\" (UniqueName: \"kubernetes.io/projected/ea03b04a-2178-4175-a860-2fec9965c985-kube-api-access-gn65v\") pod \"openshift-lws-operator-fd8ccff4c-cb5zc\" (UID: \"ea03b04a-2178-4175-a860-2fec9965c985\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"
Jul 28 14:05:58.825292 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.825159    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea03b04a-2178-4175-a860-2fec9965c985-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cb5zc\" (UID: \"ea03b04a-2178-4175-a860-2fec9965c985\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"
Jul 28 14:05:58.825491 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.825476    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea03b04a-2178-4175-a860-2fec9965c985-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cb5zc\" (UID: \"ea03b04a-2178-4175-a860-2fec9965c985\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"
Jul 28 14:05:58.834654 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.834631    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn65v\" (UniqueName: \"kubernetes.io/projected/ea03b04a-2178-4175-a860-2fec9965c985-kube-api-access-gn65v\") pod \"openshift-lws-operator-fd8ccff4c-cb5zc\" (UID: \"ea03b04a-2178-4175-a860-2fec9965c985\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"
Jul 28 14:05:58.933682 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:58.933645    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"
Jul 28 14:05:59.061294 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:59.061265    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc"]
Jul 28 14:05:59.064690 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:05:59.064660    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea03b04a_2178_4175_a860_2fec9965c985.slice/crio-6e8eb2528ebdff3903933d3776817f96106ff6b939721fe938c419a407a021c7 WatchSource:0}: Error finding container 6e8eb2528ebdff3903933d3776817f96106ff6b939721fe938c419a407a021c7: Status 404 returned error can't find the container with id 6e8eb2528ebdff3903933d3776817f96106ff6b939721fe938c419a407a021c7
Jul 28 14:05:59.066136 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:59.066120    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 14:05:59.599117 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:05:59.599077    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc" event={"ID":"ea03b04a-2178-4175-a860-2fec9965c985","Type":"ContainerStarted","Data":"6e8eb2528ebdff3903933d3776817f96106ff6b939721fe938c419a407a021c7"}
Jul 28 14:06:02.610863 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:02.610821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc" event={"ID":"ea03b04a-2178-4175-a860-2fec9965c985","Type":"ContainerStarted","Data":"518ee256c4598754f5eab362e64be4dbefd04cf5d6be86461543b6d31e70bf39"}
Jul 28 14:06:02.630478 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:02.630426    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cb5zc" podStartSLOduration=2.111056753 podStartE2EDuration="4.630408288s" totalImagesPullingTime="2.519351535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:02.629866684 +0000 UTC m=+371.848668729" watchObservedRunningTime="2026-07-28 14:06:02.630408288 +0000 UTC m=+371.849210334"
Jul 28 14:06:21.023826 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.023778    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"]
Jul 28 14:06:21.026823 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.026803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.029913 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.029888    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 14:06:21.030026 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.029938    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 14:06:21.030087 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.030019    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 14:06:21.030087 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.030079    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 14:06:21.030259 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.030243    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fp77x\""
Jul 28 14:06:21.053508 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.053472    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"]
Jul 28 14:06:21.179740 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.179704    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28850903-0c7c-4081-86dc-52a3c2ce3665-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.179740 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.179740    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28850903-0c7c-4081-86dc-52a3c2ce3665-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.179998 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.179777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28850903-0c7c-4081-86dc-52a3c2ce3665-manifests\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.179998 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.179823    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6bvb\" (UniqueName: \"kubernetes.io/projected/28850903-0c7c-4081-86dc-52a3c2ce3665-kube-api-access-x6bvb\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.179998 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.179873    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28850903-0c7c-4081-86dc-52a3c2ce3665-tmp\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.282872 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.281515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28850903-0c7c-4081-86dc-52a3c2ce3665-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.282872 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.281616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28850903-0c7c-4081-86dc-52a3c2ce3665-manifests\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.282872 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.281658    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6bvb\" (UniqueName: \"kubernetes.io/projected/28850903-0c7c-4081-86dc-52a3c2ce3665-kube-api-access-x6bvb\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.282872 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.281703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28850903-0c7c-4081-86dc-52a3c2ce3665-tmp\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.282872 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.281736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28850903-0c7c-4081-86dc-52a3c2ce3665-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.285534 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.284931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28850903-0c7c-4081-86dc-52a3c2ce3665-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.286356 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.286328    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28850903-0c7c-4081-86dc-52a3c2ce3665-manifests\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.287438 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.287414    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28850903-0c7c-4081-86dc-52a3c2ce3665-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.288424 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.288404    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28850903-0c7c-4081-86dc-52a3c2ce3665-tmp\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.296519 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.296497    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6bvb\" (UniqueName: \"kubernetes.io/projected/28850903-0c7c-4081-86dc-52a3c2ce3665-kube-api-access-x6bvb\") pod \"opendatahub-operator-controller-manager-6b59958787-lz997\" (UID: \"28850903-0c7c-4081-86dc-52a3c2ce3665\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.336698 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.336659    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:21.470168 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.470134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"]
Jul 28 14:06:21.474538 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:06:21.474509    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28850903_0c7c_4081_86dc_52a3c2ce3665.slice/crio-02c786e14463ec2e56ba8fa4afc42a62553dbb4023f2f05764ccb3c28be62ab5 WatchSource:0}: Error finding container 02c786e14463ec2e56ba8fa4afc42a62553dbb4023f2f05764ccb3c28be62ab5: Status 404 returned error can't find the container with id 02c786e14463ec2e56ba8fa4afc42a62553dbb4023f2f05764ccb3c28be62ab5
Jul 28 14:06:21.673474 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:21.673446    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997" event={"ID":"28850903-0c7c-4081-86dc-52a3c2ce3665","Type":"ContainerStarted","Data":"02c786e14463ec2e56ba8fa4afc42a62553dbb4023f2f05764ccb3c28be62ab5"}
Jul 28 14:06:25.690116 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:25.690082    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997" event={"ID":"28850903-0c7c-4081-86dc-52a3c2ce3665","Type":"ContainerStarted","Data":"b7f59dca2d1eb85252768c80cffd07495b89ff93ca1a54e843967dced415d3db"}
Jul 28 14:06:26.695445 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:26.695410    2571 generic.go:356] "Generic (PLEG): container finished" podID="28850903-0c7c-4081-86dc-52a3c2ce3665" containerID="b7f59dca2d1eb85252768c80cffd07495b89ff93ca1a54e843967dced415d3db" exitCode=0
Jul 28 14:06:26.695962 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:26.695473    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997" event={"ID":"28850903-0c7c-4081-86dc-52a3c2ce3665","Type":"ContainerDied","Data":"b7f59dca2d1eb85252768c80cffd07495b89ff93ca1a54e843967dced415d3db"}
Jul 28 14:06:27.700853 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:27.700818    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997" event={"ID":"28850903-0c7c-4081-86dc-52a3c2ce3665","Type":"ContainerStarted","Data":"7176e5d6b22d9253668e8464ffdab9451ba22a31283865d68acde36e0fe65e81"}
Jul 28 14:06:27.701240 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:27.700954    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:27.731733 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:27.731682    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997" podStartSLOduration=2.338738782 podStartE2EDuration="7.731664613s" totalImagesPullingTime="4.363436653s" totalInitContainerRuntime="1.029489178s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:27.731004452 +0000 UTC m=+396.949806498" watchObservedRunningTime="2026-07-28 14:06:27.731664613 +0000 UTC m=+396.950466659"
Jul 28 14:06:38.706746 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:38.706707    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-lz997"
Jul 28 14:06:41.512286 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.512250    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-97487846c-g8zs9"]
Jul 28 14:06:41.518998 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.518973    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.524511 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.524488    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 14:06:41.524771 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.524740    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 14:06:41.524878 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.524807    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 14:06:41.528384 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.528365    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 14:06:41.528631 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.528616    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xhjnq\""
Jul 28 14:06:41.543235 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.543213    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-97487846c-g8zs9"]
Jul 28 14:06:41.642285 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.642258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-tls-certs\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.642437 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.642310    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9td46\" (UniqueName: \"kubernetes.io/projected/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-kube-api-access-9td46\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.642437 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.642364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-tmp\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.743116 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.743076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-tls-certs\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.743282 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.743155    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9td46\" (UniqueName: \"kubernetes.io/projected/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-kube-api-access-9td46\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.743282 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.743200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-tmp\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.745467 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.745433    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-tmp\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.745655 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.745637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-tls-certs\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.760431 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.760400    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9td46\" (UniqueName: \"kubernetes.io/projected/2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20-kube-api-access-9td46\") pod \"kube-auth-proxy-97487846c-g8zs9\" (UID: \"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20\") " pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.828208 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.828116    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9"
Jul 28 14:06:41.977903 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:41.977873    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-97487846c-g8zs9"]
Jul 28 14:06:41.989727 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:06:41.989686    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6a00ab_d2ae_4fa7_ac91_8eec04a1cc20.slice/crio-1babd4bc6666f0fe3d018cd951c64e2cdc07a3ee17cf3a8d3b9108486acc4ba1 WatchSource:0}: Error finding container 1babd4bc6666f0fe3d018cd951c64e2cdc07a3ee17cf3a8d3b9108486acc4ba1: Status 404 returned error can't find the container with id 1babd4bc6666f0fe3d018cd951c64e2cdc07a3ee17cf3a8d3b9108486acc4ba1
Jul 28 14:06:42.755610 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:42.755574    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9" event={"ID":"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20","Type":"ContainerStarted","Data":"1babd4bc6666f0fe3d018cd951c64e2cdc07a3ee17cf3a8d3b9108486acc4ba1"}
Jul 28 14:06:44.764912 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:44.764813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9" event={"ID":"2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20","Type":"ContainerStarted","Data":"f7c315b4311fab050cdb0cbe676dbc129fc6c432b18abb746f3e2962a0e7a7de"}
Jul 28 14:06:44.809108 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:44.809034    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-97487846c-g8zs9" podStartSLOduration=1.40377979 podStartE2EDuration="3.80901402s" totalImagesPullingTime="2.40523423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:44.808904661 +0000 UTC m=+414.027706718" watchObservedRunningTime="2026-07-28 14:06:44.80901402 +0000 UTC m=+414.027816069"
Jul 28 14:06:49.361271 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.361233    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"]
Jul 28 14:06:49.363467 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.363451    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.368591 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.368560    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 14:06:49.368591 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.368586    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 14:06:49.368908 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.368890    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c9lb6\""
Jul 28 14:06:49.370025 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.369856    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 14:06:49.370025 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.369868    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 14:06:49.401401 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.401368    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.401401 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.401404    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b2dq\" (UniqueName: \"kubernetes.io/projected/d45895ba-b667-498b-b39b-cceb40e24e6e-kube-api-access-9b2dq\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.401609 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.401426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.401609 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.401457    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.401609 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.401521    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.401609 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.401544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.401609 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.401596    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45895ba-b667-498b-b39b-cceb40e24e6e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.445521 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.445489    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"]
Jul 28 14:06:49.502218 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.502186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.502218 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.502219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b2dq\" (UniqueName: \"kubernetes.io/projected/d45895ba-b667-498b-b39b-cceb40e24e6e-kube-api-access-9b2dq\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.502431 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.502244    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.502431 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.502357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.502431 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.502417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.502559 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.502454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.502559 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.502492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45895ba-b667-498b-b39b-cceb40e24e6e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.503069 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.503044    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.504660 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.504640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.504848 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.504824    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.505099 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.505071    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45895ba-b667-498b-b39b-cceb40e24e6e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.505204 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.505138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.513423 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.513397    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45895ba-b667-498b-b39b-cceb40e24e6e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.519215 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.519192    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b2dq\" (UniqueName: \"kubernetes.io/projected/d45895ba-b667-498b-b39b-cceb40e24e6e-kube-api-access-9b2dq\") pod \"istiod-openshift-gateway-5677ccb49b-xlpwg\" (UID: \"d45895ba-b667-498b-b39b-cceb40e24e6e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.672771 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.672737    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:49.817543 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:49.817506    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"]
Jul 28 14:06:49.821494 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:06:49.821460    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45895ba_b667_498b_b39b_cceb40e24e6e.slice/crio-c6f8ba146c3409298b50f14672b1252d32da4af2b817a9c72af1bef3c0e16ce3 WatchSource:0}: Error finding container c6f8ba146c3409298b50f14672b1252d32da4af2b817a9c72af1bef3c0e16ce3: Status 404 returned error can't find the container with id c6f8ba146c3409298b50f14672b1252d32da4af2b817a9c72af1bef3c0e16ce3
Jul 28 14:06:50.788854 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:50.788816    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg" event={"ID":"d45895ba-b667-498b-b39b-cceb40e24e6e","Type":"ContainerStarted","Data":"c6f8ba146c3409298b50f14672b1252d32da4af2b817a9c72af1bef3c0e16ce3"}
Jul 28 14:06:52.196335 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:52.196291    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:06:52.196643 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:52.196365    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:06:52.799504 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:52.799464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg" event={"ID":"d45895ba-b667-498b-b39b-cceb40e24e6e","Type":"ContainerStarted","Data":"29ed70e850f92558a1ad3c7c060b3dd017285e19b0f552a9b61c0c35965a84a2"}
Jul 28 14:06:52.799737 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:52.799567    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:52.839805 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:52.839699    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg" podStartSLOduration=1.467048884 podStartE2EDuration="3.839676808s" totalImagesPullingTime="2.372627924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:52.835827096 +0000 UTC m=+422.054629143" watchObservedRunningTime="2026-07-28 14:06:52.839676808 +0000 UTC m=+422.058478838"
Jul 28 14:06:53.114691 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.114607    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"]
Jul 28 14:06:53.118165 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.118146    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:53.122262 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.122238    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5r785\""
Jul 28 14:06:53.122393 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.122336    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 28 14:06:53.132993 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.132966    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskhj\" (UniqueName: \"kubernetes.io/projected/75766632-1611-4c34-bfa4-f069566c8237-kube-api-access-bskhj\") pod \"kserve-controller-manager-d6f4b65b8-x2bfd\" (UID: \"75766632-1611-4c34-bfa4-f069566c8237\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:53.133149 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.133014    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75766632-1611-4c34-bfa4-f069566c8237-cert\") pod \"kserve-controller-manager-d6f4b65b8-x2bfd\" (UID: \"75766632-1611-4c34-bfa4-f069566c8237\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:53.140867 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.140843    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"]
Jul 28 14:06:53.233691 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.233649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75766632-1611-4c34-bfa4-f069566c8237-cert\") pod \"kserve-controller-manager-d6f4b65b8-x2bfd\" (UID: \"75766632-1611-4c34-bfa4-f069566c8237\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:53.234113 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.233722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskhj\" (UniqueName: \"kubernetes.io/projected/75766632-1611-4c34-bfa4-f069566c8237-kube-api-access-bskhj\") pod \"kserve-controller-manager-d6f4b65b8-x2bfd\" (UID: \"75766632-1611-4c34-bfa4-f069566c8237\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:53.236073 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.236055    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75766632-1611-4c34-bfa4-f069566c8237-cert\") pod \"kserve-controller-manager-d6f4b65b8-x2bfd\" (UID: \"75766632-1611-4c34-bfa4-f069566c8237\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:53.245581 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.245552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskhj\" (UniqueName: \"kubernetes.io/projected/75766632-1611-4c34-bfa4-f069566c8237-kube-api-access-bskhj\") pod \"kserve-controller-manager-d6f4b65b8-x2bfd\" (UID: \"75766632-1611-4c34-bfa4-f069566c8237\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:53.428299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.428260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:53.565215 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.565181    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"]
Jul 28 14:06:53.568851 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:06:53.568818    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75766632_1611_4c34_bfa4_f069566c8237.slice/crio-b4c08e51159d9597512b6852dc878e966099446e139e559570d224a3991d9d49 WatchSource:0}: Error finding container b4c08e51159d9597512b6852dc878e966099446e139e559570d224a3991d9d49: Status 404 returned error can't find the container with id b4c08e51159d9597512b6852dc878e966099446e139e559570d224a3991d9d49
Jul 28 14:06:53.804431 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.804328    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd" event={"ID":"75766632-1611-4c34-bfa4-f069566c8237","Type":"ContainerStarted","Data":"b4c08e51159d9597512b6852dc878e966099446e139e559570d224a3991d9d49"}
Jul 28 14:06:53.806220 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:53.806196    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xlpwg"
Jul 28 14:06:56.822594 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:56.822554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd" event={"ID":"75766632-1611-4c34-bfa4-f069566c8237","Type":"ContainerStarted","Data":"313d323b38569fd0198dc2cb9bd75d1ae5053268e1f1bd063f2fa9c609bcf05d"}
Jul 28 14:06:56.823090 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:56.822684    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:06:56.844902 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:06:56.844847    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd" podStartSLOduration=1.6246729069999999 podStartE2EDuration="3.844826895s" totalImagesPullingTime="2.220153988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:56.842884484 +0000 UTC m=+426.061686531" watchObservedRunningTime="2026-07-28 14:06:56.844826895 +0000 UTC m=+426.063628942"
Jul 28 14:07:27.831538 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:27.831503    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x2bfd"
Jul 28 14:07:42.360655 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.360617    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7jfhw"]
Jul 28 14:07:42.370543 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.370516    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw"
Jul 28 14:07:42.375293 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.375270    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-nvrz6\""
Jul 28 14:07:42.376607 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.376588    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 14:07:42.376679 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.376590    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 14:07:42.381939 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.381912    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7jfhw"]
Jul 28 14:07:42.527891 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.527852    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j5bq\" (UniqueName: \"kubernetes.io/projected/3be17ae7-17ac-4e5d-8313-15ab07bf48e5-kube-api-access-9j5bq\") pod \"kuadrant-operator-catalog-7jfhw\" (UID: \"3be17ae7-17ac-4e5d-8313-15ab07bf48e5\") " pod="kuadrant-system/kuadrant-operator-catalog-7jfhw"
Jul 28 14:07:42.629258 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.629162    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j5bq\" (UniqueName: \"kubernetes.io/projected/3be17ae7-17ac-4e5d-8313-15ab07bf48e5-kube-api-access-9j5bq\") pod \"kuadrant-operator-catalog-7jfhw\" (UID: \"3be17ae7-17ac-4e5d-8313-15ab07bf48e5\") " pod="kuadrant-system/kuadrant-operator-catalog-7jfhw"
Jul 28 14:07:42.642064 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.642030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j5bq\" (UniqueName: \"kubernetes.io/projected/3be17ae7-17ac-4e5d-8313-15ab07bf48e5-kube-api-access-9j5bq\") pod \"kuadrant-operator-catalog-7jfhw\" (UID: \"3be17ae7-17ac-4e5d-8313-15ab07bf48e5\") " pod="kuadrant-system/kuadrant-operator-catalog-7jfhw"
Jul 28 14:07:42.682674 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.682633    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw"
Jul 28 14:07:42.705096 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.705066    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7jfhw"]
Jul 28 14:07:42.817575 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.817513    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7jfhw"]
Jul 28 14:07:42.822125 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:07:42.822094    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be17ae7_17ac_4e5d_8313_15ab07bf48e5.slice/crio-68e782b8d49cbbd88ebc2665882a62421f43aa90e4087d9ac00d6ea9c362c42a WatchSource:0}: Error finding container 68e782b8d49cbbd88ebc2665882a62421f43aa90e4087d9ac00d6ea9c362c42a: Status 404 returned error can't find the container with id 68e782b8d49cbbd88ebc2665882a62421f43aa90e4087d9ac00d6ea9c362c42a
Jul 28 14:07:42.997424 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:42.997390    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw" event={"ID":"3be17ae7-17ac-4e5d-8313-15ab07bf48e5","Type":"ContainerStarted","Data":"68e782b8d49cbbd88ebc2665882a62421f43aa90e4087d9ac00d6ea9c362c42a"}
Jul 28 14:07:46.011947 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:46.011907    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw" event={"ID":"3be17ae7-17ac-4e5d-8313-15ab07bf48e5","Type":"ContainerStarted","Data":"aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3"}
Jul 28 14:07:46.012408 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:46.012020    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw" podUID="3be17ae7-17ac-4e5d-8313-15ab07bf48e5" containerName="registry-server" containerID="cri-o://aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3" gracePeriod=2
Jul 28 14:07:46.032165 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:46.032122    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw" podStartSLOduration=1.809285144 podStartE2EDuration="4.032106933s" totalImagesPullingTime="2.222821789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:07:46.03096444 +0000 UTC m=+475.249766488" watchObservedRunningTime="2026-07-28 14:07:46.032106933 +0000 UTC m=+475.250908978"
Jul 28 14:07:46.252958 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:46.252929    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw"
Jul 28 14:07:46.361695 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:46.361612    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j5bq\" (UniqueName: \"kubernetes.io/projected/3be17ae7-17ac-4e5d-8313-15ab07bf48e5-kube-api-access-9j5bq\") pod \"3be17ae7-17ac-4e5d-8313-15ab07bf48e5\" (UID: \"3be17ae7-17ac-4e5d-8313-15ab07bf48e5\") "
Jul 28 14:07:46.363745 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:46.363723    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be17ae7-17ac-4e5d-8313-15ab07bf48e5-kube-api-access-9j5bq" (OuterVolumeSpecName: "kube-api-access-9j5bq") pod "3be17ae7-17ac-4e5d-8313-15ab07bf48e5" (UID: "3be17ae7-17ac-4e5d-8313-15ab07bf48e5"). InnerVolumeSpecName "kube-api-access-9j5bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:07:46.463070 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:46.463030    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j5bq\" (UniqueName: \"kubernetes.io/projected/3be17ae7-17ac-4e5d-8313-15ab07bf48e5-kube-api-access-9j5bq\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:07:47.016654 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.016620    2571 generic.go:356] "Generic (PLEG): container finished" podID="3be17ae7-17ac-4e5d-8313-15ab07bf48e5" containerID="aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3" exitCode=0
Jul 28 14:07:47.017140 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.016666    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw"
Jul 28 14:07:47.017140 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.016669    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw" event={"ID":"3be17ae7-17ac-4e5d-8313-15ab07bf48e5","Type":"ContainerDied","Data":"aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3"}
Jul 28 14:07:47.017140 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.016708    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7jfhw" event={"ID":"3be17ae7-17ac-4e5d-8313-15ab07bf48e5","Type":"ContainerDied","Data":"68e782b8d49cbbd88ebc2665882a62421f43aa90e4087d9ac00d6ea9c362c42a"}
Jul 28 14:07:47.017140 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.016727    2571 scope.go:117] "RemoveContainer" containerID="aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3"
Jul 28 14:07:47.025315 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.025298    2571 scope.go:117] "RemoveContainer" containerID="aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3"
Jul 28 14:07:47.025600 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:07:47.025580    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3\": container with ID starting with aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3 not found: ID does not exist" containerID="aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3"
Jul 28 14:07:47.025683 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.025614    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3"} err="failed to get container status \"aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3\": rpc error: code = NotFound desc = could not find container \"aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3\": container with ID starting with aad8a3bcc3fab407d21442f2045c33cce2518a6d03ab19f26109aa960ff7cfb3 not found: ID does not exist"
Jul 28 14:07:47.045081 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.045050    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7jfhw"]
Jul 28 14:07:47.048797 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.048763    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7jfhw"]
Jul 28 14:07:47.341737 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:07:47.341658    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3be17ae7-17ac-4e5d-8313-15ab07bf48e5" path="/var/lib/kubelet/pods/3be17ae7-17ac-4e5d-8313-15ab07bf48e5/volumes"
Jul 28 14:08:09.922670 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.922633    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"]
Jul 28 14:08:09.923149 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.922907    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be17ae7-17ac-4e5d-8313-15ab07bf48e5" containerName="registry-server"
Jul 28 14:08:09.923149 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.922920    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be17ae7-17ac-4e5d-8313-15ab07bf48e5" containerName="registry-server"
Jul 28 14:08:09.923149 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.922969    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3be17ae7-17ac-4e5d-8313-15ab07bf48e5" containerName="registry-server"
Jul 28 14:08:09.929600 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.929584    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"
Jul 28 14:08:09.933617 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.933596    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 14:08:09.933746 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.933596    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tx868\""
Jul 28 14:08:09.934864 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.934847    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 14:08:09.940468 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:09.940440    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"]
Jul 28 14:08:10.037583 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:10.037546    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dhjg\" (UniqueName: \"kubernetes.io/projected/8ac63aec-198d-4faf-92d9-dc1923e627bd-kube-api-access-7dhjg\") pod \"authorino-operator-75cc8d5cb7-bp7wl\" (UID: \"8ac63aec-198d-4faf-92d9-dc1923e627bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"
Jul 28 14:08:10.138518 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:10.138473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dhjg\" (UniqueName: \"kubernetes.io/projected/8ac63aec-198d-4faf-92d9-dc1923e627bd-kube-api-access-7dhjg\") pod \"authorino-operator-75cc8d5cb7-bp7wl\" (UID: \"8ac63aec-198d-4faf-92d9-dc1923e627bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"
Jul 28 14:08:10.150511 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:10.150488    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dhjg\" (UniqueName: \"kubernetes.io/projected/8ac63aec-198d-4faf-92d9-dc1923e627bd-kube-api-access-7dhjg\") pod \"authorino-operator-75cc8d5cb7-bp7wl\" (UID: \"8ac63aec-198d-4faf-92d9-dc1923e627bd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"
Jul 28 14:08:10.239198 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:10.239104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"
Jul 28 14:08:10.378515 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:10.378483    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"]
Jul 28 14:08:10.382219 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:08:10.382190    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac63aec_198d_4faf_92d9_dc1923e627bd.slice/crio-041ce90bf165a16d993b79c2d9a506416679a3b9a372bf913c736c346d73c1c5 WatchSource:0}: Error finding container 041ce90bf165a16d993b79c2d9a506416679a3b9a372bf913c736c346d73c1c5: Status 404 returned error can't find the container with id 041ce90bf165a16d993b79c2d9a506416679a3b9a372bf913c736c346d73c1c5
Jul 28 14:08:11.110235 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:11.110198    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl" event={"ID":"8ac63aec-198d-4faf-92d9-dc1923e627bd","Type":"ContainerStarted","Data":"041ce90bf165a16d993b79c2d9a506416679a3b9a372bf913c736c346d73c1c5"}
Jul 28 14:08:13.119963 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:13.119930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl" event={"ID":"8ac63aec-198d-4faf-92d9-dc1923e627bd","Type":"ContainerStarted","Data":"f904a7d3e1ead310e0dfff55a459b1a4d518ceaf46aa9930f3158df1ce6960cd"}
Jul 28 14:08:13.120336 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:13.120073    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"
Jul 28 14:08:13.161184 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:13.161036    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl" podStartSLOduration=1.644979426 podStartE2EDuration="4.16101823s" totalImagesPullingTime="2.516038804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:13.159896037 +0000 UTC m=+502.378698086" watchObservedRunningTime="2026-07-28 14:08:13.16101823 +0000 UTC m=+502.379820270"
Jul 28 14:08:20.164997 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.164964    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"]
Jul 28 14:08:20.168766 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.168736    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:20.172367 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.172341    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mv7mq\""
Jul 28 14:08:20.190877 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.190847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"]
Jul 28 14:08:20.212918 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.212884    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86df42ae-f61e-4d52-adc4-139f2c791665-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" (UID: \"86df42ae-f61e-4d52-adc4-139f2c791665\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:20.212918 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.212921    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvrg\" (UniqueName: \"kubernetes.io/projected/86df42ae-f61e-4d52-adc4-139f2c791665-kube-api-access-gvvrg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" (UID: \"86df42ae-f61e-4d52-adc4-139f2c791665\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:20.314273 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.314232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86df42ae-f61e-4d52-adc4-139f2c791665-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" (UID: \"86df42ae-f61e-4d52-adc4-139f2c791665\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:20.314273 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.314272    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvrg\" (UniqueName: \"kubernetes.io/projected/86df42ae-f61e-4d52-adc4-139f2c791665-kube-api-access-gvvrg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" (UID: \"86df42ae-f61e-4d52-adc4-139f2c791665\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:20.314631 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.314613    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86df42ae-f61e-4d52-adc4-139f2c791665-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" (UID: \"86df42ae-f61e-4d52-adc4-139f2c791665\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:20.326544 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.326508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvrg\" (UniqueName: \"kubernetes.io/projected/86df42ae-f61e-4d52-adc4-139f2c791665-kube-api-access-gvvrg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" (UID: \"86df42ae-f61e-4d52-adc4-139f2c791665\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:20.478730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.478644    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:20.627461 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:20.627437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"]
Jul 28 14:08:20.630304 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:08:20.630277    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86df42ae_f61e_4d52_adc4_139f2c791665.slice/crio-e5cb45568bf8cb2094592912855b82c0c19d4775a694a9b5120faf51e3511eb3 WatchSource:0}: Error finding container e5cb45568bf8cb2094592912855b82c0c19d4775a694a9b5120faf51e3511eb3: Status 404 returned error can't find the container with id e5cb45568bf8cb2094592912855b82c0c19d4775a694a9b5120faf51e3511eb3
Jul 28 14:08:21.151941 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:21.151910    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg" event={"ID":"86df42ae-f61e-4d52-adc4-139f2c791665","Type":"ContainerStarted","Data":"e5cb45568bf8cb2094592912855b82c0c19d4775a694a9b5120faf51e3511eb3"}
Jul 28 14:08:24.126424 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:24.126390    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bp7wl"
Jul 28 14:08:27.177868 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:27.177835    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg" event={"ID":"86df42ae-f61e-4d52-adc4-139f2c791665","Type":"ContainerStarted","Data":"cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078"}
Jul 28 14:08:27.178261 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:27.178002    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:27.205767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:27.205705    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg" podStartSLOduration=1.017508291 podStartE2EDuration="7.205683681s" totalImagesPullingTime="6.18817539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:27.203716158 +0000 UTC m=+516.422518203" watchObservedRunningTime="2026-07-28 14:08:27.205683681 +0000 UTC m=+516.424485729"
Jul 28 14:08:38.184478 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:38.184443    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:39.495805 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.495751    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"]
Jul 28 14:08:39.498960 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.498942    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:39.521159 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.521129    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"]
Jul 28 14:08:39.564443 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.564400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbz4g\" (UniqueName: \"kubernetes.io/projected/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-kube-api-access-zbz4g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" (UID: \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:39.564630 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.564607    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" (UID: \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:39.636708 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.636675    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"]
Jul 28 14:08:39.636948 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:39.636927    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-zbz4g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl" podUID="cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb"
Jul 28 14:08:39.665730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.665698    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbz4g\" (UniqueName: \"kubernetes.io/projected/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-kube-api-access-zbz4g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" (UID: \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:39.665862 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.665825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" (UID: \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:39.666169 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.666150    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" (UID: \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:39.686676 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:39.686641    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbz4g\" (UniqueName: \"kubernetes.io/projected/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-kube-api-access-zbz4g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" (UID: \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:40.227728 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.227697    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:40.234557 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.234533    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:40.263163 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.263126    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"]
Jul 28 14:08:40.275211 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:40.275175    2571 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\": pods \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:40.279896 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.279869    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"]
Jul 28 14:08:40.293653 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.293624    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"]
Jul 28 14:08:40.293926 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.293894    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" containerName="manager" containerID="cri-o://cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078" gracePeriod=2
Jul 28 14:08:40.295670 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.295646    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"]
Jul 28 14:08:40.298132 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:40.298104    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:40.298722 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.298706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:40.307066 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.307040    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"]
Jul 28 14:08:40.314590 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:40.314554    2571 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"86df42ae-f61e-4d52-adc4-139f2c791665\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-627xg\": pods \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:40.315319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.315242    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"]
Jul 28 14:08:40.348202 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:40.347939    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:40.353721 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:40.353673    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:40.369515 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.369480    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-extensions-socket-volume\") pod \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\" (UID: \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\") "
Jul 28 14:08:40.369674 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.369531    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbz4g\" (UniqueName: \"kubernetes.io/projected/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-kube-api-access-zbz4g\") pod \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\" (UID: \"cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb\") "
Jul 28 14:08:40.369738 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.369677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5ch\" (UniqueName: \"kubernetes.io/projected/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-kube-api-access-jw5ch\") pod \"kuadrant-operator-controller-manager-55467d9f7-szm9d\" (UID: \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:40.369738 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.369716    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-szm9d\" (UID: \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:40.369865 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.369755    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" (UID: "cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:08:40.369915 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.369870    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-extensions-socket-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:08:40.372042 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.372016    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-kube-api-access-zbz4g" (OuterVolumeSpecName: "kube-api-access-zbz4g") pod "cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" (UID: "cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb"). InnerVolumeSpecName "kube-api-access-zbz4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:08:40.471311 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.471275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5ch\" (UniqueName: \"kubernetes.io/projected/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-kube-api-access-jw5ch\") pod \"kuadrant-operator-controller-manager-55467d9f7-szm9d\" (UID: \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:40.471465 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.471352    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-szm9d\" (UID: \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:40.471465 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.471454    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbz4g\" (UniqueName: \"kubernetes.io/projected/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb-kube-api-access-zbz4g\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:08:40.472072 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.472047    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-szm9d\" (UID: \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:40.482132 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.482062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5ch\" (UniqueName: \"kubernetes.io/projected/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-kube-api-access-jw5ch\") pod \"kuadrant-operator-controller-manager-55467d9f7-szm9d\" (UID: \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:40.532591 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.532566    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:40.535685 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:40.535661    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:40.538935 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:40.538914    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:40.616447 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.616407    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:40.673287 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.673254    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86df42ae-f61e-4d52-adc4-139f2c791665-extensions-socket-volume\") pod \"86df42ae-f61e-4d52-adc4-139f2c791665\" (UID: \"86df42ae-f61e-4d52-adc4-139f2c791665\") "
Jul 28 14:08:40.673469 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.673308    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvvrg\" (UniqueName: \"kubernetes.io/projected/86df42ae-f61e-4d52-adc4-139f2c791665-kube-api-access-gvvrg\") pod \"86df42ae-f61e-4d52-adc4-139f2c791665\" (UID: \"86df42ae-f61e-4d52-adc4-139f2c791665\") "
Jul 28 14:08:40.673914 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.673881    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86df42ae-f61e-4d52-adc4-139f2c791665-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "86df42ae-f61e-4d52-adc4-139f2c791665" (UID: "86df42ae-f61e-4d52-adc4-139f2c791665"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:08:40.676472 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.676441    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86df42ae-f61e-4d52-adc4-139f2c791665-kube-api-access-gvvrg" (OuterVolumeSpecName: "kube-api-access-gvvrg") pod "86df42ae-f61e-4d52-adc4-139f2c791665" (UID: "86df42ae-f61e-4d52-adc4-139f2c791665"). InnerVolumeSpecName "kube-api-access-gvvrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:08:40.753324 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.753300    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"]
Jul 28 14:08:40.755945 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:08:40.755917    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49f4be5_5668_4e97_9d3e_6f9dc83d169e.slice/crio-38c561cf74e45f23f0a428adfd011f53c1eb3022ce9f23cb556f90100d61c9c3 WatchSource:0}: Error finding container 38c561cf74e45f23f0a428adfd011f53c1eb3022ce9f23cb556f90100d61c9c3: Status 404 returned error can't find the container with id 38c561cf74e45f23f0a428adfd011f53c1eb3022ce9f23cb556f90100d61c9c3
Jul 28 14:08:40.774297 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.774277    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86df42ae-f61e-4d52-adc4-139f2c791665-extensions-socket-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:08:40.774386 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:40.774299    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvvrg\" (UniqueName: \"kubernetes.io/projected/86df42ae-f61e-4d52-adc4-139f2c791665-kube-api-access-gvvrg\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:08:41.233860 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.233829    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d" event={"ID":"f49f4be5-5668-4e97-9d3e-6f9dc83d169e","Type":"ContainerStarted","Data":"dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60"}
Jul 28 14:08:41.233860 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.233878    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d" event={"ID":"f49f4be5-5668-4e97-9d3e-6f9dc83d169e","Type":"ContainerStarted","Data":"38c561cf74e45f23f0a428adfd011f53c1eb3022ce9f23cb556f90100d61c9c3"}
Jul 28 14:08:41.234182 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.233922    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:08:41.235134 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.235110    2571 generic.go:356] "Generic (PLEG): container finished" podID="86df42ae-f61e-4d52-adc4-139f2c791665" containerID="cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078" exitCode=0
Jul 28 14:08:41.235223 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.235147    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:41.235223 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.235197    2571 scope.go:117] "RemoveContainer" containerID="cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078"
Jul 28 14:08:41.235355 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.235340    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:41.236495 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:41.236472    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:41.243493 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.243472    2571 scope.go:117] "RemoveContainer" containerID="cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078"
Jul 28 14:08:41.244011 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:41.243773    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078\": container with ID starting with cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078 not found: ID does not exist" containerID="cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078"
Jul 28 14:08:41.244011 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.243832    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078"} err="failed to get container status \"cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078\": rpc error: code = NotFound desc = could not find container \"cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078\": container with ID starting with cf205b6809c0825e0d0c7ccd799921143141ec86bcba28b2f880f3c2ea521078 not found: ID does not exist"
Jul 28 14:08:41.264761 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.264709    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d" podStartSLOduration=1.264693559 podStartE2EDuration="1.264693559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:41.263671292 +0000 UTC m=+530.482473362" watchObservedRunningTime="2026-07-28 14:08:41.264693559 +0000 UTC m=+530.483495660"
Jul 28 14:08:41.266066 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:41.266042    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:41.268129 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:41.268100    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:41.270242 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:41.270218    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:41.341658 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:41.341621    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-72xcl\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-72xcl"
Jul 28 14:08:41.342612 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.342588    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" path="/var/lib/kubelet/pods/86df42ae-f61e-4d52-adc4-139f2c791665/volumes"
Jul 28 14:08:41.343003 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:41.342986    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb" path="/var/lib/kubelet/pods/cc6c7fe8-6dd8-4cba-a5b0-d848115b07bb/volumes"
Jul 28 14:08:41.344083 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:08:41.344065    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-627xg\" is forbidden: User \"system:node:ip-10-0-137-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-91.ec2.internal' and this object" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-627xg"
Jul 28 14:08:52.243232 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:08:52.243202    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:09:04.681063 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:04.681024    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"]
Jul 28 14:09:04.681471 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:04.681215    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d" podUID="f49f4be5-5668-4e97-9d3e-6f9dc83d169e" containerName="manager" containerID="cri-o://dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60" gracePeriod=10
Jul 28 14:09:04.936089 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:04.936023    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:09:05.061806 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.061751    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-extensions-socket-volume\") pod \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\" (UID: \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\") "
Jul 28 14:09:05.061971 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.061881    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw5ch\" (UniqueName: \"kubernetes.io/projected/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-kube-api-access-jw5ch\") pod \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\" (UID: \"f49f4be5-5668-4e97-9d3e-6f9dc83d169e\") "
Jul 28 14:09:05.062140 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.062117    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f49f4be5-5668-4e97-9d3e-6f9dc83d169e" (UID: "f49f4be5-5668-4e97-9d3e-6f9dc83d169e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:09:05.063815 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.063795    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-kube-api-access-jw5ch" (OuterVolumeSpecName: "kube-api-access-jw5ch") pod "f49f4be5-5668-4e97-9d3e-6f9dc83d169e" (UID: "f49f4be5-5668-4e97-9d3e-6f9dc83d169e"). InnerVolumeSpecName "kube-api-access-jw5ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:09:05.162588 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.162542    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw5ch\" (UniqueName: \"kubernetes.io/projected/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-kube-api-access-jw5ch\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:09:05.162588 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.162584    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49f4be5-5668-4e97-9d3e-6f9dc83d169e-extensions-socket-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:09:05.329259 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.329171    2571 generic.go:356] "Generic (PLEG): container finished" podID="f49f4be5-5668-4e97-9d3e-6f9dc83d169e" containerID="dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60" exitCode=0
Jul 28 14:09:05.329259 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.329219    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"
Jul 28 14:09:05.329491 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.329262    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d" event={"ID":"f49f4be5-5668-4e97-9d3e-6f9dc83d169e","Type":"ContainerDied","Data":"dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60"}
Jul 28 14:09:05.329491 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.329321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d" event={"ID":"f49f4be5-5668-4e97-9d3e-6f9dc83d169e","Type":"ContainerDied","Data":"38c561cf74e45f23f0a428adfd011f53c1eb3022ce9f23cb556f90100d61c9c3"}
Jul 28 14:09:05.329491 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.329349    2571 scope.go:117] "RemoveContainer" containerID="dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60"
Jul 28 14:09:05.338123 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.338103    2571 scope.go:117] "RemoveContainer" containerID="dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60"
Jul 28 14:09:05.338370 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:09:05.338352    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60\": container with ID starting with dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60 not found: ID does not exist" containerID="dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60"
Jul 28 14:09:05.338435 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.338383    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60"} err="failed to get container status \"dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60\": rpc error: code = NotFound desc = could not find container \"dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60\": container with ID starting with dc0a984cb09b415ea75be4ec12e2e7bef611669fb066bb16216b719998d4de60 not found: ID does not exist"
Jul 28 14:09:05.358040 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.357826    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"]
Jul 28 14:09:05.365654 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:05.365628    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-szm9d"]
Jul 28 14:09:07.341962 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:07.341932    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f49f4be5-5668-4e97-9d3e-6f9dc83d169e" path="/var/lib/kubelet/pods/f49f4be5-5668-4e97-9d3e-6f9dc83d169e/volumes"
Jul 28 14:09:09.206467 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.206431    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"]
Jul 28 14:09:09.207575 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.207551    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" containerName="manager"
Jul 28 14:09:09.207705 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.207694    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" containerName="manager"
Jul 28 14:09:09.207806 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.207779    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49f4be5-5668-4e97-9d3e-6f9dc83d169e" containerName="manager"
Jul 28 14:09:09.207889 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.207880    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49f4be5-5668-4e97-9d3e-6f9dc83d169e" containerName="manager"
Jul 28 14:09:09.208123 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.208111    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49f4be5-5668-4e97-9d3e-6f9dc83d169e" containerName="manager"
Jul 28 14:09:09.208212 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.208202    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="86df42ae-f61e-4d52-adc4-139f2c791665" containerName="manager"
Jul 28 14:09:09.213464 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.213446    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.217081 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.217062    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sszk5\""
Jul 28 14:09:09.225519 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.225497    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"]
Jul 28 14:09:09.390633 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.390633 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390633    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.390888 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.390888 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtkjv\" (UniqueName: \"kubernetes.io/projected/a87eb071-4877-4f83-8ada-045ed9de5d33-kube-api-access-jtkjv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.390888 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.390888 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a87eb071-4877-4f83-8ada-045ed9de5d33-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.390888 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390863    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.391044 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390894    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.391044 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.390928    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492342 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492257    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492342 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492297    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492342 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492577 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtkjv\" (UniqueName: \"kubernetes.io/projected/a87eb071-4877-4f83-8ada-045ed9de5d33-kube-api-access-jtkjv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492577 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492681 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492588    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a87eb071-4877-4f83-8ada-045ed9de5d33-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492681 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492661    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492880 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492880 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.492880 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492743    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.493062 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.493062 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.492897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.493128 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.493079    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.493372 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.493339    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a87eb071-4877-4f83-8ada-045ed9de5d33-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.494940 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.494919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.495117 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.495098    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.507419 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.507391    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a87eb071-4877-4f83-8ada-045ed9de5d33-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.507542 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.507457    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtkjv\" (UniqueName: \"kubernetes.io/projected/a87eb071-4877-4f83-8ada-045ed9de5d33-kube-api-access-jtkjv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-jskvr\" (UID: \"a87eb071-4877-4f83-8ada-045ed9de5d33\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.525495 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.525455    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:09.685086 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:09.685053    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"]
Jul 28 14:09:09.687764 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:09:09.687730    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87eb071_4877_4f83_8ada_045ed9de5d33.slice/crio-9db703f8c96e51517a1b6abaa2043439c59970550184c7a8d333104f87925dfd WatchSource:0}: Error finding container 9db703f8c96e51517a1b6abaa2043439c59970550184c7a8d333104f87925dfd: Status 404 returned error can't find the container with id 9db703f8c96e51517a1b6abaa2043439c59970550184c7a8d333104f87925dfd
Jul 28 14:09:10.350521 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:10.350486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" event={"ID":"a87eb071-4877-4f83-8ada-045ed9de5d33","Type":"ContainerStarted","Data":"9db703f8c96e51517a1b6abaa2043439c59970550184c7a8d333104f87925dfd"}
Jul 28 14:09:12.521913 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:12.521882    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:09:12.522176 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:12.521951    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:09:12.522176 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:12.521980    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:09:13.364680 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:13.364645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" event={"ID":"a87eb071-4877-4f83-8ada-045ed9de5d33","Type":"ContainerStarted","Data":"2413e0e7c8139fbef843e536918cb3351f90ee6ff344a6c5ad19ac445e38155e"}
Jul 28 14:09:13.392484 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:13.392432    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" podStartSLOduration=1.5604124069999998 podStartE2EDuration="4.392416177s" totalImagesPullingTime="2.83200377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:09:13.390984332 +0000 UTC m=+562.609786379" watchObservedRunningTime="2026-07-28 14:09:13.392416177 +0000 UTC m=+562.611218222"
Jul 28 14:09:13.526238 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:13.526203    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:13.531308 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:13.531285    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:14.368437 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:14.368406    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:14.369364 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:14.369340    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:09:22.514107 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.514073    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"]
Jul 28 14:09:22.517409 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.517387    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:22.520419 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.520399    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 14:09:22.520518 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.520456    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wwwfv\""
Jul 28 14:09:22.535200 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.535166    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"]
Jul 28 14:09:22.596300 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.596264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-config-file\") pod \"limitador-limitador-64c94fd64f-6r9zr\" (UID: \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:22.596552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.596331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgdpf\" (UniqueName: \"kubernetes.io/projected/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-kube-api-access-cgdpf\") pod \"limitador-limitador-64c94fd64f-6r9zr\" (UID: \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:22.614359 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.614326    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"]
Jul 28 14:09:22.697213 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.697174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-config-file\") pod \"limitador-limitador-64c94fd64f-6r9zr\" (UID: \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:22.697414 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.697225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgdpf\" (UniqueName: \"kubernetes.io/projected/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-kube-api-access-cgdpf\") pod \"limitador-limitador-64c94fd64f-6r9zr\" (UID: \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:22.697817 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.697767    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-config-file\") pod \"limitador-limitador-64c94fd64f-6r9zr\" (UID: \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:22.707447 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.707417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgdpf\" (UniqueName: \"kubernetes.io/projected/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-kube-api-access-cgdpf\") pod \"limitador-limitador-64c94fd64f-6r9zr\" (UID: \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:22.826603 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.826516    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:22.963502 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:22.963477    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"]
Jul 28 14:09:22.965997 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:09:22.965973    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c47b3c3_bb5b_4e9a_b3cf_2639dd928693.slice/crio-dd5d1deae864124dd495ee92964ae17e3ad7983af5e18eb98b19176df7f34df3 WatchSource:0}: Error finding container dd5d1deae864124dd495ee92964ae17e3ad7983af5e18eb98b19176df7f34df3: Status 404 returned error can't find the container with id dd5d1deae864124dd495ee92964ae17e3ad7983af5e18eb98b19176df7f34df3
Jul 28 14:09:23.407659 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:23.407618    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr" event={"ID":"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693","Type":"ContainerStarted","Data":"dd5d1deae864124dd495ee92964ae17e3ad7983af5e18eb98b19176df7f34df3"}
Jul 28 14:09:23.734656 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:23.733176    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-f8zjl"]
Jul 28 14:09:23.736882 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:23.736847    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f8zjl"
Jul 28 14:09:23.741510 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:23.741482    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hnlqr\""
Jul 28 14:09:23.747533 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:23.747449    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f8zjl"]
Jul 28 14:09:23.806018 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:23.805970    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k72n6\" (UniqueName: \"kubernetes.io/projected/dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc-kube-api-access-k72n6\") pod \"authorino-75d556bd77-f8zjl\" (UID: \"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc\") " pod="kuadrant-system/authorino-75d556bd77-f8zjl"
Jul 28 14:09:23.906950 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:23.906912    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k72n6\" (UniqueName: \"kubernetes.io/projected/dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc-kube-api-access-k72n6\") pod \"authorino-75d556bd77-f8zjl\" (UID: \"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc\") " pod="kuadrant-system/authorino-75d556bd77-f8zjl"
Jul 28 14:09:23.918132 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:23.918093    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k72n6\" (UniqueName: \"kubernetes.io/projected/dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc-kube-api-access-k72n6\") pod \"authorino-75d556bd77-f8zjl\" (UID: \"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc\") " pod="kuadrant-system/authorino-75d556bd77-f8zjl"
Jul 28 14:09:24.053491 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:24.053404    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f8zjl"
Jul 28 14:09:24.213372 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:24.213347    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f8zjl"]
Jul 28 14:09:24.218130 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:09:24.218092    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd2d6a3b_8410_4776_bd9f_c46bd8e0c4dc.slice/crio-36e58aa3be9fc6825378ed0b63cc27b8d91659c286e6a98509bd401482593490 WatchSource:0}: Error finding container 36e58aa3be9fc6825378ed0b63cc27b8d91659c286e6a98509bd401482593490: Status 404 returned error can't find the container with id 36e58aa3be9fc6825378ed0b63cc27b8d91659c286e6a98509bd401482593490
Jul 28 14:09:24.413969 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:24.413931    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f8zjl" event={"ID":"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc","Type":"ContainerStarted","Data":"36e58aa3be9fc6825378ed0b63cc27b8d91659c286e6a98509bd401482593490"}
Jul 28 14:09:26.426778 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:26.426741    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr" event={"ID":"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693","Type":"ContainerStarted","Data":"e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390"}
Jul 28 14:09:26.427213 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:26.427001    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:26.456196 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:26.456132    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr" podStartSLOduration=1.644773104 podStartE2EDuration="4.456111538s" totalImagesPullingTime="2.811338434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:09:26.453679204 +0000 UTC m=+575.672481250" watchObservedRunningTime="2026-07-28 14:09:26.456111538 +0000 UTC m=+575.674913585"
Jul 28 14:09:28.442274 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:28.442236    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f8zjl" event={"ID":"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc","Type":"ContainerStarted","Data":"e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e"}
Jul 28 14:09:28.467249 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:28.467191    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-f8zjl" podStartSLOduration=1.780370606 podStartE2EDuration="5.467174681s" totalImagesPullingTime="3.686804075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:09:28.466182773 +0000 UTC m=+577.684984820" watchObservedRunningTime="2026-07-28 14:09:28.467174681 +0000 UTC m=+577.685976727"
Jul 28 14:09:37.433097 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:37.433060    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:39.413080 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:39.413043    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"]
Jul 28 14:09:39.413502 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:39.413226    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr" podUID="5c47b3c3-bb5b-4e9a-b3cf-2639dd928693" containerName="limitador" containerID="cri-o://e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390" gracePeriod=30
Jul 28 14:09:39.968141 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:39.968116    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:40.021775 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.021693    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgdpf\" (UniqueName: \"kubernetes.io/projected/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-kube-api-access-cgdpf\") pod \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\" (UID: \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\") "
Jul 28 14:09:40.021775 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.021758    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-config-file\") pod \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\" (UID: \"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693\") "
Jul 28 14:09:40.022184 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.022159    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-config-file" (OuterVolumeSpecName: "config-file") pod "5c47b3c3-bb5b-4e9a-b3cf-2639dd928693" (UID: "5c47b3c3-bb5b-4e9a-b3cf-2639dd928693"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:09:40.023738 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.023709    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-kube-api-access-cgdpf" (OuterVolumeSpecName: "kube-api-access-cgdpf") pod "5c47b3c3-bb5b-4e9a-b3cf-2639dd928693" (UID: "5c47b3c3-bb5b-4e9a-b3cf-2639dd928693"). InnerVolumeSpecName "kube-api-access-cgdpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:09:40.122547 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.122501    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgdpf\" (UniqueName: \"kubernetes.io/projected/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-kube-api-access-cgdpf\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:09:40.122547 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.122536    2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693-config-file\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:09:40.491679 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.491638    2571 generic.go:356] "Generic (PLEG): container finished" podID="5c47b3c3-bb5b-4e9a-b3cf-2639dd928693" containerID="e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390" exitCode=0
Jul 28 14:09:40.491679 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.491681    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr" event={"ID":"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693","Type":"ContainerDied","Data":"e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390"}
Jul 28 14:09:40.491679 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.491686    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"
Jul 28 14:09:40.492272 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.491734    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6r9zr" event={"ID":"5c47b3c3-bb5b-4e9a-b3cf-2639dd928693","Type":"ContainerDied","Data":"dd5d1deae864124dd495ee92964ae17e3ad7983af5e18eb98b19176df7f34df3"}
Jul 28 14:09:40.492272 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.491762    2571 scope.go:117] "RemoveContainer" containerID="e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390"
Jul 28 14:09:40.500176 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.500154    2571 scope.go:117] "RemoveContainer" containerID="e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390"
Jul 28 14:09:40.500440 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:09:40.500422    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390\": container with ID starting with e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390 not found: ID does not exist" containerID="e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390"
Jul 28 14:09:40.500504 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.500455    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390"} err="failed to get container status \"e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390\": rpc error: code = NotFound desc = could not find container \"e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390\": container with ID starting with e741e11d4f61718c40874df438ec851d5bad3521ad0294f8b5ba81670e56c390 not found: ID does not exist"
Jul 28 14:09:40.517559 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.517528    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"]
Jul 28 14:09:40.525827 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:40.525803    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6r9zr"]
Jul 28 14:09:41.342499 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:41.342469    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c47b3c3-bb5b-4e9a-b3cf-2639dd928693" path="/var/lib/kubelet/pods/5c47b3c3-bb5b-4e9a-b3cf-2639dd928693/volumes"
Jul 28 14:09:59.463683 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.463645    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"]
Jul 28 14:09:59.464114 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.463957    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c47b3c3-bb5b-4e9a-b3cf-2639dd928693" containerName="limitador"
Jul 28 14:09:59.464114 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.463970    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c47b3c3-bb5b-4e9a-b3cf-2639dd928693" containerName="limitador"
Jul 28 14:09:59.464114 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.464026    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c47b3c3-bb5b-4e9a-b3cf-2639dd928693" containerName="limitador"
Jul 28 14:09:59.528352 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.528317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"]
Jul 28 14:09:59.528519 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.528426    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:09:59.531651 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.531626    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 14:09:59.531862 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.531684    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xmsrq\""
Jul 28 14:09:59.531862 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.531684    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 14:09:59.533071 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.533052    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 14:09:59.577695 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.577660    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6h4j\" (UniqueName: \"kubernetes.io/projected/aee8e1a1-d015-44b7-bb20-eb0b2d60aee6-kube-api-access-l6h4j\") pod \"postgres-69fb4594cf-zhw7k\" (UID: \"aee8e1a1-d015-44b7-bb20-eb0b2d60aee6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:09:59.577695 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.577696    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aee8e1a1-d015-44b7-bb20-eb0b2d60aee6-data\") pod \"postgres-69fb4594cf-zhw7k\" (UID: \"aee8e1a1-d015-44b7-bb20-eb0b2d60aee6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:09:59.678601 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.678564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6h4j\" (UniqueName: \"kubernetes.io/projected/aee8e1a1-d015-44b7-bb20-eb0b2d60aee6-kube-api-access-l6h4j\") pod \"postgres-69fb4594cf-zhw7k\" (UID: \"aee8e1a1-d015-44b7-bb20-eb0b2d60aee6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:09:59.678601 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.678606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aee8e1a1-d015-44b7-bb20-eb0b2d60aee6-data\") pod \"postgres-69fb4594cf-zhw7k\" (UID: \"aee8e1a1-d015-44b7-bb20-eb0b2d60aee6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:09:59.678978 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.678962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aee8e1a1-d015-44b7-bb20-eb0b2d60aee6-data\") pod \"postgres-69fb4594cf-zhw7k\" (UID: \"aee8e1a1-d015-44b7-bb20-eb0b2d60aee6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:09:59.689893 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.689871    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6h4j\" (UniqueName: \"kubernetes.io/projected/aee8e1a1-d015-44b7-bb20-eb0b2d60aee6-kube-api-access-l6h4j\") pod \"postgres-69fb4594cf-zhw7k\" (UID: \"aee8e1a1-d015-44b7-bb20-eb0b2d60aee6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:09:59.838309 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:09:59.838226    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:10:00.011863 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:00.011749    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"]
Jul 28 14:10:00.014824 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:10:00.014777    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee8e1a1_d015_44b7_bb20_eb0b2d60aee6.slice/crio-03cd4e8c73ecacd19cfe6bd97f7d5a969e6bed2ee3018ede751cb7d5b01c84af WatchSource:0}: Error finding container 03cd4e8c73ecacd19cfe6bd97f7d5a969e6bed2ee3018ede751cb7d5b01c84af: Status 404 returned error can't find the container with id 03cd4e8c73ecacd19cfe6bd97f7d5a969e6bed2ee3018ede751cb7d5b01c84af
Jul 28 14:10:00.574343 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:00.574309    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k" event={"ID":"aee8e1a1-d015-44b7-bb20-eb0b2d60aee6","Type":"ContainerStarted","Data":"03cd4e8c73ecacd19cfe6bd97f7d5a969e6bed2ee3018ede751cb7d5b01c84af"}
Jul 28 14:10:05.600913 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:05.600874    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k" event={"ID":"aee8e1a1-d015-44b7-bb20-eb0b2d60aee6","Type":"ContainerStarted","Data":"0cd763648b0f1b109ba852c0e37e5f70bdb8f748e12174fc50440f979cbe7e20"}
Jul 28 14:10:05.601290 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:05.601011    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:10:05.621291 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:05.621208    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k" podStartSLOduration=1.6144874599999999 podStartE2EDuration="6.62118883s" totalImagesPullingTime="5.00670137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:10:05.620773668 +0000 UTC m=+614.839575710" watchObservedRunningTime="2026-07-28 14:10:05.62118883 +0000 UTC m=+614.839990876"
Jul 28 14:10:11.633633 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:11.633600    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zhw7k"
Jul 28 14:10:14.679172 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:14.679091    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f8zjl"]
Jul 28 14:10:14.679574 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:14.679281    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-f8zjl" podUID="dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc" containerName="authorino" containerID="cri-o://e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e" gracePeriod=30
Jul 28 14:10:14.926910 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:14.926886    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f8zjl"
Jul 28 14:10:15.012376 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.012291    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k72n6\" (UniqueName: \"kubernetes.io/projected/dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc-kube-api-access-k72n6\") pod \"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc\" (UID: \"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc\") "
Jul 28 14:10:15.014339 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.014301    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc-kube-api-access-k72n6" (OuterVolumeSpecName: "kube-api-access-k72n6") pod "dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc" (UID: "dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc"). InnerVolumeSpecName "kube-api-access-k72n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:10:15.113012 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.112978    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k72n6\" (UniqueName: \"kubernetes.io/projected/dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc-kube-api-access-k72n6\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:10:15.643819 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.643722    2571 generic.go:356] "Generic (PLEG): container finished" podID="dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc" containerID="e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e" exitCode=0
Jul 28 14:10:15.643819 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.643762    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f8zjl"
Jul 28 14:10:15.644057 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.643811    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f8zjl" event={"ID":"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc","Type":"ContainerDied","Data":"e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e"}
Jul 28 14:10:15.644057 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.643860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f8zjl" event={"ID":"dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc","Type":"ContainerDied","Data":"36e58aa3be9fc6825378ed0b63cc27b8d91659c286e6a98509bd401482593490"}
Jul 28 14:10:15.644057 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.643881    2571 scope.go:117] "RemoveContainer" containerID="e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e"
Jul 28 14:10:15.651672 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.651654    2571 scope.go:117] "RemoveContainer" containerID="e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e"
Jul 28 14:10:15.651981 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:10:15.651955    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e\": container with ID starting with e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e not found: ID does not exist" containerID="e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e"
Jul 28 14:10:15.652059 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.651996    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e"} err="failed to get container status \"e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e\": rpc error: code = NotFound desc = could not find container \"e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e\": container with ID starting with e15d8c751ddb21d1a3c0233a079db9679c34edec5cd6911cb161ef61cca2137e not found: ID does not exist"
Jul 28 14:10:15.678762 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.678730    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f8zjl"]
Jul 28 14:10:15.681548 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:15.681525    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f8zjl"]
Jul 28 14:10:17.342139 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:17.342105    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc" path="/var/lib/kubelet/pods/dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc/volumes"
Jul 28 14:10:20.145606 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.145570    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-855d74796d-5ntwh"]
Jul 28 14:10:20.146040 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.145870    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc" containerName="authorino"
Jul 28 14:10:20.146040 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.145882    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc" containerName="authorino"
Jul 28 14:10:20.146040 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.145940    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd2d6a3b-8410-4776-bd9f-c46bd8e0c4dc" containerName="authorino"
Jul 28 14:10:20.150085 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.150067    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.152972 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.152941    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xqb84\""
Jul 28 14:10:20.153164 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.153149    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 14:10:20.154174 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.154158    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 14:10:20.154262 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.154210    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Jul 28 14:10:20.164815 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.164765    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-855d74796d-5ntwh"]
Jul 28 14:10:20.254621 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.254588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52tfm\" (UniqueName: \"kubernetes.io/projected/c4ad022f-7f70-4dda-87c6-0af877841ad4-kube-api-access-52tfm\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.254830 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.254642    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-metrics-certs\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.254830 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.254663    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-webhook-cert\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.355252 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.355215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-metrics-certs\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.355252 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.355251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-webhook-cert\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.355468 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.355322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52tfm\" (UniqueName: \"kubernetes.io/projected/c4ad022f-7f70-4dda-87c6-0af877841ad4-kube-api-access-52tfm\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.357818 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.357771    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-webhook-cert\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.357934 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.357778    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-metrics-certs\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.368028 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.368002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52tfm\" (UniqueName: \"kubernetes.io/projected/c4ad022f-7f70-4dda-87c6-0af877841ad4-kube-api-access-52tfm\") pod \"maas-controller-855d74796d-5ntwh\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") " pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.374354 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.374328    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-nqkpm"]
Jul 28 14:10:20.377443 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.377426    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.396270 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.396191    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-nqkpm"]
Jul 28 14:10:20.460341 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.460302    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:20.557463 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.557419    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-metrics-certs\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.557621 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.557481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndvkk\" (UniqueName: \"kubernetes.io/projected/960cf587-25b1-4de7-89be-69c606fd92bc-kube-api-access-ndvkk\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.557621 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.557595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-webhook-cert\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.602603 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.602568    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-855d74796d-5ntwh"]
Jul 28 14:10:20.605735 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:10:20.605708    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ad022f_7f70_4dda_87c6_0af877841ad4.slice/crio-4dd2cf62cb7c69f57797f19cf7001eaa4a1edf5883314a4556b450f98fe27e4a WatchSource:0}: Error finding container 4dd2cf62cb7c69f57797f19cf7001eaa4a1edf5883314a4556b450f98fe27e4a: Status 404 returned error can't find the container with id 4dd2cf62cb7c69f57797f19cf7001eaa4a1edf5883314a4556b450f98fe27e4a
Jul 28 14:10:20.658359 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.658273    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-metrics-certs\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.658359 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.658309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndvkk\" (UniqueName: \"kubernetes.io/projected/960cf587-25b1-4de7-89be-69c606fd92bc-kube-api-access-ndvkk\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.658359 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.658357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-webhook-cert\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.660823 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.660777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-webhook-cert\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.660964 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.660902    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-metrics-certs\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.664439 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.664413    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-855d74796d-5ntwh" event={"ID":"c4ad022f-7f70-4dda-87c6-0af877841ad4","Type":"ContainerStarted","Data":"4dd2cf62cb7c69f57797f19cf7001eaa4a1edf5883314a4556b450f98fe27e4a"}
Jul 28 14:10:20.668487 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.668460    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndvkk\" (UniqueName: \"kubernetes.io/projected/960cf587-25b1-4de7-89be-69c606fd92bc-kube-api-access-ndvkk\") pod \"maas-controller-7f8dcf4b8-nqkpm\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") " pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.687494 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.687467    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:20.822493 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:20.822463    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-nqkpm"]
Jul 28 14:10:20.825579 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:10:20.825549    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960cf587_25b1_4de7_89be_69c606fd92bc.slice/crio-05c1ec64beb6e7e2078761540d2873be8ed20d043c5422b9a16947286fc57b46 WatchSource:0}: Error finding container 05c1ec64beb6e7e2078761540d2873be8ed20d043c5422b9a16947286fc57b46: Status 404 returned error can't find the container with id 05c1ec64beb6e7e2078761540d2873be8ed20d043c5422b9a16947286fc57b46
Jul 28 14:10:21.671474 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:21.671436    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm" event={"ID":"960cf587-25b1-4de7-89be-69c606fd92bc","Type":"ContainerStarted","Data":"05c1ec64beb6e7e2078761540d2873be8ed20d043c5422b9a16947286fc57b46"}
Jul 28 14:10:23.686625 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:23.686567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-855d74796d-5ntwh" event={"ID":"c4ad022f-7f70-4dda-87c6-0af877841ad4","Type":"ContainerStarted","Data":"b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f"}
Jul 28 14:10:23.687103 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:23.686714    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:23.688215 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:23.688195    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm" event={"ID":"960cf587-25b1-4de7-89be-69c606fd92bc","Type":"ContainerStarted","Data":"eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28"}
Jul 28 14:10:23.688333 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:23.688321    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:23.714881 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:23.714828    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-855d74796d-5ntwh" podStartSLOduration=1.372813942 podStartE2EDuration="3.714811538s" totalImagesPullingTime="2.341997596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:10:23.713882881 +0000 UTC m=+632.932684927" watchObservedRunningTime="2026-07-28 14:10:23.714811538 +0000 UTC m=+632.933613615"
Jul 28 14:10:23.740536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:23.740482    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm" podStartSLOduration=1.617832248 podStartE2EDuration="3.740464679s" totalImagesPullingTime="2.122632431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:10:23.737248513 +0000 UTC m=+632.956050559" watchObservedRunningTime="2026-07-28 14:10:23.740464679 +0000 UTC m=+632.959266724"
Jul 28 14:10:34.695106 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:34.695074    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:34.696502 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:34.695148    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:10:34.806459 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:34.806412    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-855d74796d-5ntwh"]
Jul 28 14:10:34.806650 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:34.806614    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-855d74796d-5ntwh" podUID="c4ad022f-7f70-4dda-87c6-0af877841ad4" containerName="manager" containerID="cri-o://b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f" gracePeriod=30
Jul 28 14:10:35.049680 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.049651    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:35.178534 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.178495    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-webhook-cert\") pod \"c4ad022f-7f70-4dda-87c6-0af877841ad4\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") "
Jul 28 14:10:35.178716 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.178554    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52tfm\" (UniqueName: \"kubernetes.io/projected/c4ad022f-7f70-4dda-87c6-0af877841ad4-kube-api-access-52tfm\") pod \"c4ad022f-7f70-4dda-87c6-0af877841ad4\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") "
Jul 28 14:10:35.178716 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.178609    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-metrics-certs\") pod \"c4ad022f-7f70-4dda-87c6-0af877841ad4\" (UID: \"c4ad022f-7f70-4dda-87c6-0af877841ad4\") "
Jul 28 14:10:35.181130 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.181097    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4ad022f-7f70-4dda-87c6-0af877841ad4-kube-api-access-52tfm" (OuterVolumeSpecName: "kube-api-access-52tfm") pod "c4ad022f-7f70-4dda-87c6-0af877841ad4" (UID: "c4ad022f-7f70-4dda-87c6-0af877841ad4"). InnerVolumeSpecName "kube-api-access-52tfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:10:35.181267 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.181102    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c4ad022f-7f70-4dda-87c6-0af877841ad4" (UID: "c4ad022f-7f70-4dda-87c6-0af877841ad4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:10:35.181267 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.181225    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c4ad022f-7f70-4dda-87c6-0af877841ad4" (UID: "c4ad022f-7f70-4dda-87c6-0af877841ad4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:10:35.279574 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.279486    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-metrics-certs\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:10:35.279574 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.279515    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ad022f-7f70-4dda-87c6-0af877841ad4-webhook-cert\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:10:35.279574 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.279524    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52tfm\" (UniqueName: \"kubernetes.io/projected/c4ad022f-7f70-4dda-87c6-0af877841ad4-kube-api-access-52tfm\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:10:35.738800 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.738750    2571 generic.go:356] "Generic (PLEG): container finished" podID="c4ad022f-7f70-4dda-87c6-0af877841ad4" containerID="b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f" exitCode=0
Jul 28 14:10:35.739194 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.738810    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-855d74796d-5ntwh"
Jul 28 14:10:35.739194 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.738834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-855d74796d-5ntwh" event={"ID":"c4ad022f-7f70-4dda-87c6-0af877841ad4","Type":"ContainerDied","Data":"b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f"}
Jul 28 14:10:35.739194 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.738890    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-855d74796d-5ntwh" event={"ID":"c4ad022f-7f70-4dda-87c6-0af877841ad4","Type":"ContainerDied","Data":"4dd2cf62cb7c69f57797f19cf7001eaa4a1edf5883314a4556b450f98fe27e4a"}
Jul 28 14:10:35.739194 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.738914    2571 scope.go:117] "RemoveContainer" containerID="b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f"
Jul 28 14:10:35.746915 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.746896    2571 scope.go:117] "RemoveContainer" containerID="b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f"
Jul 28 14:10:35.747196 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:10:35.747176    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f\": container with ID starting with b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f not found: ID does not exist" containerID="b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f"
Jul 28 14:10:35.747249 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.747205    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f"} err="failed to get container status \"b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f\": rpc error: code = NotFound desc = could not find container \"b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f\": container with ID starting with b1bc4dda0d4afda422ca950ded009d52da711f98566f1e2f8a2535f94240f85f not found: ID does not exist"
Jul 28 14:10:35.768980 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.768950    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-855d74796d-5ntwh"]
Jul 28 14:10:35.785155 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:35.785127    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-855d74796d-5ntwh"]
Jul 28 14:10:37.342482 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:37.342446    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ad022f-7f70-4dda-87c6-0af877841ad4" path="/var/lib/kubelet/pods/c4ad022f-7f70-4dda-87c6-0af877841ad4/volumes"
Jul 28 14:10:56.705927 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.705888    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-575598fc6-797pn"]
Jul 28 14:10:56.706330 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.706203    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ad022f-7f70-4dda-87c6-0af877841ad4" containerName="manager"
Jul 28 14:10:56.706330 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.706215    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ad022f-7f70-4dda-87c6-0af877841ad4" containerName="manager"
Jul 28 14:10:56.706330 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.706268    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ad022f-7f70-4dda-87c6-0af877841ad4" containerName="manager"
Jul 28 14:10:56.712081 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.712054    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.719475 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.719449    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hsfxf\""
Jul 28 14:10:56.719592 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.719445    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 28 14:10:56.738132 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.738102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hctqg\" (UniqueName: \"kubernetes.io/projected/29abf9d6-224c-40c2-a29b-275657b62687-kube-api-access-hctqg\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.738294 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.738145    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29abf9d6-224c-40c2-a29b-275657b62687-maas-api-tls\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.738294 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.738210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29abf9d6-224c-40c2-a29b-275657b62687-openshift-service-ca\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.748490 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.748459    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-575598fc6-797pn"]
Jul 28 14:10:56.839445 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.839413    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29abf9d6-224c-40c2-a29b-275657b62687-openshift-service-ca\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.839627 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.839463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hctqg\" (UniqueName: \"kubernetes.io/projected/29abf9d6-224c-40c2-a29b-275657b62687-kube-api-access-hctqg\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.839627 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.839574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29abf9d6-224c-40c2-a29b-275657b62687-maas-api-tls\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.840200 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.840171    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29abf9d6-224c-40c2-a29b-275657b62687-openshift-service-ca\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.842081 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.842055    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29abf9d6-224c-40c2-a29b-275657b62687-maas-api-tls\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:56.853032 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:56.853002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hctqg\" (UniqueName: \"kubernetes.io/projected/29abf9d6-224c-40c2-a29b-275657b62687-kube-api-access-hctqg\") pod \"maas-api-575598fc6-797pn\" (UID: \"29abf9d6-224c-40c2-a29b-275657b62687\") " pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:57.023726 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.023633    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:57.187118 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.186929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-575598fc6-797pn"]
Jul 28 14:10:57.189915 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:10:57.189884    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29abf9d6_224c_40c2_a29b_275657b62687.slice/crio-7ba3c04155611c13c92db6736a51c2d048c7b754029872d0ba68d0fb2a2bce59 WatchSource:0}: Error finding container 7ba3c04155611c13c92db6736a51c2d048c7b754029872d0ba68d0fb2a2bce59: Status 404 returned error can't find the container with id 7ba3c04155611c13c92db6736a51c2d048c7b754029872d0ba68d0fb2a2bce59
Jul 28 14:10:57.469755 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.469718    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-s9nv8"]
Jul 28 14:10:57.474074 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.474055    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:10:57.477101 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.477082    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 14:10:57.491141 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.491113    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-s9nv8"]
Jul 28 14:10:57.527098 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.527061    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"]
Jul 28 14:10:57.530167 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.530148    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:10:57.533305 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.533283    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9g8pc\""
Jul 28 14:10:57.543682 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.543659    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"]
Jul 28 14:10:57.543975 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.543958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e48844b-ea34-4c14-aecf-d84c67656c69-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-s9nv8\" (UID: \"4e48844b-ea34-4c14-aecf-d84c67656c69\") " pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:10:57.544034 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.543987    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5v24\" (UniqueName: \"kubernetes.io/projected/4e48844b-ea34-4c14-aecf-d84c67656c69-kube-api-access-k5v24\") pod \"payload-processing-5cc6cd444b-s9nv8\" (UID: \"4e48844b-ea34-4c14-aecf-d84c67656c69\") " pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:10:57.645124 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.645090    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9b6\" (UniqueName: \"kubernetes.io/projected/471c6804-46bf-42e4-a823-7f56ecdada52-kube-api-access-pr9b6\") pod \"payload-pre-processing-687dbb6cf6-7vnzs\" (UID: \"471c6804-46bf-42e4-a823-7f56ecdada52\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:10:57.645311 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.645133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e48844b-ea34-4c14-aecf-d84c67656c69-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-s9nv8\" (UID: \"4e48844b-ea34-4c14-aecf-d84c67656c69\") " pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:10:57.645311 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.645168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5v24\" (UniqueName: \"kubernetes.io/projected/4e48844b-ea34-4c14-aecf-d84c67656c69-kube-api-access-k5v24\") pod \"payload-processing-5cc6cd444b-s9nv8\" (UID: \"4e48844b-ea34-4c14-aecf-d84c67656c69\") " pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:10:57.645311 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.645224    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/471c6804-46bf-42e4-a823-7f56ecdada52-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7vnzs\" (UID: \"471c6804-46bf-42e4-a823-7f56ecdada52\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:10:57.645842 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.645823    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e48844b-ea34-4c14-aecf-d84c67656c69-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-s9nv8\" (UID: \"4e48844b-ea34-4c14-aecf-d84c67656c69\") " pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:10:57.662726 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.662693    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5v24\" (UniqueName: \"kubernetes.io/projected/4e48844b-ea34-4c14-aecf-d84c67656c69-kube-api-access-k5v24\") pod \"payload-processing-5cc6cd444b-s9nv8\" (UID: \"4e48844b-ea34-4c14-aecf-d84c67656c69\") " pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:10:57.746726 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.746620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/471c6804-46bf-42e4-a823-7f56ecdada52-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7vnzs\" (UID: \"471c6804-46bf-42e4-a823-7f56ecdada52\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:10:57.746726 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.746701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9b6\" (UniqueName: \"kubernetes.io/projected/471c6804-46bf-42e4-a823-7f56ecdada52-kube-api-access-pr9b6\") pod \"payload-pre-processing-687dbb6cf6-7vnzs\" (UID: \"471c6804-46bf-42e4-a823-7f56ecdada52\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:10:57.747363 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.747340    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/471c6804-46bf-42e4-a823-7f56ecdada52-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-7vnzs\" (UID: \"471c6804-46bf-42e4-a823-7f56ecdada52\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:10:57.760919 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.760888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9b6\" (UniqueName: \"kubernetes.io/projected/471c6804-46bf-42e4-a823-7f56ecdada52-kube-api-access-pr9b6\") pod \"payload-pre-processing-687dbb6cf6-7vnzs\" (UID: \"471c6804-46bf-42e4-a823-7f56ecdada52\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:10:57.784768 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.784738    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:10:57.833525 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.833492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn" event={"ID":"29abf9d6-224c-40c2-a29b-275657b62687","Type":"ContainerStarted","Data":"7ba3c04155611c13c92db6736a51c2d048c7b754029872d0ba68d0fb2a2bce59"}
Jul 28 14:10:57.839876 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.839678    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:10:57.940369 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:57.940318    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-s9nv8"]
Jul 28 14:10:57.948069 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:10:57.944758    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e48844b_ea34_4c14_aecf_d84c67656c69.slice/crio-dc4b35192409b0e43c79af1ffcb12adac73d5885f7d9ed89ba9ab8768d7b3a81 WatchSource:0}: Error finding container dc4b35192409b0e43c79af1ffcb12adac73d5885f7d9ed89ba9ab8768d7b3a81: Status 404 returned error can't find the container with id dc4b35192409b0e43c79af1ffcb12adac73d5885f7d9ed89ba9ab8768d7b3a81
Jul 28 14:10:58.026055 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:58.025967    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"]
Jul 28 14:10:58.029455 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:10:58.029425    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471c6804_46bf_42e4_a823_7f56ecdada52.slice/crio-cf0977caea281533ceb0af89de43323bab6d33fb5c08c46179824c31e6fb067b WatchSource:0}: Error finding container cf0977caea281533ceb0af89de43323bab6d33fb5c08c46179824c31e6fb067b: Status 404 returned error can't find the container with id cf0977caea281533ceb0af89de43323bab6d33fb5c08c46179824c31e6fb067b
Jul 28 14:10:58.842493 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:58.842441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8" event={"ID":"4e48844b-ea34-4c14-aecf-d84c67656c69","Type":"ContainerStarted","Data":"dc4b35192409b0e43c79af1ffcb12adac73d5885f7d9ed89ba9ab8768d7b3a81"}
Jul 28 14:10:58.843738 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:58.843702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs" event={"ID":"471c6804-46bf-42e4-a823-7f56ecdada52","Type":"ContainerStarted","Data":"cf0977caea281533ceb0af89de43323bab6d33fb5c08c46179824c31e6fb067b"}
Jul 28 14:10:59.853217 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:59.853049    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn" event={"ID":"29abf9d6-224c-40c2-a29b-275657b62687","Type":"ContainerStarted","Data":"166c6b23989f55cfb47c9a4266d75da4986cf0ae7e4a8e8e7bef66100d061e92"}
Jul 28 14:10:59.853664 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:59.853523    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:10:59.884616 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:10:59.884293    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn" podStartSLOduration=1.9107995309999999 podStartE2EDuration="3.884272424s" totalImagesPullingTime="1.973472893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:10:59.882805109 +0000 UTC m=+669.101607151" watchObservedRunningTime="2026-07-28 14:10:59.884272424 +0000 UTC m=+669.103074469"
Jul 28 14:11:02.874826 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:02.874705    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8" event={"ID":"4e48844b-ea34-4c14-aecf-d84c67656c69","Type":"ContainerStarted","Data":"b5955d529fa1048c4dc0f1083c2eb36e2dd891e6f495cb2ef00fecccaacc8f9d"}
Jul 28 14:11:02.875251 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:02.874881    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:11:02.876319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:02.876296    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs" event={"ID":"471c6804-46bf-42e4-a823-7f56ecdada52","Type":"ContainerStarted","Data":"fe8d964526d9d4257927d4e08821a6522e9565b0db702f81821109bb1347c1cd"}
Jul 28 14:11:02.876437 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:02.876427    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:11:02.895495 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:02.895421    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8" podStartSLOduration=1.9737355220000001 podStartE2EDuration="5.895398133s" totalImagesPullingTime="3.921662611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:11:02.893305182 +0000 UTC m=+672.112107230" watchObservedRunningTime="2026-07-28 14:11:02.895398133 +0000 UTC m=+672.114200181"
Jul 28 14:11:02.913012 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:02.912953    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs" podStartSLOduration=2.067664554 podStartE2EDuration="5.912935708s" totalImagesPullingTime="3.845271154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:11:02.911112445 +0000 UTC m=+672.129914497" watchObservedRunningTime="2026-07-28 14:11:02.912935708 +0000 UTC m=+672.131737799"
Jul 28 14:11:05.865721 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:05.865643    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-575598fc6-797pn"
Jul 28 14:11:05.892171 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:05.892143    2571 generic.go:356] "Generic (PLEG): container finished" podID="a87eb071-4877-4f83-8ada-045ed9de5d33" containerID="2413e0e7c8139fbef843e536918cb3351f90ee6ff344a6c5ad19ac445e38155e" exitCode=0
Jul 28 14:11:05.892346 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:05.892218    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" event={"ID":"a87eb071-4877-4f83-8ada-045ed9de5d33","Type":"ContainerDied","Data":"2413e0e7c8139fbef843e536918cb3351f90ee6ff344a6c5ad19ac445e38155e"}
Jul 28 14:11:05.892593 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:05.892576    2571 scope.go:117] "RemoveContainer" containerID="2413e0e7c8139fbef843e536918cb3351f90ee6ff344a6c5ad19ac445e38155e"
Jul 28 14:11:05.893552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:05.893525    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:11:05.893609 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:05.893591    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:11:05.893643 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:05.893625    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:11:06.898260 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:06.898227    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" event={"ID":"a87eb071-4877-4f83-8ada-045ed9de5d33","Type":"ContainerStarted","Data":"fdc4260117d606b1538ae2d06228c7176601155251de8c990158367adc4b29cf"}
Jul 28 14:11:07.526628 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:07.526590    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:11:07.526844 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:07.526715    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-jskvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 14:11:07.526844 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:07.526765    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" podUID="a87eb071-4877-4f83-8ada-045ed9de5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 14:11:08.526087 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:08.526040    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-jskvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 14:11:08.526560 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:08.526108    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" podUID="a87eb071-4877-4f83-8ada-045ed9de5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 14:11:09.527238 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:09.526809    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-jskvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 14:11:09.527238 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:09.526871    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" podUID="a87eb071-4877-4f83-8ada-045ed9de5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 14:11:10.526208 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:10.526162    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-jskvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 14:11:10.526418 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:10.526233    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr" podUID="a87eb071-4877-4f83-8ada-045ed9de5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 14:11:11.530216 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:11.530180    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:11:11.530592 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:11.530533    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:11:11.531170 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:11.531149    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jskvr"
Jul 28 14:11:13.882339 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:13.882294    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs" podUID="471c6804-46bf-42e4-a823-7f56ecdada52" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.31:9004: connect: connection refused"
Jul 28 14:11:13.882760 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:13.882720    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-s9nv8"
Jul 28 14:11:22.938380 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:22.938335    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"]
Jul 28 14:11:22.942051 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:22.942025    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:22.945863 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:22.945837    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 14:11:22.947407 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:22.947384    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 14:11:22.947407 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:22.947393    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nxn8f\""
Jul 28 14:11:22.947616 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:22.947393    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 14:11:22.951075 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:22.951051    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"]
Jul 28 14:11:23.075560 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.075523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.075730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.075574    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88201f44-3009-4bde-84de-0b05dbb412ae-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.075730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.075603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl6cx\" (UniqueName: \"kubernetes.io/projected/88201f44-3009-4bde-84de-0b05dbb412ae-kube-api-access-jl6cx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.075730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.075661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.075730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.075691    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.075730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.075707    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.176901 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.176859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.176901 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.176901    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.177146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.176930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.177146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.176970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88201f44-3009-4bde-84de-0b05dbb412ae-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.177146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.177004    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl6cx\" (UniqueName: \"kubernetes.io/projected/88201f44-3009-4bde-84de-0b05dbb412ae-kube-api-access-jl6cx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.177146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.177053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.177418 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.177393    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.177472 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.177432    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.177472 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.177450    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.179272 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.179250    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88201f44-3009-4bde-84de-0b05dbb412ae-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.179631 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.179611    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88201f44-3009-4bde-84de-0b05dbb412ae-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.187997 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.187973    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl6cx\" (UniqueName: \"kubernetes.io/projected/88201f44-3009-4bde-84de-0b05dbb412ae-kube-api-access-jl6cx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jvmjd\" (UID: \"88201f44-3009-4bde-84de-0b05dbb412ae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.253701 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.253615    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:23.398111 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.398084    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"]
Jul 28 14:11:23.400562 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:11:23.400524    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88201f44_3009_4bde_84de_0b05dbb412ae.slice/crio-b652173675f9e479f31f568801366297acbd9eeb1d2c746939c49b29f5245077 WatchSource:0}: Error finding container b652173675f9e479f31f568801366297acbd9eeb1d2c746939c49b29f5245077: Status 404 returned error can't find the container with id b652173675f9e479f31f568801366297acbd9eeb1d2c746939c49b29f5245077
Jul 28 14:11:23.401959 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.401942    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 14:11:23.880980 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.880949    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-7vnzs"
Jul 28 14:11:23.976168 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:23.976115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd" event={"ID":"88201f44-3009-4bde-84de-0b05dbb412ae","Type":"ContainerStarted","Data":"b652173675f9e479f31f568801366297acbd9eeb1d2c746939c49b29f5245077"}
Jul 28 14:11:24.982340 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:24.982305    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd" event={"ID":"88201f44-3009-4bde-84de-0b05dbb412ae","Type":"ContainerStarted","Data":"7a17acc7b8b2d767be6bb15de638f1b6794f77eba3f21f74cdf68610a52399b0"}
Jul 28 14:11:25.006256 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:25.006204    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd" podStartSLOduration=1.897436769 podStartE2EDuration="3.006186629s" totalImagesPullingTime="1.10874986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:11:25.004985597 +0000 UTC m=+694.223787656" watchObservedRunningTime="2026-07-28 14:11:25.006186629 +0000 UTC m=+694.224988719"
Jul 28 14:11:33.254182 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:33.254135    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:33.254679 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:33.254229    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:33.266953 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:33.266918    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:34.033553 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:34.033516    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jvmjd"
Jul 28 14:11:44.847282 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.847204    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"]
Jul 28 14:11:44.852054 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.852027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.855123 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.855103    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 28 14:11:44.858584 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.858555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.858723 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.858612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908f7141-1b21-4885-b80f-18828d5fa922-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.858723 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.858693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.859164 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.858723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.859164 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.858746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9zh\" (UniqueName: \"kubernetes.io/projected/908f7141-1b21-4885-b80f-18828d5fa922-kube-api-access-tt9zh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.859164 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.858778    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.862827 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.862804    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"]
Jul 28 14:11:44.959387 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.959353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908f7141-1b21-4885-b80f-18828d5fa922-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.959552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.959410    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.959552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.959429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.959552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.959453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9zh\" (UniqueName: \"kubernetes.io/projected/908f7141-1b21-4885-b80f-18828d5fa922-kube-api-access-tt9zh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.959552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.959478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.959552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.959502    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.959986 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.959959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.960109 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.960010    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.960109 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.960039    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.961913 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.961889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908f7141-1b21-4885-b80f-18828d5fa922-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.962001 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.961956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908f7141-1b21-4885-b80f-18828d5fa922-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:44.970587 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:44.970563    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9zh\" (UniqueName: \"kubernetes.io/projected/908f7141-1b21-4885-b80f-18828d5fa922-kube-api-access-tt9zh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm\" (UID: \"908f7141-1b21-4885-b80f-18828d5fa922\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:45.162669 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:45.162634    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:45.305296 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:45.300246    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"]
Jul 28 14:11:45.305697 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:11:45.305546    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908f7141_1b21_4885_b80f_18828d5fa922.slice/crio-0941caf12fd38d7a82b60952f94e20a9cf579cf69292eaad4c8a36d58f74c50b WatchSource:0}: Error finding container 0941caf12fd38d7a82b60952f94e20a9cf579cf69292eaad4c8a36d58f74c50b: Status 404 returned error can't find the container with id 0941caf12fd38d7a82b60952f94e20a9cf579cf69292eaad4c8a36d58f74c50b
Jul 28 14:11:46.073834 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:46.073767    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm" event={"ID":"908f7141-1b21-4885-b80f-18828d5fa922","Type":"ContainerStarted","Data":"36ac4567793b775b1829eeb9b93fa54399ba086bfdeb2a7325f24b88580ba08d"}
Jul 28 14:11:46.074248 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:46.073856    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm" event={"ID":"908f7141-1b21-4885-b80f-18828d5fa922","Type":"ContainerStarted","Data":"0941caf12fd38d7a82b60952f94e20a9cf579cf69292eaad4c8a36d58f74c50b"}
Jul 28 14:11:46.097579 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:46.097525    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm" podStartSLOduration=1.903968865 podStartE2EDuration="2.097509529s" totalImagesPullingTime="193.540664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:11:46.09634885 +0000 UTC m=+715.315150906" watchObservedRunningTime="2026-07-28 14:11:46.097509529 +0000 UTC m=+715.316311575"
Jul 28 14:11:55.163214 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:55.163177    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:55.163632 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:55.163271    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:55.175774 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:55.175747    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:56.047712 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.047680    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"]
Jul 28 14:11:56.050153 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.050132    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.053266 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.053248    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 28 14:11:56.061900 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.061875    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"]
Jul 28 14:11:56.131867 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.131839    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm"
Jul 28 14:11:56.150914 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.150879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.151077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.150919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w54p2\" (UniqueName: \"kubernetes.io/projected/20dddab8-589a-4433-925d-f10efb806a6f-kube-api-access-w54p2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.151077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.150950    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.151077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.150984    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.151077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.151039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20dddab8-589a-4433-925d-f10efb806a6f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.151077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.151074    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.252268 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.252268 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252272    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w54p2\" (UniqueName: \"kubernetes.io/projected/20dddab8-589a-4433-925d-f10efb806a6f-kube-api-access-w54p2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.252829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.252829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252319    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.252829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20dddab8-589a-4433-925d-f10efb806a6f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.252829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.252829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252718    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.253016 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252843    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.253016 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.252894    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.254625 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.254600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20dddab8-589a-4433-925d-f10efb806a6f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.254857 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.254834    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20dddab8-589a-4433-925d-f10efb806a6f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.263288 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.263238    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w54p2\" (UniqueName: \"kubernetes.io/projected/20dddab8-589a-4433-925d-f10efb806a6f-kube-api-access-w54p2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cflh\" (UID: \"20dddab8-589a-4433-925d-f10efb806a6f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.360359 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.360260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:11:56.524254 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:56.524216    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"]
Jul 28 14:11:56.527146 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:11:56.527119    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20dddab8_589a_4433_925d_f10efb806a6f.slice/crio-b98c6a62bde2f59139d6bcd9e195ee6dce9d1ca56533fef2527a78555f4ef203 WatchSource:0}: Error finding container b98c6a62bde2f59139d6bcd9e195ee6dce9d1ca56533fef2527a78555f4ef203: Status 404 returned error can't find the container with id b98c6a62bde2f59139d6bcd9e195ee6dce9d1ca56533fef2527a78555f4ef203
Jul 28 14:11:57.125960 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:57.125927    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh" event={"ID":"20dddab8-589a-4433-925d-f10efb806a6f","Type":"ContainerStarted","Data":"71f35b9b8b7c881f1723a55cf8382fbd0c71090277a65661548f32ee67095de3"}
Jul 28 14:11:57.126129 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:57.125974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh" event={"ID":"20dddab8-589a-4433-925d-f10efb806a6f","Type":"ContainerStarted","Data":"b98c6a62bde2f59139d6bcd9e195ee6dce9d1ca56533fef2527a78555f4ef203"}
Jul 28 14:11:57.149823 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:11:57.149755    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh" podStartSLOduration=0.735274362 podStartE2EDuration="1.149738783s" totalImagesPullingTime="414.464421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:11:57.148407551 +0000 UTC m=+726.367209589" watchObservedRunningTime="2026-07-28 14:11:57.149738783 +0000 UTC m=+726.368540829"
Jul 28 14:12:06.360753 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:06.360711    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:12:06.361243 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:06.360814    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:12:06.373549 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:06.373515    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:12:07.185509 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:07.185480    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cflh"
Jul 28 14:12:08.336399 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.336344    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"]
Jul 28 14:12:08.341030 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.340997    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.344319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.344293    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 28 14:12:08.355752 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.352582    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"]
Jul 28 14:12:08.457764 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.457723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.457943 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.457814    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.457943 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.457831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.457943 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.457850    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.457943 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.457880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f24bx\" (UniqueName: \"kubernetes.io/projected/d251c37a-2a77-4cee-bfe4-690d648c8e33-kube-api-access-f24bx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.458077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.457968    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d251c37a-2a77-4cee-bfe4-690d648c8e33-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.558565 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.558529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.558737 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.558660    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.558737 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.558678    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.558737 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.558697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.558737 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.558719    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f24bx\" (UniqueName: \"kubernetes.io/projected/d251c37a-2a77-4cee-bfe4-690d648c8e33-kube-api-access-f24bx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.558976 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.558753    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d251c37a-2a77-4cee-bfe4-690d648c8e33-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.559073 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.559044    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.559128 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.559067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.559128 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.559100    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.561070 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.561043    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d251c37a-2a77-4cee-bfe4-690d648c8e33-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.561321 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.561303    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d251c37a-2a77-4cee-bfe4-690d648c8e33-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.571020 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.570993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f24bx\" (UniqueName: \"kubernetes.io/projected/d251c37a-2a77-4cee-bfe4-690d648c8e33-kube-api-access-f24bx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg\" (UID: \"d251c37a-2a77-4cee-bfe4-690d648c8e33\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.657138 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.657100    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:08.800950 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:08.800919    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"]
Jul 28 14:12:08.804563 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:12:08.804536    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd251c37a_2a77_4cee_bfe4_690d648c8e33.slice/crio-b07d95b5791c71570ea5142c046aeed40c3655bdd9871dd0c3753a2ba5011def WatchSource:0}: Error finding container b07d95b5791c71570ea5142c046aeed40c3655bdd9871dd0c3753a2ba5011def: Status 404 returned error can't find the container with id b07d95b5791c71570ea5142c046aeed40c3655bdd9871dd0c3753a2ba5011def
Jul 28 14:12:09.184089 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:09.184050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg" event={"ID":"d251c37a-2a77-4cee-bfe4-690d648c8e33","Type":"ContainerStarted","Data":"533e6b2dd33fd7382ce9f834cc8bbfd45508a832098c3dcd818b657ad3ebd8dd"}
Jul 28 14:12:09.184283 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:09.184100    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg" event={"ID":"d251c37a-2a77-4cee-bfe4-690d648c8e33","Type":"ContainerStarted","Data":"b07d95b5791c71570ea5142c046aeed40c3655bdd9871dd0c3753a2ba5011def"}
Jul 28 14:12:09.210743 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:09.210692    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg" podStartSLOduration=1.025671401 podStartE2EDuration="1.210675677s" totalImagesPullingTime="185.004276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:12:09.208255619 +0000 UTC m=+738.427057666" watchObservedRunningTime="2026-07-28 14:12:09.210675677 +0000 UTC m=+738.429477701"
Jul 28 14:12:18.658211 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:18.658169    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:18.658600 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:18.658227    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:18.670618 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:18.670587    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:12:19.238728 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:12:19.238698    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg"
Jul 28 14:14:34.185433 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.185398    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-nqkpm"]
Jul 28 14:14:34.186043 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.185659    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm" podUID="960cf587-25b1-4de7-89be-69c606fd92bc" containerName="manager" containerID="cri-o://eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28" gracePeriod=30
Jul 28 14:14:34.434178 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.434156    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:14:34.549146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.549036    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-metrics-certs\") pod \"960cf587-25b1-4de7-89be-69c606fd92bc\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") "
Jul 28 14:14:34.549146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.549132    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndvkk\" (UniqueName: \"kubernetes.io/projected/960cf587-25b1-4de7-89be-69c606fd92bc-kube-api-access-ndvkk\") pod \"960cf587-25b1-4de7-89be-69c606fd92bc\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") "
Jul 28 14:14:34.549374 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.549301    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-webhook-cert\") pod \"960cf587-25b1-4de7-89be-69c606fd92bc\" (UID: \"960cf587-25b1-4de7-89be-69c606fd92bc\") "
Jul 28 14:14:34.551134 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.551098    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "960cf587-25b1-4de7-89be-69c606fd92bc" (UID: "960cf587-25b1-4de7-89be-69c606fd92bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:14:34.551238 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.551153    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "960cf587-25b1-4de7-89be-69c606fd92bc" (UID: "960cf587-25b1-4de7-89be-69c606fd92bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:14:34.551238 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.551166    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960cf587-25b1-4de7-89be-69c606fd92bc-kube-api-access-ndvkk" (OuterVolumeSpecName: "kube-api-access-ndvkk") pod "960cf587-25b1-4de7-89be-69c606fd92bc" (UID: "960cf587-25b1-4de7-89be-69c606fd92bc"). InnerVolumeSpecName "kube-api-access-ndvkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:14:34.650054 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.650002    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-metrics-certs\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:14:34.650054 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.650047    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndvkk\" (UniqueName: \"kubernetes.io/projected/960cf587-25b1-4de7-89be-69c606fd92bc-kube-api-access-ndvkk\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:14:34.650054 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.650058    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960cf587-25b1-4de7-89be-69c606fd92bc-webhook-cert\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:14:34.823692 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.823606    2571 generic.go:356] "Generic (PLEG): container finished" podID="960cf587-25b1-4de7-89be-69c606fd92bc" containerID="eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28" exitCode=0
Jul 28 14:14:34.823692 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.823667    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm"
Jul 28 14:14:34.823913 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.823689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm" event={"ID":"960cf587-25b1-4de7-89be-69c606fd92bc","Type":"ContainerDied","Data":"eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28"}
Jul 28 14:14:34.823913 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.823764    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-nqkpm" event={"ID":"960cf587-25b1-4de7-89be-69c606fd92bc","Type":"ContainerDied","Data":"05c1ec64beb6e7e2078761540d2873be8ed20d043c5422b9a16947286fc57b46"}
Jul 28 14:14:34.823913 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.823800    2571 scope.go:117] "RemoveContainer" containerID="eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28"
Jul 28 14:14:34.832754 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.832738    2571 scope.go:117] "RemoveContainer" containerID="eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28"
Jul 28 14:14:34.833044 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:14:34.833026    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28\": container with ID starting with eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28 not found: ID does not exist" containerID="eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28"
Jul 28 14:14:34.833085 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.833054    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28"} err="failed to get container status \"eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28\": rpc error: code = NotFound desc = could not find container \"eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28\": container with ID starting with eb3831db592b176d2d071496de2d71a32c64d8e2132f1b2f16269bb64098ed28 not found: ID does not exist"
Jul 28 14:14:34.848230 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.848197    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-nqkpm"]
Jul 28 14:14:34.850669 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:34.850640    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-nqkpm"]
Jul 28 14:14:35.343053 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:14:35.343012    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960cf587-25b1-4de7-89be-69c606fd92bc" path="/var/lib/kubelet/pods/960cf587-25b1-4de7-89be-69c606fd92bc/volumes"
Jul 28 14:15:35.717972 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.717932    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-vbkrv"]
Jul 28 14:15:35.718567 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.718436    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960cf587-25b1-4de7-89be-69c606fd92bc" containerName="manager"
Jul 28 14:15:35.718567 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.718457    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="960cf587-25b1-4de7-89be-69c606fd92bc" containerName="manager"
Jul 28 14:15:35.718567 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.718537    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="960cf587-25b1-4de7-89be-69c606fd92bc" containerName="manager"
Jul 28 14:15:35.721779 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.721742    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.727265 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.727031    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 14:15:35.727265 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.727077    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Jul 28 14:15:35.727265 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.727104    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 14:15:35.727265 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.727031    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xqb84\""
Jul 28 14:15:35.735129 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.735102    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-vbkrv"]
Jul 28 14:15:35.776880 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.776847    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-webhook-cert\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.776880 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.776895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-metrics-certs\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.777157 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.776937    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gww7s\" (UniqueName: \"kubernetes.io/projected/129babc7-6909-42cc-97e6-3f3da3797ad1-kube-api-access-gww7s\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.878066 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.878027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-webhook-cert\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.878229 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.878091    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-metrics-certs\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.878229 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.878137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww7s\" (UniqueName: \"kubernetes.io/projected/129babc7-6909-42cc-97e6-3f3da3797ad1-kube-api-access-gww7s\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.880632 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.880599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-metrics-certs\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.880632 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.880619    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-webhook-cert\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:35.888685 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:35.888659    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gww7s\" (UniqueName: \"kubernetes.io/projected/129babc7-6909-42cc-97e6-3f3da3797ad1-kube-api-access-gww7s\") pod \"maas-controller-7f8dcf4b8-vbkrv\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") " pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:36.033011 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:36.032910    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:36.181577 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:36.181467    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-vbkrv"]
Jul 28 14:15:36.184543 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:15:36.184514    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129babc7_6909_42cc_97e6_3f3da3797ad1.slice/crio-a7fb1a40bb6f07e1ec8722946a5314fbf498a5d78d2a00c47d3144bf843a2d4c WatchSource:0}: Error finding container a7fb1a40bb6f07e1ec8722946a5314fbf498a5d78d2a00c47d3144bf843a2d4c: Status 404 returned error can't find the container with id a7fb1a40bb6f07e1ec8722946a5314fbf498a5d78d2a00c47d3144bf843a2d4c
Jul 28 14:15:37.097032 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:37.096997    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv" event={"ID":"129babc7-6909-42cc-97e6-3f3da3797ad1","Type":"ContainerStarted","Data":"cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055"}
Jul 28 14:15:37.097414 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:37.097084    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv" event={"ID":"129babc7-6909-42cc-97e6-3f3da3797ad1","Type":"ContainerStarted","Data":"a7fb1a40bb6f07e1ec8722946a5314fbf498a5d78d2a00c47d3144bf843a2d4c"}
Jul 28 14:15:37.097414 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:37.097122    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:37.118713 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:37.118655    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv" podStartSLOduration=1.674763947 podStartE2EDuration="2.118638829s" totalImagesPullingTime="443.874882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:15:37.117320279 +0000 UTC m=+946.336122339" watchObservedRunningTime="2026-07-28 14:15:37.118638829 +0000 UTC m=+946.337440874"
Jul 28 14:15:48.103646 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:48.103615    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:52.921660 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:52.921628    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-vbkrv"]
Jul 28 14:15:52.922086 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:52.921833    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv" podUID="129babc7-6909-42cc-97e6-3f3da3797ad1" containerName="manager" containerID="cri-o://cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055" gracePeriod=30
Jul 28 14:15:53.165874 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.165846    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:53.168833 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.168803    2571 generic.go:356] "Generic (PLEG): container finished" podID="129babc7-6909-42cc-97e6-3f3da3797ad1" containerID="cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055" exitCode=0
Jul 28 14:15:53.168941 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.168851    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv"
Jul 28 14:15:53.168941 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.168878    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv" event={"ID":"129babc7-6909-42cc-97e6-3f3da3797ad1","Type":"ContainerDied","Data":"cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055"}
Jul 28 14:15:53.169043 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.168948    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-vbkrv" event={"ID":"129babc7-6909-42cc-97e6-3f3da3797ad1","Type":"ContainerDied","Data":"a7fb1a40bb6f07e1ec8722946a5314fbf498a5d78d2a00c47d3144bf843a2d4c"}
Jul 28 14:15:53.169043 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.168962    2571 scope.go:117] "RemoveContainer" containerID="cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055"
Jul 28 14:15:53.176984 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.176965    2571 scope.go:117] "RemoveContainer" containerID="cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055"
Jul 28 14:15:53.177223 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:15:53.177203    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055\": container with ID starting with cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055 not found: ID does not exist" containerID="cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055"
Jul 28 14:15:53.177271 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.177233    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055"} err="failed to get container status \"cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055\": rpc error: code = NotFound desc = could not find container \"cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055\": container with ID starting with cd4bd2fec62a625af5dc7d20015c4bce49b474ef0fe5feb4ccdfb9509f4dc055 not found: ID does not exist"
Jul 28 14:15:53.211291 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.211265    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-webhook-cert\") pod \"129babc7-6909-42cc-97e6-3f3da3797ad1\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") "
Jul 28 14:15:53.211462 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.211325    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gww7s\" (UniqueName: \"kubernetes.io/projected/129babc7-6909-42cc-97e6-3f3da3797ad1-kube-api-access-gww7s\") pod \"129babc7-6909-42cc-97e6-3f3da3797ad1\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") "
Jul 28 14:15:53.211462 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.211453    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-metrics-certs\") pod \"129babc7-6909-42cc-97e6-3f3da3797ad1\" (UID: \"129babc7-6909-42cc-97e6-3f3da3797ad1\") "
Jul 28 14:15:53.213386 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.213357    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "129babc7-6909-42cc-97e6-3f3da3797ad1" (UID: "129babc7-6909-42cc-97e6-3f3da3797ad1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:15:53.213506 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.213452    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/129babc7-6909-42cc-97e6-3f3da3797ad1-kube-api-access-gww7s" (OuterVolumeSpecName: "kube-api-access-gww7s") pod "129babc7-6909-42cc-97e6-3f3da3797ad1" (UID: "129babc7-6909-42cc-97e6-3f3da3797ad1"). InnerVolumeSpecName "kube-api-access-gww7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:15:53.213550 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.213498    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "129babc7-6909-42cc-97e6-3f3da3797ad1" (UID: "129babc7-6909-42cc-97e6-3f3da3797ad1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:15:53.312221 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.312186    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-metrics-certs\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:15:53.312221 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.312215    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/129babc7-6909-42cc-97e6-3f3da3797ad1-webhook-cert\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:15:53.312221 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.312225    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gww7s\" (UniqueName: \"kubernetes.io/projected/129babc7-6909-42cc-97e6-3f3da3797ad1-kube-api-access-gww7s\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:15:53.487561 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.487484    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-vbkrv"]
Jul 28 14:15:53.493864 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:53.493836    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-vbkrv"]
Jul 28 14:15:54.400825 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.400777    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-9d8wh"]
Jul 28 14:15:54.401192 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.401119    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="129babc7-6909-42cc-97e6-3f3da3797ad1" containerName="manager"
Jul 28 14:15:54.401192 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.401130    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="129babc7-6909-42cc-97e6-3f3da3797ad1" containerName="manager"
Jul 28 14:15:54.401192 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.401185    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="129babc7-6909-42cc-97e6-3f3da3797ad1" containerName="manager"
Jul 28 14:15:54.405231 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.405212    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.409832 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.409795    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Jul 28 14:15:54.409832 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.409812    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 14:15:54.410052 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.409842    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xqb84\""
Jul 28 14:15:54.410052 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.409914    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 14:15:54.420012 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.419990    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-9d8wh"]
Jul 28 14:15:54.423182 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.423158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db98da70-2906-426e-8865-054171e73bf3-webhook-cert\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.423406 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.423377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv69b\" (UniqueName: \"kubernetes.io/projected/db98da70-2906-426e-8865-054171e73bf3-kube-api-access-nv69b\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.423515 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.423437    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db98da70-2906-426e-8865-054171e73bf3-metrics-certs\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.524121 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.524079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv69b\" (UniqueName: \"kubernetes.io/projected/db98da70-2906-426e-8865-054171e73bf3-kube-api-access-nv69b\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.524302 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.524136    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db98da70-2906-426e-8865-054171e73bf3-metrics-certs\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.524302 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.524171    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db98da70-2906-426e-8865-054171e73bf3-webhook-cert\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.526591 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.526562    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db98da70-2906-426e-8865-054171e73bf3-webhook-cert\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.526707 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.526609    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db98da70-2906-426e-8865-054171e73bf3-metrics-certs\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.535556 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.535532    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv69b\" (UniqueName: \"kubernetes.io/projected/db98da70-2906-426e-8865-054171e73bf3-kube-api-access-nv69b\") pod \"maas-controller-7f8dcf4b8-9d8wh\" (UID: \"db98da70-2906-426e-8865-054171e73bf3\") " pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.716033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.715919    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:54.866471 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:54.866417    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8dcf4b8-9d8wh"]
Jul 28 14:15:54.869126 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:15:54.869093    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb98da70_2906_426e_8865_054171e73bf3.slice/crio-6b7aeccb9c9678729ba87d98e9244748491b5915cdd3774e282d9ef53e48bef0 WatchSource:0}: Error finding container 6b7aeccb9c9678729ba87d98e9244748491b5915cdd3774e282d9ef53e48bef0: Status 404 returned error can't find the container with id 6b7aeccb9c9678729ba87d98e9244748491b5915cdd3774e282d9ef53e48bef0
Jul 28 14:15:55.180224 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:55.180187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh" event={"ID":"db98da70-2906-426e-8865-054171e73bf3","Type":"ContainerStarted","Data":"6b7aeccb9c9678729ba87d98e9244748491b5915cdd3774e282d9ef53e48bef0"}
Jul 28 14:15:55.342947 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:55.342914    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="129babc7-6909-42cc-97e6-3f3da3797ad1" path="/var/lib/kubelet/pods/129babc7-6909-42cc-97e6-3f3da3797ad1/volumes"
Jul 28 14:15:56.187092 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:56.187052    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh" event={"ID":"db98da70-2906-426e-8865-054171e73bf3","Type":"ContainerStarted","Data":"bad454c7153ba5f28f4d95533d10965a73262f8c8f79db5fb369e304f91dcfd0"}
Jul 28 14:15:56.187565 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:56.187132    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:15:56.211377 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:15:56.211320    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh" podStartSLOduration=1.849007493 podStartE2EDuration="2.211305855s" totalImagesPullingTime="362.298362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:15:56.209574863 +0000 UTC m=+965.428376901" watchObservedRunningTime="2026-07-28 14:15:56.211305855 +0000 UTC m=+965.430107953"
Jul 28 14:16:07.194889 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:16:07.194850    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f8dcf4b8-9d8wh"
Jul 28 14:29:22.165947 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.165911    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"]
Jul 28 14:29:22.169368 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.169350    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.180813 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.180763    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7d901975-serving-cert\""
Jul 28 14:29:22.199030 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.198998    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"]
Jul 28 14:29:22.284673 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.284633    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.284886 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.284700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj67p\" (UniqueName: \"kubernetes.io/projected/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-kube-api-access-nj67p\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.284886 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.284752    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-openshift-service-ca\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.385420 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.385385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.385609 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.385445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj67p\" (UniqueName: \"kubernetes.io/projected/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-kube-api-access-nj67p\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.385609 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.385505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-openshift-service-ca\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.385609 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:29:22.385547    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-serving-cert: secret "maas-api-e2e-ait-7d901975-serving-cert" not found
Jul 28 14:29:22.385759 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:29:22.385625    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls podName:2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18 nodeName:}" failed. No retries permitted until 2026-07-28 14:29:22.885605066 +0000 UTC m=+1772.104407097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls") pod "maas-api-e2e-ait-7d901975-6cb994694c-bk65g" (UID: "2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18") : secret "maas-api-e2e-ait-7d901975-serving-cert" not found
Jul 28 14:29:22.386181 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.386162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-openshift-service-ca\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.399028 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.399003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj67p\" (UniqueName: \"kubernetes.io/projected/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-kube-api-access-nj67p\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.890814 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.890758    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:22.893105 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:22.893085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls\") pod \"maas-api-e2e-ait-7d901975-6cb994694c-bk65g\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:23.080980 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.080941    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:23.237266 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.237103    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"]
Jul 28 14:29:23.239545 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:29:23.239518    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6e8b5a_bb4f_47bb_9ef3_aa686bdeee18.slice/crio-023325b42abecbb87d6cb049679299e96ed327dcf36d3acd1094282fec910069 WatchSource:0}: Error finding container 023325b42abecbb87d6cb049679299e96ed327dcf36d3acd1094282fec910069: Status 404 returned error can't find the container with id 023325b42abecbb87d6cb049679299e96ed327dcf36d3acd1094282fec910069
Jul 28 14:29:23.241208 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.241187    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 14:29:23.242774 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.242754    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"]
Jul 28 14:29:23.247202 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.247184    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:23.256298 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.256277    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-7d901975\""
Jul 28 14:29:23.256418 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.256315    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-7d901975-dockercfg-g2vlk\""
Jul 28 14:29:23.265952 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.265924    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"]
Jul 28 14:29:23.318510 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.318478    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"]
Jul 28 14:29:23.321751 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.321732    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:23.346643 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.346613    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"]
Jul 28 14:29:23.394737 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.394705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtdp8\" (UniqueName: \"kubernetes.io/projected/a8d13451-049a-429c-8537-eed6c7b0dcfb-kube-api-access-rtdp8\") pod \"payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j\" (UID: \"a8d13451-049a-429c-8537-eed6c7b0dcfb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:23.394933 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.394812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d13451-049a-429c-8537-eed6c7b0dcfb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j\" (UID: \"a8d13451-049a-429c-8537-eed6c7b0dcfb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:23.496041 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.495949    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdp8\" (UniqueName: \"kubernetes.io/projected/a8d13451-049a-429c-8537-eed6c7b0dcfb-kube-api-access-rtdp8\") pod \"payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j\" (UID: \"a8d13451-049a-429c-8537-eed6c7b0dcfb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:23.496041 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.496015    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-plugins-config-volume\") pod \"payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7\" (UID: \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\") " pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:23.496241 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.496057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d13451-049a-429c-8537-eed6c7b0dcfb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j\" (UID: \"a8d13451-049a-429c-8537-eed6c7b0dcfb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:23.496241 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.496085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddrh\" (UniqueName: \"kubernetes.io/projected/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-kube-api-access-xddrh\") pod \"payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7\" (UID: \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\") " pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:23.496830 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.496812    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d13451-049a-429c-8537-eed6c7b0dcfb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j\" (UID: \"a8d13451-049a-429c-8537-eed6c7b0dcfb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:23.506904 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.506880    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtdp8\" (UniqueName: \"kubernetes.io/projected/a8d13451-049a-429c-8537-eed6c7b0dcfb-kube-api-access-rtdp8\") pod \"payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j\" (UID: \"a8d13451-049a-429c-8537-eed6c7b0dcfb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:23.557736 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.557699    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:23.597261 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.597217    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xddrh\" (UniqueName: \"kubernetes.io/projected/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-kube-api-access-xddrh\") pod \"payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7\" (UID: \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\") " pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:23.597430 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.597343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-plugins-config-volume\") pod \"payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7\" (UID: \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\") " pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:23.598105 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.598085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-plugins-config-volume\") pod \"payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7\" (UID: \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\") " pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:23.607866 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.607830    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddrh\" (UniqueName: \"kubernetes.io/projected/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-kube-api-access-xddrh\") pod \"payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7\" (UID: \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\") " pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:23.631663 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.631626    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:23.696764 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.696658    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"]
Jul 28 14:29:23.758347 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.758317    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g" event={"ID":"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18","Type":"ContainerStarted","Data":"023325b42abecbb87d6cb049679299e96ed327dcf36d3acd1094282fec910069"}
Jul 28 14:29:23.760472 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.760433    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j" event={"ID":"a8d13451-049a-429c-8537-eed6c7b0dcfb","Type":"ContainerStarted","Data":"00a850863459dd54fe6df65232b8a8bdbadad6aaba39e8df9e94a49f7df687df"}
Jul 28 14:29:23.785312 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:23.785287    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"]
Jul 28 14:29:23.787837 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:29:23.787814    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3c86d9_7436_4aa5_9dd5_fdcf2b852abc.slice/crio-87bb8b12f24696511cd10ffbc47baa2ac381b044a8b5c9a0cac4f2a73bc80efa WatchSource:0}: Error finding container 87bb8b12f24696511cd10ffbc47baa2ac381b044a8b5c9a0cac4f2a73bc80efa: Status 404 returned error can't find the container with id 87bb8b12f24696511cd10ffbc47baa2ac381b044a8b5c9a0cac4f2a73bc80efa
Jul 28 14:29:24.767142 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.767102    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g" event={"ID":"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18","Type":"ContainerStarted","Data":"2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10"}
Jul 28 14:29:24.767593 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.767206    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:24.768612 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.768590    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j" event={"ID":"a8d13451-049a-429c-8537-eed6c7b0dcfb","Type":"ContainerStarted","Data":"8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd"}
Jul 28 14:29:24.768726 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.768640    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:24.770040 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.770020    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7" event={"ID":"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc","Type":"ContainerStarted","Data":"12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f"}
Jul 28 14:29:24.770090 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.770058    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7" event={"ID":"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc","Type":"ContainerStarted","Data":"87bb8b12f24696511cd10ffbc47baa2ac381b044a8b5c9a0cac4f2a73bc80efa"}
Jul 28 14:29:24.770090 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.770081    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:24.788110 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.788064    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g" podStartSLOduration=2.098562315 podStartE2EDuration="2.788039292s" totalImagesPullingTime="689.476977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:29:24.786844124 +0000 UTC m=+1774.005646172" watchObservedRunningTime="2026-07-28 14:29:24.788039292 +0000 UTC m=+1774.006841339"
Jul 28 14:29:24.806673 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.806622    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j" podStartSLOduration=1.806607893 podStartE2EDuration="1.806607893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:29:24.805229045 +0000 UTC m=+1774.024031093" watchObservedRunningTime="2026-07-28 14:29:24.806607893 +0000 UTC m=+1774.025409939"
Jul 28 14:29:24.825646 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:24.825595    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7" podStartSLOduration=1.82557611 podStartE2EDuration="1.82557611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:29:24.8245667 +0000 UTC m=+1774.043368744" watchObservedRunningTime="2026-07-28 14:29:24.82557611 +0000 UTC m=+1774.044378159"
Jul 28 14:29:30.780934 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:30.780904    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:35.777560 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:35.777528    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:35.778050 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:35.777840    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:53.026916 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.026883    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"]
Jul 28 14:29:53.027303 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.027101    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g" podUID="2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" containerName="maas-api" containerID="cri-o://2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10" gracePeriod=30
Jul 28 14:29:53.100508 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.100475    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"]
Jul 28 14:29:53.100735 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.100708    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7" podUID="1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc" containerName="payload-processing" containerID="cri-o://12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f" gracePeriod=30
Jul 28 14:29:53.112859 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.112829    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"]
Jul 28 14:29:53.113089 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.113060    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j" podUID="a8d13451-049a-429c-8537-eed6c7b0dcfb" containerName="payload-pre-processing" containerID="cri-o://8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd" gracePeriod=30
Jul 28 14:29:53.397621 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.397597    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:53.400566 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.400546    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:53.424998 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.424965    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:53.463553 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.463507    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-plugins-config-volume\") pod \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\" (UID: \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\") "
Jul 28 14:29:53.463731 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.463565    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xddrh\" (UniqueName: \"kubernetes.io/projected/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-kube-api-access-xddrh\") pod \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\" (UID: \"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc\") "
Jul 28 14:29:53.463731 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.463600    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-openshift-service-ca\") pod \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") "
Jul 28 14:29:53.463731 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.463662    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj67p\" (UniqueName: \"kubernetes.io/projected/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-kube-api-access-nj67p\") pod \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") "
Jul 28 14:29:53.463731 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.463685    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls\") pod \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\" (UID: \"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18\") "
Jul 28 14:29:53.463964 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.463920    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc" (UID: "1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:29:53.464346 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.464172    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:29:53.464346 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.464337    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" (UID: "2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:29:53.466622 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.466592    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" (UID: "2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:29:53.466714 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.466637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-kube-api-access-xddrh" (OuterVolumeSpecName: "kube-api-access-xddrh") pod "1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc" (UID: "1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc"). InnerVolumeSpecName "kube-api-access-xddrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:29:53.466714 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.466687    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-kube-api-access-nj67p" (OuterVolumeSpecName: "kube-api-access-nj67p") pod "2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" (UID: "2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18"). InnerVolumeSpecName "kube-api-access-nj67p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:29:53.565293 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.565200    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d13451-049a-429c-8537-eed6c7b0dcfb-plugins-config-volume\") pod \"a8d13451-049a-429c-8537-eed6c7b0dcfb\" (UID: \"a8d13451-049a-429c-8537-eed6c7b0dcfb\") "
Jul 28 14:29:53.565456 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.565301    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtdp8\" (UniqueName: \"kubernetes.io/projected/a8d13451-049a-429c-8537-eed6c7b0dcfb-kube-api-access-rtdp8\") pod \"a8d13451-049a-429c-8537-eed6c7b0dcfb\" (UID: \"a8d13451-049a-429c-8537-eed6c7b0dcfb\") "
Jul 28 14:29:53.565456 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.565452    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xddrh\" (UniqueName: \"kubernetes.io/projected/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc-kube-api-access-xddrh\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:29:53.565578 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.565464    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:29:53.565578 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.565474    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj67p\" (UniqueName: \"kubernetes.io/projected/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-kube-api-access-nj67p\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:29:53.565578 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.565483    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:29:53.565718 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.565666    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8d13451-049a-429c-8537-eed6c7b0dcfb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8d13451-049a-429c-8537-eed6c7b0dcfb" (UID: "a8d13451-049a-429c-8537-eed6c7b0dcfb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:29:53.567278 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.567257    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8d13451-049a-429c-8537-eed6c7b0dcfb-kube-api-access-rtdp8" (OuterVolumeSpecName: "kube-api-access-rtdp8") pod "a8d13451-049a-429c-8537-eed6c7b0dcfb" (UID: "a8d13451-049a-429c-8537-eed6c7b0dcfb"). InnerVolumeSpecName "kube-api-access-rtdp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:29:53.666159 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.666121    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d13451-049a-429c-8537-eed6c7b0dcfb-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:29:53.666159 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.666152    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtdp8\" (UniqueName: \"kubernetes.io/projected/a8d13451-049a-429c-8537-eed6c7b0dcfb-kube-api-access-rtdp8\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:29:53.902132 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.902098    2571 generic.go:356] "Generic (PLEG): container finished" podID="2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" containerID="2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10" exitCode=0
Jul 28 14:29:53.902302 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.902143    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"
Jul 28 14:29:53.902302 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.902187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g" event={"ID":"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18","Type":"ContainerDied","Data":"2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10"}
Jul 28 14:29:53.902302 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.902251    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g" event={"ID":"2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18","Type":"ContainerDied","Data":"023325b42abecbb87d6cb049679299e96ed327dcf36d3acd1094282fec910069"}
Jul 28 14:29:53.902302 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.902281    2571 scope.go:117] "RemoveContainer" containerID="2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10"
Jul 28 14:29:53.903583 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.903554    2571 generic.go:356] "Generic (PLEG): container finished" podID="a8d13451-049a-429c-8537-eed6c7b0dcfb" containerID="8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd" exitCode=0
Jul 28 14:29:53.903701 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.903598    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"
Jul 28 14:29:53.903701 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.903632    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j" event={"ID":"a8d13451-049a-429c-8537-eed6c7b0dcfb","Type":"ContainerDied","Data":"8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd"}
Jul 28 14:29:53.903701 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.903685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j" event={"ID":"a8d13451-049a-429c-8537-eed6c7b0dcfb","Type":"ContainerDied","Data":"00a850863459dd54fe6df65232b8a8bdbadad6aaba39e8df9e94a49f7df687df"}
Jul 28 14:29:53.905411 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.905386    2571 generic.go:356] "Generic (PLEG): container finished" podID="1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc" containerID="12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f" exitCode=0
Jul 28 14:29:53.905524 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.905425    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7" event={"ID":"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc","Type":"ContainerDied","Data":"12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f"}
Jul 28 14:29:53.905524 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.905432    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"
Jul 28 14:29:53.905524 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.905464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7" event={"ID":"1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc","Type":"ContainerDied","Data":"87bb8b12f24696511cd10ffbc47baa2ac381b044a8b5c9a0cac4f2a73bc80efa"}
Jul 28 14:29:53.916378 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.916359    2571 scope.go:117] "RemoveContainer" containerID="2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10"
Jul 28 14:29:53.916662 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:29:53.916642    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10\": container with ID starting with 2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10 not found: ID does not exist" containerID="2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10"
Jul 28 14:29:53.916727 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.916671    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10"} err="failed to get container status \"2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10\": rpc error: code = NotFound desc = could not find container \"2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10\": container with ID starting with 2577bc32fb1e2281567a0c12bd6eab9be3abcd1306b968eb3d282cb8101dea10 not found: ID does not exist"
Jul 28 14:29:53.916727 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.916688    2571 scope.go:117] "RemoveContainer" containerID="8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd"
Jul 28 14:29:53.926298 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.926279    2571 scope.go:117] "RemoveContainer" containerID="8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd"
Jul 28 14:29:53.926588 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:29:53.926563    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd\": container with ID starting with 8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd not found: ID does not exist" containerID="8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd"
Jul 28 14:29:53.926635 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.926598    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd"} err="failed to get container status \"8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd\": rpc error: code = NotFound desc = could not find container \"8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd\": container with ID starting with 8fc373111b2a07da4a09ab83246cc83aad1135d5bc27dba8c7215c3a9f0302bd not found: ID does not exist"
Jul 28 14:29:53.926635 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.926618    2571 scope.go:117] "RemoveContainer" containerID="12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f"
Jul 28 14:29:53.934887 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.934866    2571 scope.go:117] "RemoveContainer" containerID="12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f"
Jul 28 14:29:53.935177 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:29:53.935157    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f\": container with ID starting with 12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f not found: ID does not exist" containerID="12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f"
Jul 28 14:29:53.935223 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.935186    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f"} err="failed to get container status \"12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f\": rpc error: code = NotFound desc = could not find container \"12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f\": container with ID starting with 12e2b2c59331772d89bb5f11650493df174473a021a785091e47b375f585530f not found: ID does not exist"
Jul 28 14:29:53.950399 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.950368    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"]
Jul 28 14:29:53.954355 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.954329    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7d901975-75f9b7dd56-8rl2j"]
Jul 28 14:29:53.976975 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.976939    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"]
Jul 28 14:29:53.986651 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:53.986617    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d901975-6cb994694c-bk65g"]
Jul 28 14:29:54.004095 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:54.004051    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"]
Jul 28 14:29:54.007582 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:54.007558    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7d901975-64f47745bd-d2cd7"]
Jul 28 14:29:55.343162 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:55.343120    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc" path="/var/lib/kubelet/pods/1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc/volumes"
Jul 28 14:29:55.343707 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:55.343685    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" path="/var/lib/kubelet/pods/2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18/volumes"
Jul 28 14:29:55.344113 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:55.344093    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8d13451-049a-429c-8537-eed6c7b0dcfb" path="/var/lib/kubelet/pods/a8d13451-049a-429c-8537-eed6c7b0dcfb/volumes"
Jul 28 14:29:57.346661 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.346632    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"]
Jul 28 14:29:57.347827 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.347780    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" containerName="maas-api"
Jul 28 14:29:57.347951 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.347941    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" containerName="maas-api"
Jul 28 14:29:57.348053 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.348044    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8d13451-049a-429c-8537-eed6c7b0dcfb" containerName="payload-pre-processing"
Jul 28 14:29:57.348121 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.348113    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8d13451-049a-429c-8537-eed6c7b0dcfb" containerName="payload-pre-processing"
Jul 28 14:29:57.348204 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.348194    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc" containerName="payload-processing"
Jul 28 14:29:57.348268 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.348260    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc" containerName="payload-processing"
Jul 28 14:29:57.348438 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.348429    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3c86d9-7436-4aa5-9dd5-fdcf2b852abc" containerName="payload-processing"
Jul 28 14:29:57.348517 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.348508    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c6e8b5a-bb4f-47bb-9ef3-aa686bdeee18" containerName="maas-api"
Jul 28 14:29:57.348585 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.348577    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8d13451-049a-429c-8537-eed6c7b0dcfb" containerName="payload-pre-processing"
Jul 28 14:29:57.357706 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.354122    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.357706 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.357389    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"]
Jul 28 14:29:57.359208 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.358742    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-d2089a60-serving-cert\""
Jul 28 14:29:57.496518 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.496481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.496704 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.496529    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xj48\" (UniqueName: \"kubernetes.io/projected/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-kube-api-access-2xj48\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.496704 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.496569    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-maas-api-tls\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.597703 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.597608    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.597703 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.597650    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xj48\" (UniqueName: \"kubernetes.io/projected/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-kube-api-access-2xj48\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.597703 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.597688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-maas-api-tls\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.598373 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.598348    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-openshift-service-ca\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.600168 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.600149    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-maas-api-tls\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.608453 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.608431    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xj48\" (UniqueName: \"kubernetes.io/projected/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-kube-api-access-2xj48\") pod \"maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:57.668307 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:57.668270    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:58.027409 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.027375    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"]
Jul 28 14:29:58.029994 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:29:58.029960    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34b88e3_2aa8_4b82_8b7c_19562b7bd1e6.slice/crio-8ca39af2346a277540f6f3e436a662ed2049a7e2a70054349db435807d984ec3 WatchSource:0}: Error finding container 8ca39af2346a277540f6f3e436a662ed2049a7e2a70054349db435807d984ec3: Status 404 returned error can't find the container with id 8ca39af2346a277540f6f3e436a662ed2049a7e2a70054349db435807d984ec3
Jul 28 14:29:58.267077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.267041    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"]
Jul 28 14:29:58.271558 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.271541    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.275114 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.275090    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d2089a60\""
Jul 28 14:29:58.275229 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.275134    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d2089a60-dockercfg-f2nrz\""
Jul 28 14:29:58.287912 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.287886    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"]
Jul 28 14:29:58.404958 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.404919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnmcd\" (UniqueName: \"kubernetes.io/projected/2d940f06-2b10-479d-9edf-40ebc211017f-kube-api-access-rnmcd\") pod \"payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc\" (UID: \"2d940f06-2b10-479d-9edf-40ebc211017f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.405332 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.404973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d940f06-2b10-479d-9edf-40ebc211017f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc\" (UID: \"2d940f06-2b10-479d-9edf-40ebc211017f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.505980 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.505942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmcd\" (UniqueName: \"kubernetes.io/projected/2d940f06-2b10-479d-9edf-40ebc211017f-kube-api-access-rnmcd\") pod \"payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc\" (UID: \"2d940f06-2b10-479d-9edf-40ebc211017f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.506146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.505990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d940f06-2b10-479d-9edf-40ebc211017f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc\" (UID: \"2d940f06-2b10-479d-9edf-40ebc211017f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.506659 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.506640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d940f06-2b10-479d-9edf-40ebc211017f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc\" (UID: \"2d940f06-2b10-479d-9edf-40ebc211017f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.518323 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.518296    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmcd\" (UniqueName: \"kubernetes.io/projected/2d940f06-2b10-479d-9edf-40ebc211017f-kube-api-access-rnmcd\") pod \"payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc\" (UID: \"2d940f06-2b10-479d-9edf-40ebc211017f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.582607 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.582579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.733239 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.733166    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"]
Jul 28 14:29:58.736976 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:29:58.736932    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d940f06_2b10_479d_9edf_40ebc211017f.slice/crio-cdd90a27e7d730dac5fd9c1c5f65ae82787472e5783692b2507e95ada49fc703 WatchSource:0}: Error finding container cdd90a27e7d730dac5fd9c1c5f65ae82787472e5783692b2507e95ada49fc703: Status 404 returned error can't find the container with id cdd90a27e7d730dac5fd9c1c5f65ae82787472e5783692b2507e95ada49fc703
Jul 28 14:29:58.939027 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.938978    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc" event={"ID":"2d940f06-2b10-479d-9edf-40ebc211017f","Type":"ContainerStarted","Data":"31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d"}
Jul 28 14:29:58.939183 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.939051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc" event={"ID":"2d940f06-2b10-479d-9edf-40ebc211017f","Type":"ContainerStarted","Data":"cdd90a27e7d730dac5fd9c1c5f65ae82787472e5783692b2507e95ada49fc703"}
Jul 28 14:29:58.939183 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.939081    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:29:58.940598 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.940567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng" event={"ID":"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6","Type":"ContainerStarted","Data":"6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d"}
Jul 28 14:29:58.940753 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.940614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng" event={"ID":"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6","Type":"ContainerStarted","Data":"8ca39af2346a277540f6f3e436a662ed2049a7e2a70054349db435807d984ec3"}
Jul 28 14:29:58.940753 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.940690    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:29:58.964920 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.964866    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc" podStartSLOduration=0.964849807 podStartE2EDuration="964.849807ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:29:58.964547802 +0000 UTC m=+1808.183349850" watchObservedRunningTime="2026-07-28 14:29:58.964849807 +0000 UTC m=+1808.183651847"
Jul 28 14:29:58.989679 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:29:58.989617    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng" podStartSLOduration=1.471517182 podStartE2EDuration="1.989598341s" totalImagesPullingTime="518.081159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:29:58.989129069 +0000 UTC m=+1808.207931131" watchObservedRunningTime="2026-07-28 14:29:58.989598341 +0000 UTC m=+1808.208400389"
Jul 28 14:30:04.950429 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:04.950397    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:30:09.947118 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:09.947085    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:30:17.575630 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.575596    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"]
Jul 28 14:30:17.576148 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.575881    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng" podUID="a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" containerName="maas-api" containerID="cri-o://6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d" gracePeriod=30
Jul 28 14:30:17.733575 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.733536    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"]
Jul 28 14:30:17.733858 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.733806    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc" podUID="2d940f06-2b10-479d-9edf-40ebc211017f" containerName="payload-pre-processing" containerID="cri-o://31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d" gracePeriod=30
Jul 28 14:30:17.858945 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.858915    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:30:17.981253 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.981226    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:30:17.983258 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.983233    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xj48\" (UniqueName: \"kubernetes.io/projected/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-kube-api-access-2xj48\") pod \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") "
Jul 28 14:30:17.983380 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.983308    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-openshift-service-ca\") pod \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") "
Jul 28 14:30:17.983380 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.983337    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-maas-api-tls\") pod \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\" (UID: \"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6\") "
Jul 28 14:30:17.983654 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.983631    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" (UID: "a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:30:17.985305 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.985287    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-kube-api-access-2xj48" (OuterVolumeSpecName: "kube-api-access-2xj48") pod "a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" (UID: "a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6"). InnerVolumeSpecName "kube-api-access-2xj48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:30:17.985361 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:17.985304    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" (UID: "a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:30:18.024088 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.024057    2571 generic.go:356] "Generic (PLEG): container finished" podID="a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" containerID="6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d" exitCode=0
Jul 28 14:30:18.024253 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.024096    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"
Jul 28 14:30:18.024253 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.024141    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng" event={"ID":"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6","Type":"ContainerDied","Data":"6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d"}
Jul 28 14:30:18.024253 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.024209    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng" event={"ID":"a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6","Type":"ContainerDied","Data":"8ca39af2346a277540f6f3e436a662ed2049a7e2a70054349db435807d984ec3"}
Jul 28 14:30:18.024253 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.024232    2571 scope.go:117] "RemoveContainer" containerID="6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d"
Jul 28 14:30:18.025513 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.025487    2571 generic.go:356] "Generic (PLEG): container finished" podID="2d940f06-2b10-479d-9edf-40ebc211017f" containerID="31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d" exitCode=0
Jul 28 14:30:18.025594 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.025542    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"
Jul 28 14:30:18.025671 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.025573    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc" event={"ID":"2d940f06-2b10-479d-9edf-40ebc211017f","Type":"ContainerDied","Data":"31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d"}
Jul 28 14:30:18.025728 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.025704    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc" event={"ID":"2d940f06-2b10-479d-9edf-40ebc211017f","Type":"ContainerDied","Data":"cdd90a27e7d730dac5fd9c1c5f65ae82787472e5783692b2507e95ada49fc703"}
Jul 28 14:30:18.033980 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.033964    2571 scope.go:117] "RemoveContainer" containerID="6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d"
Jul 28 14:30:18.034237 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:30:18.034220    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d\": container with ID starting with 6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d not found: ID does not exist" containerID="6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d"
Jul 28 14:30:18.034305 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.034244    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d"} err="failed to get container status \"6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d\": rpc error: code = NotFound desc = could not find container \"6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d\": container with ID starting with 6921e36fb22b8e76f81f0b376015a6a0d6745e383fa70cd2e06cf24242a81e0d not found: ID does not exist"
Jul 28 14:30:18.034305 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.034261    2571 scope.go:117] "RemoveContainer" containerID="31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d"
Jul 28 14:30:18.042974 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.042949    2571 scope.go:117] "RemoveContainer" containerID="31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d"
Jul 28 14:30:18.043267 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:30:18.043247    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d\": container with ID starting with 31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d not found: ID does not exist" containerID="31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d"
Jul 28 14:30:18.043319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.043278    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d"} err="failed to get container status \"31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d\": rpc error: code = NotFound desc = could not find container \"31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d\": container with ID starting with 31baa5c371071ff5668790f88816a8211032e4a164e710e823e14f5e4408c40d not found: ID does not exist"
Jul 28 14:30:18.069501 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.069467    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"]
Jul 28 14:30:18.072102 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.072078    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d2089a60-74ffb8fb76-l5vng"]
Jul 28 14:30:18.084454 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.084431    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnmcd\" (UniqueName: \"kubernetes.io/projected/2d940f06-2b10-479d-9edf-40ebc211017f-kube-api-access-rnmcd\") pod \"2d940f06-2b10-479d-9edf-40ebc211017f\" (UID: \"2d940f06-2b10-479d-9edf-40ebc211017f\") "
Jul 28 14:30:18.084583 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.084498    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d940f06-2b10-479d-9edf-40ebc211017f-plugins-config-volume\") pod \"2d940f06-2b10-479d-9edf-40ebc211017f\" (UID: \"2d940f06-2b10-479d-9edf-40ebc211017f\") "
Jul 28 14:30:18.084755 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.084737    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:30:18.084816 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.084761    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:30:18.084816 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.084777    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xj48\" (UniqueName: \"kubernetes.io/projected/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6-kube-api-access-2xj48\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:30:18.084920 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.084903    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d940f06-2b10-479d-9edf-40ebc211017f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d940f06-2b10-479d-9edf-40ebc211017f" (UID: "2d940f06-2b10-479d-9edf-40ebc211017f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:30:18.086482 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.086461    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d940f06-2b10-479d-9edf-40ebc211017f-kube-api-access-rnmcd" (OuterVolumeSpecName: "kube-api-access-rnmcd") pod "2d940f06-2b10-479d-9edf-40ebc211017f" (UID: "2d940f06-2b10-479d-9edf-40ebc211017f"). InnerVolumeSpecName "kube-api-access-rnmcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:30:18.186163 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.186132    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d940f06-2b10-479d-9edf-40ebc211017f-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:30:18.186163 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.186160    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnmcd\" (UniqueName: \"kubernetes.io/projected/2d940f06-2b10-479d-9edf-40ebc211017f-kube-api-access-rnmcd\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:30:18.354128 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.354093    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"]
Jul 28 14:30:18.359704 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:18.359680    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d2089a60-b5658877b-r8wcc"]
Jul 28 14:30:19.343005 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:19.342964    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d940f06-2b10-479d-9edf-40ebc211017f" path="/var/lib/kubelet/pods/2d940f06-2b10-479d-9edf-40ebc211017f/volumes"
Jul 28 14:30:19.343495 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:19.343482    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" path="/var/lib/kubelet/pods/a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6/volumes"
Jul 28 14:30:21.507088 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.507052    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"]
Jul 28 14:30:21.507498 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.507395    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" containerName="maas-api"
Jul 28 14:30:21.507498 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.507409    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" containerName="maas-api"
Jul 28 14:30:21.507498 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.507422    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d940f06-2b10-479d-9edf-40ebc211017f" containerName="payload-pre-processing"
Jul 28 14:30:21.507498 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.507428    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d940f06-2b10-479d-9edf-40ebc211017f" containerName="payload-pre-processing"
Jul 28 14:30:21.507498 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.507495    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a34b88e3-2aa8-4b82-8b7c-19562b7bd1e6" containerName="maas-api"
Jul 28 14:30:21.507666 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.507505    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d940f06-2b10-479d-9edf-40ebc211017f" containerName="payload-pre-processing"
Jul 28 14:30:21.511838 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.511819    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:21.514831 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.514809    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0b8a5700-serving-cert\""
Jul 28 14:30:21.524874 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.524849    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"]
Jul 28 14:30:21.619175 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.619130    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-openshift-service-ca\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:21.619367 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.619185    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:21.619367 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.619217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdmf4\" (UniqueName: \"kubernetes.io/projected/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-kube-api-access-rdmf4\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:21.720400 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.720359    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-openshift-service-ca\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:21.720603 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.720410    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:21.720603 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.720446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdmf4\" (UniqueName: \"kubernetes.io/projected/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-kube-api-access-rdmf4\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:21.720603 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:30:21.720574    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-serving-cert: secret "maas-api-e2e-ait-0b8a5700-serving-cert" not found
Jul 28 14:30:21.720773 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:30:21.720637    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls podName:deef0b35-c6eb-4ee6-a5db-3aa656aca34f nodeName:}" failed. No retries permitted until 2026-07-28 14:30:22.220622601 +0000 UTC m=+1831.439424628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls") pod "maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn" (UID: "deef0b35-c6eb-4ee6-a5db-3aa656aca34f") : secret "maas-api-e2e-ait-0b8a5700-serving-cert" not found
Jul 28 14:30:21.721107 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.721083    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-openshift-service-ca\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:21.737632 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:21.737595    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdmf4\" (UniqueName: \"kubernetes.io/projected/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-kube-api-access-rdmf4\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:22.226438 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.226402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:22.229477 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.229452    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls\") pod \"maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:22.422646 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.422611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:22.570604 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.570570    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"]
Jul 28 14:30:22.573894 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:30:22.573858    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeef0b35_c6eb_4ee6_a5db_3aa656aca34f.slice/crio-3d88b0a5f797a83dd083f992c3c2994823324c1aaca333299f8f472b8de6d8ad WatchSource:0}: Error finding container 3d88b0a5f797a83dd083f992c3c2994823324c1aaca333299f8f472b8de6d8ad: Status 404 returned error can't find the container with id 3d88b0a5f797a83dd083f992c3c2994823324c1aaca333299f8f472b8de6d8ad
Jul 28 14:30:22.599876 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.599841    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"]
Jul 28 14:30:22.604708 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.604687    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:22.607820 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.607769    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0b8a5700\""
Jul 28 14:30:22.608028 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.608015    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0b8a5700-dockercfg-skkxc\""
Jul 28 14:30:22.619840 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.619809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"]
Jul 28 14:30:22.630043 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.630016    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv\" (UID: \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:22.630174 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.630051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6g5v\" (UniqueName: \"kubernetes.io/projected/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-kube-api-access-v6g5v\") pod \"payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv\" (UID: \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:22.731175 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.731085    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv\" (UID: \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:22.731175 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.731132    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6g5v\" (UniqueName: \"kubernetes.io/projected/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-kube-api-access-v6g5v\") pod \"payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv\" (UID: \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:22.731745 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.731725    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv\" (UID: \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:22.744430 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.744401    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6g5v\" (UniqueName: \"kubernetes.io/projected/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-kube-api-access-v6g5v\") pod \"payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv\" (UID: \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:22.915880 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:22.915851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:23.052977 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:23.052944    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn" event={"ID":"deef0b35-c6eb-4ee6-a5db-3aa656aca34f","Type":"ContainerStarted","Data":"61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9"}
Jul 28 14:30:23.053166 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:23.052999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn" event={"ID":"deef0b35-c6eb-4ee6-a5db-3aa656aca34f","Type":"ContainerStarted","Data":"3d88b0a5f797a83dd083f992c3c2994823324c1aaca333299f8f472b8de6d8ad"}
Jul 28 14:30:23.053166 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:23.053031    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:23.060958 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:23.060929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"]
Jul 28 14:30:23.063800 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:30:23.063765    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c677ac5_e61a_4ad0_9767_1b976e56d1a7.slice/crio-2310d4ce08bf13cb9a26b416869451e519fb95dbec078fe085489555d8e575c2 WatchSource:0}: Error finding container 2310d4ce08bf13cb9a26b416869451e519fb95dbec078fe085489555d8e575c2: Status 404 returned error can't find the container with id 2310d4ce08bf13cb9a26b416869451e519fb95dbec078fe085489555d8e575c2
Jul 28 14:30:23.083169 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:23.083125    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn" podStartSLOduration=1.7671640659999999 podStartE2EDuration="2.083108681s" totalImagesPullingTime="315.944615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:30:23.082761696 +0000 UTC m=+1832.301563742" watchObservedRunningTime="2026-07-28 14:30:23.083108681 +0000 UTC m=+1832.301910730"
Jul 28 14:30:24.060487 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:24.060444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv" event={"ID":"9c677ac5-e61a-4ad0-9767-1b976e56d1a7","Type":"ContainerStarted","Data":"f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2"}
Jul 28 14:30:24.061025 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:24.060509    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv" event={"ID":"9c677ac5-e61a-4ad0-9767-1b976e56d1a7","Type":"ContainerStarted","Data":"2310d4ce08bf13cb9a26b416869451e519fb95dbec078fe085489555d8e575c2"}
Jul 28 14:30:24.061025 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:24.060695    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:30:29.066595 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:29.066558    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:30:29.092975 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:29.092923    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv" podStartSLOduration=7.092905485 podStartE2EDuration="7.092905485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:30:24.087908758 +0000 UTC m=+1833.306710804" watchObservedRunningTime="2026-07-28 14:30:29.092905485 +0000 UTC m=+1838.311707531"
Jul 28 14:30:35.068966 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:30:35.068932    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:31:03.441004 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.440967    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"]
Jul 28 14:31:03.441477 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.441216    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn" podUID="deef0b35-c6eb-4ee6-a5db-3aa656aca34f" containerName="maas-api" containerID="cri-o://61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9" gracePeriod=30
Jul 28 14:31:03.598692 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.598652    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"]
Jul 28 14:31:03.598978 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.598949    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv" podUID="9c677ac5-e61a-4ad0-9767-1b976e56d1a7" containerName="payload-pre-processing" containerID="cri-o://f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2" gracePeriod=30
Jul 28 14:31:03.724999 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.724917    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:31:03.846268 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.846243    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:31:03.888460 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.888432    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-openshift-service-ca\") pod \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") "
Jul 28 14:31:03.888672 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.888498    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdmf4\" (UniqueName: \"kubernetes.io/projected/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-kube-api-access-rdmf4\") pod \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") "
Jul 28 14:31:03.888672 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.888568    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls\") pod \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\" (UID: \"deef0b35-c6eb-4ee6-a5db-3aa656aca34f\") "
Jul 28 14:31:03.889106 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.888850    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "deef0b35-c6eb-4ee6-a5db-3aa656aca34f" (UID: "deef0b35-c6eb-4ee6-a5db-3aa656aca34f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:31:03.891462 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.891403    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-kube-api-access-rdmf4" (OuterVolumeSpecName: "kube-api-access-rdmf4") pod "deef0b35-c6eb-4ee6-a5db-3aa656aca34f" (UID: "deef0b35-c6eb-4ee6-a5db-3aa656aca34f"). InnerVolumeSpecName "kube-api-access-rdmf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:31:03.891462 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.891435    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "deef0b35-c6eb-4ee6-a5db-3aa656aca34f" (UID: "deef0b35-c6eb-4ee6-a5db-3aa656aca34f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:31:03.989461 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.989374    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6g5v\" (UniqueName: \"kubernetes.io/projected/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-kube-api-access-v6g5v\") pod \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\" (UID: \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\") "
Jul 28 14:31:03.989461 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.989461    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-plugins-config-volume\") pod \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\" (UID: \"9c677ac5-e61a-4ad0-9767-1b976e56d1a7\") "
Jul 28 14:31:03.989692 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.989576    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:03.989692 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.989589    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:03.989692 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.989603    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdmf4\" (UniqueName: \"kubernetes.io/projected/deef0b35-c6eb-4ee6-a5db-3aa656aca34f-kube-api-access-rdmf4\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:03.989914 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.989887    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c677ac5-e61a-4ad0-9767-1b976e56d1a7" (UID: "9c677ac5-e61a-4ad0-9767-1b976e56d1a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:31:03.991465 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:03.991443    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-kube-api-access-v6g5v" (OuterVolumeSpecName: "kube-api-access-v6g5v") pod "9c677ac5-e61a-4ad0-9767-1b976e56d1a7" (UID: "9c677ac5-e61a-4ad0-9767-1b976e56d1a7"). InnerVolumeSpecName "kube-api-access-v6g5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:31:04.090398 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.090359    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:04.090398 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.090388    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6g5v\" (UniqueName: \"kubernetes.io/projected/9c677ac5-e61a-4ad0-9767-1b976e56d1a7-kube-api-access-v6g5v\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:04.246816 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.246715    2571 generic.go:356] "Generic (PLEG): container finished" podID="9c677ac5-e61a-4ad0-9767-1b976e56d1a7" containerID="f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2" exitCode=0
Jul 28 14:31:04.246816 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.246764    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"
Jul 28 14:31:04.246816 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.246814    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv" event={"ID":"9c677ac5-e61a-4ad0-9767-1b976e56d1a7","Type":"ContainerDied","Data":"f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2"}
Jul 28 14:31:04.247064 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.246866    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv" event={"ID":"9c677ac5-e61a-4ad0-9767-1b976e56d1a7","Type":"ContainerDied","Data":"2310d4ce08bf13cb9a26b416869451e519fb95dbec078fe085489555d8e575c2"}
Jul 28 14:31:04.247064 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.246900    2571 scope.go:117] "RemoveContainer" containerID="f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2"
Jul 28 14:31:04.248233 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.248207    2571 generic.go:356] "Generic (PLEG): container finished" podID="deef0b35-c6eb-4ee6-a5db-3aa656aca34f" containerID="61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9" exitCode=0
Jul 28 14:31:04.248336 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.248260    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn" event={"ID":"deef0b35-c6eb-4ee6-a5db-3aa656aca34f","Type":"ContainerDied","Data":"61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9"}
Jul 28 14:31:04.248336 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.248268    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"
Jul 28 14:31:04.248336 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.248303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn" event={"ID":"deef0b35-c6eb-4ee6-a5db-3aa656aca34f","Type":"ContainerDied","Data":"3d88b0a5f797a83dd083f992c3c2994823324c1aaca333299f8f472b8de6d8ad"}
Jul 28 14:31:04.255479 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.255460    2571 scope.go:117] "RemoveContainer" containerID="f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2"
Jul 28 14:31:04.255739 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:31:04.255715    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2\": container with ID starting with f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2 not found: ID does not exist" containerID="f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2"
Jul 28 14:31:04.255825 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.255753    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2"} err="failed to get container status \"f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2\": rpc error: code = NotFound desc = could not find container \"f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2\": container with ID starting with f29b3e90e717eada46c70462e2a753f42e87433db73bf65e02c216ce6c1844c2 not found: ID does not exist"
Jul 28 14:31:04.255825 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.255772    2571 scope.go:117] "RemoveContainer" containerID="61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9"
Jul 28 14:31:04.263886 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.263865    2571 scope.go:117] "RemoveContainer" containerID="61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9"
Jul 28 14:31:04.264141 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:31:04.264118    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9\": container with ID starting with 61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9 not found: ID does not exist" containerID="61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9"
Jul 28 14:31:04.264232 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.264145    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9"} err="failed to get container status \"61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9\": rpc error: code = NotFound desc = could not find container \"61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9\": container with ID starting with 61e87671bcab73ce95e3148b4bce0806b30bd3ccc73021b272b74cd3a37b2ca9 not found: ID does not exist"
Jul 28 14:31:04.281008 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.280980    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"]
Jul 28 14:31:04.296388 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.296347    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b8a5700-57d48996db-mwcpn"]
Jul 28 14:31:04.315930 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.315898    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"]
Jul 28 14:31:04.328481 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:04.328453    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b8a5700-864688766d-7h8qv"]
Jul 28 14:31:05.343343 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:05.343308    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c677ac5-e61a-4ad0-9767-1b976e56d1a7" path="/var/lib/kubelet/pods/9c677ac5-e61a-4ad0-9767-1b976e56d1a7/volumes"
Jul 28 14:31:05.344090 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:05.344064    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deef0b35-c6eb-4ee6-a5db-3aa656aca34f" path="/var/lib/kubelet/pods/deef0b35-c6eb-4ee6-a5db-3aa656aca34f/volumes"
Jul 28 14:31:08.817861 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.817828    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"]
Jul 28 14:31:08.818213 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.818157    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c677ac5-e61a-4ad0-9767-1b976e56d1a7" containerName="payload-pre-processing"
Jul 28 14:31:08.818213 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.818168    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c677ac5-e61a-4ad0-9767-1b976e56d1a7" containerName="payload-pre-processing"
Jul 28 14:31:08.818213 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.818185    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deef0b35-c6eb-4ee6-a5db-3aa656aca34f" containerName="maas-api"
Jul 28 14:31:08.818213 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.818191    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="deef0b35-c6eb-4ee6-a5db-3aa656aca34f" containerName="maas-api"
Jul 28 14:31:08.818354 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.818244    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c677ac5-e61a-4ad0-9767-1b976e56d1a7" containerName="payload-pre-processing"
Jul 28 14:31:08.818354 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.818254    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="deef0b35-c6eb-4ee6-a5db-3aa656aca34f" containerName="maas-api"
Jul 28 14:31:08.822948 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.822916    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:08.828218 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.828198    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-384b773a-serving-cert\""
Jul 28 14:31:08.848022 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.847986    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"]
Jul 28 14:31:08.933925 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.933895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhdp\" (UniqueName: \"kubernetes.io/projected/2922b193-83c9-4dba-ae17-8f1974c55ba6-kube-api-access-bdhdp\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:08.934102 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.933967    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:08.934102 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:08.934045    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2922b193-83c9-4dba-ae17-8f1974c55ba6-openshift-service-ca\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.035207 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.035174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.035369 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.035218    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2922b193-83c9-4dba-ae17-8f1974c55ba6-openshift-service-ca\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.035369 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.035331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhdp\" (UniqueName: \"kubernetes.io/projected/2922b193-83c9-4dba-ae17-8f1974c55ba6-kube-api-access-bdhdp\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.035450 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:31:09.035341    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-serving-cert: secret "maas-api-e2e-derive-384b773a-serving-cert" not found
Jul 28 14:31:09.035548 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:31:09.035454    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls podName:2922b193-83c9-4dba-ae17-8f1974c55ba6 nodeName:}" failed. No retries permitted until 2026-07-28 14:31:09.535437557 +0000 UTC m=+1878.754239584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls") pod "maas-api-e2e-derive-384b773a-897cbfc75-2mglz" (UID: "2922b193-83c9-4dba-ae17-8f1974c55ba6") : secret "maas-api-e2e-derive-384b773a-serving-cert" not found
Jul 28 14:31:09.035990 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.035972    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2922b193-83c9-4dba-ae17-8f1974c55ba6-openshift-service-ca\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.086842 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.086752    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhdp\" (UniqueName: \"kubernetes.io/projected/2922b193-83c9-4dba-ae17-8f1974c55ba6-kube-api-access-bdhdp\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.539755 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.539716    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.542092 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.542068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls\") pod \"maas-api-e2e-derive-384b773a-897cbfc75-2mglz\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.733838 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.733776    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:09.893164 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:09.893139    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"]
Jul 28 14:31:09.895616 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:31:09.895588    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2922b193_83c9_4dba_ae17_8f1974c55ba6.slice/crio-c295edfd8348c16b2855540e95d7f9b52d5135281e958541796b90438e37a94a WatchSource:0}: Error finding container c295edfd8348c16b2855540e95d7f9b52d5135281e958541796b90438e37a94a: Status 404 returned error can't find the container with id c295edfd8348c16b2855540e95d7f9b52d5135281e958541796b90438e37a94a
Jul 28 14:31:10.280262 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:10.280216    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz" event={"ID":"2922b193-83c9-4dba-ae17-8f1974c55ba6","Type":"ContainerStarted","Data":"c295edfd8348c16b2855540e95d7f9b52d5135281e958541796b90438e37a94a"}
Jul 28 14:31:10.812690 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:10.812656    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"]
Jul 28 14:31:10.816035 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:10.816019    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:10.819895 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:10.819873    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-384b773a-dockercfg-wc6fd\""
Jul 28 14:31:10.820036 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:10.819905    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-384b773a\""
Jul 28 14:31:10.840355 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:10.840322    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"]
Jul 28 14:31:10.952769 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:10.952736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqpk2\" (UniqueName: \"kubernetes.io/projected/8298fb1b-8709-4a9f-b928-fc055416ddfd-kube-api-access-tqpk2\") pod \"payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8\" (UID: \"8298fb1b-8709-4a9f-b928-fc055416ddfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:10.953123 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:10.952822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8298fb1b-8709-4a9f-b928-fc055416ddfd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8\" (UID: \"8298fb1b-8709-4a9f-b928-fc055416ddfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:11.053707 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.053663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqpk2\" (UniqueName: \"kubernetes.io/projected/8298fb1b-8709-4a9f-b928-fc055416ddfd-kube-api-access-tqpk2\") pod \"payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8\" (UID: \"8298fb1b-8709-4a9f-b928-fc055416ddfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:11.053921 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.053750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8298fb1b-8709-4a9f-b928-fc055416ddfd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8\" (UID: \"8298fb1b-8709-4a9f-b928-fc055416ddfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:11.054489 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.054466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8298fb1b-8709-4a9f-b928-fc055416ddfd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8\" (UID: \"8298fb1b-8709-4a9f-b928-fc055416ddfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:11.066731 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.066664    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqpk2\" (UniqueName: \"kubernetes.io/projected/8298fb1b-8709-4a9f-b928-fc055416ddfd-kube-api-access-tqpk2\") pod \"payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8\" (UID: \"8298fb1b-8709-4a9f-b928-fc055416ddfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:11.125861 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.125830    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:11.274435 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.274405    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"]
Jul 28 14:31:11.275857 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:31:11.275827    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8298fb1b_8709_4a9f_b928_fc055416ddfd.slice/crio-569c7a4a5e2dc08b87c6d92ed11407cfdad509ca631f960fb701f3e33780953f WatchSource:0}: Error finding container 569c7a4a5e2dc08b87c6d92ed11407cfdad509ca631f960fb701f3e33780953f: Status 404 returned error can't find the container with id 569c7a4a5e2dc08b87c6d92ed11407cfdad509ca631f960fb701f3e33780953f
Jul 28 14:31:11.286685 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.286657    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz" event={"ID":"2922b193-83c9-4dba-ae17-8f1974c55ba6","Type":"ContainerStarted","Data":"65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059"}
Jul 28 14:31:11.286821 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.286719    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:11.287993 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.287970    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8" event={"ID":"8298fb1b-8709-4a9f-b928-fc055416ddfd","Type":"ContainerStarted","Data":"569c7a4a5e2dc08b87c6d92ed11407cfdad509ca631f960fb701f3e33780953f"}
Jul 28 14:31:11.321231 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:11.321186    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz" podStartSLOduration=2.804872059 podStartE2EDuration="3.32117061s" totalImagesPullingTime="516.298551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:31:11.320367709 +0000 UTC m=+1880.539169769" watchObservedRunningTime="2026-07-28 14:31:11.32117061 +0000 UTC m=+1880.539972655"
Jul 28 14:31:12.294256 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:12.294164    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8" event={"ID":"8298fb1b-8709-4a9f-b928-fc055416ddfd","Type":"ContainerStarted","Data":"99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a"}
Jul 28 14:31:12.294685 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:12.294329    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:12.334646 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:12.334592    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8" podStartSLOduration=2.334576554 podStartE2EDuration="2.334576554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:31:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:31:12.334275538 +0000 UTC m=+1881.553077586" watchObservedRunningTime="2026-07-28 14:31:12.334576554 +0000 UTC m=+1881.553378857"
Jul 28 14:31:17.300067 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:17.300035    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:23.300952 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:23.300917    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:37.850563 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:37.850523    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"]
Jul 28 14:31:37.851148 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:37.850778    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz" podUID="2922b193-83c9-4dba-ae17-8f1974c55ba6" containerName="maas-api" containerID="cri-o://65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059" gracePeriod=30
Jul 28 14:31:37.977072 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:37.977037    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"]
Jul 28 14:31:37.977319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:37.977290    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8" podUID="8298fb1b-8709-4a9f-b928-fc055416ddfd" containerName="payload-pre-processing" containerID="cri-o://99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a" gracePeriod=30
Jul 28 14:31:38.116353 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.116322    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:38.178023 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.177993    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdhdp\" (UniqueName: \"kubernetes.io/projected/2922b193-83c9-4dba-ae17-8f1974c55ba6-kube-api-access-bdhdp\") pod \"2922b193-83c9-4dba-ae17-8f1974c55ba6\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") "
Jul 28 14:31:38.178182 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.178048    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2922b193-83c9-4dba-ae17-8f1974c55ba6-openshift-service-ca\") pod \"2922b193-83c9-4dba-ae17-8f1974c55ba6\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") "
Jul 28 14:31:38.178182 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.178116    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls\") pod \"2922b193-83c9-4dba-ae17-8f1974c55ba6\" (UID: \"2922b193-83c9-4dba-ae17-8f1974c55ba6\") "
Jul 28 14:31:38.178519 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.178487    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2922b193-83c9-4dba-ae17-8f1974c55ba6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2922b193-83c9-4dba-ae17-8f1974c55ba6" (UID: "2922b193-83c9-4dba-ae17-8f1974c55ba6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:31:38.181437 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.181403    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2922b193-83c9-4dba-ae17-8f1974c55ba6" (UID: "2922b193-83c9-4dba-ae17-8f1974c55ba6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:31:38.181558 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.181478    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2922b193-83c9-4dba-ae17-8f1974c55ba6-kube-api-access-bdhdp" (OuterVolumeSpecName: "kube-api-access-bdhdp") pod "2922b193-83c9-4dba-ae17-8f1974c55ba6" (UID: "2922b193-83c9-4dba-ae17-8f1974c55ba6"). InnerVolumeSpecName "kube-api-access-bdhdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:31:38.239136 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.239110    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:38.278825 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.278766    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqpk2\" (UniqueName: \"kubernetes.io/projected/8298fb1b-8709-4a9f-b928-fc055416ddfd-kube-api-access-tqpk2\") pod \"8298fb1b-8709-4a9f-b928-fc055416ddfd\" (UID: \"8298fb1b-8709-4a9f-b928-fc055416ddfd\") "
Jul 28 14:31:38.279007 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.278865    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8298fb1b-8709-4a9f-b928-fc055416ddfd-plugins-config-volume\") pod \"8298fb1b-8709-4a9f-b928-fc055416ddfd\" (UID: \"8298fb1b-8709-4a9f-b928-fc055416ddfd\") "
Jul 28 14:31:38.279183 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.279135    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdhdp\" (UniqueName: \"kubernetes.io/projected/2922b193-83c9-4dba-ae17-8f1974c55ba6-kube-api-access-bdhdp\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:38.279319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.279188    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2922b193-83c9-4dba-ae17-8f1974c55ba6-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:38.279319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.279203    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2922b193-83c9-4dba-ae17-8f1974c55ba6-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:38.279319 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.279264    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8298fb1b-8709-4a9f-b928-fc055416ddfd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8298fb1b-8709-4a9f-b928-fc055416ddfd" (UID: "8298fb1b-8709-4a9f-b928-fc055416ddfd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:31:38.280991 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.280970    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8298fb1b-8709-4a9f-b928-fc055416ddfd-kube-api-access-tqpk2" (OuterVolumeSpecName: "kube-api-access-tqpk2") pod "8298fb1b-8709-4a9f-b928-fc055416ddfd" (UID: "8298fb1b-8709-4a9f-b928-fc055416ddfd"). InnerVolumeSpecName "kube-api-access-tqpk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:31:38.380144 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.380046    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8298fb1b-8709-4a9f-b928-fc055416ddfd-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:38.380144 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.380081    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqpk2\" (UniqueName: \"kubernetes.io/projected/8298fb1b-8709-4a9f-b928-fc055416ddfd-kube-api-access-tqpk2\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:31:38.416165 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.416122    2571 generic.go:356] "Generic (PLEG): container finished" podID="2922b193-83c9-4dba-ae17-8f1974c55ba6" containerID="65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059" exitCode=0
Jul 28 14:31:38.416165 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.416164    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"
Jul 28 14:31:38.416401 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.416203    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz" event={"ID":"2922b193-83c9-4dba-ae17-8f1974c55ba6","Type":"ContainerDied","Data":"65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059"}
Jul 28 14:31:38.416401 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.416265    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz" event={"ID":"2922b193-83c9-4dba-ae17-8f1974c55ba6","Type":"ContainerDied","Data":"c295edfd8348c16b2855540e95d7f9b52d5135281e958541796b90438e37a94a"}
Jul 28 14:31:38.416401 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.416301    2571 scope.go:117] "RemoveContainer" containerID="65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059"
Jul 28 14:31:38.417722 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.417685    2571 generic.go:356] "Generic (PLEG): container finished" podID="8298fb1b-8709-4a9f-b928-fc055416ddfd" containerID="99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a" exitCode=0
Jul 28 14:31:38.417875 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.417729    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"
Jul 28 14:31:38.417875 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.417769    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8" event={"ID":"8298fb1b-8709-4a9f-b928-fc055416ddfd","Type":"ContainerDied","Data":"99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a"}
Jul 28 14:31:38.417875 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.417843    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8" event={"ID":"8298fb1b-8709-4a9f-b928-fc055416ddfd","Type":"ContainerDied","Data":"569c7a4a5e2dc08b87c6d92ed11407cfdad509ca631f960fb701f3e33780953f"}
Jul 28 14:31:38.427931 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.427906    2571 scope.go:117] "RemoveContainer" containerID="65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059"
Jul 28 14:31:38.428333 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:31:38.428297    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059\": container with ID starting with 65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059 not found: ID does not exist" containerID="65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059"
Jul 28 14:31:38.428440 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.428338    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059"} err="failed to get container status \"65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059\": rpc error: code = NotFound desc = could not find container \"65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059\": container with ID starting with 65075e70ba9ef3a25e1c80cb8a77ba1b0e5d34e3a507dae5a49111606d9fd059 not found: ID does not exist"
Jul 28 14:31:38.428440 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.428363    2571 scope.go:117] "RemoveContainer" containerID="99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a"
Jul 28 14:31:38.438251 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.438228    2571 scope.go:117] "RemoveContainer" containerID="99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a"
Jul 28 14:31:38.438574 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:31:38.438550    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a\": container with ID starting with 99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a not found: ID does not exist" containerID="99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a"
Jul 28 14:31:38.438655 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.438582    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a"} err="failed to get container status \"99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a\": rpc error: code = NotFound desc = could not find container \"99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a\": container with ID starting with 99b7c58e49f09431c4c2533c445b671fa352aa7416fd888e4c09071b69ba1e8a not found: ID does not exist"
Jul 28 14:31:38.447587 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.447561    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"]
Jul 28 14:31:38.453990 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.453955    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-384b773a-897cbfc75-2mglz"]
Jul 28 14:31:38.470504 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.470472    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"]
Jul 28 14:31:38.476095 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:38.476072    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-384b773a-67b6b55fb4-gg7n8"]
Jul 28 14:31:39.342700 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:39.342666    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2922b193-83c9-4dba-ae17-8f1974c55ba6" path="/var/lib/kubelet/pods/2922b193-83c9-4dba-ae17-8f1974c55ba6/volumes"
Jul 28 14:31:39.343087 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:31:39.343063    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8298fb1b-8709-4a9f-b928-fc055416ddfd" path="/var/lib/kubelet/pods/8298fb1b-8709-4a9f-b928-fc055416ddfd/volumes"
Jul 28 14:33:40.021735 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.021701    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"]
Jul 28 14:33:40.022334 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.022243    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8298fb1b-8709-4a9f-b928-fc055416ddfd" containerName="payload-pre-processing"
Jul 28 14:33:40.022334 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.022264    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8298fb1b-8709-4a9f-b928-fc055416ddfd" containerName="payload-pre-processing"
Jul 28 14:33:40.022334 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.022281    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2922b193-83c9-4dba-ae17-8f1974c55ba6" containerName="maas-api"
Jul 28 14:33:40.022334 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.022290    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2922b193-83c9-4dba-ae17-8f1974c55ba6" containerName="maas-api"
Jul 28 14:33:40.022542 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.022392    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8298fb1b-8709-4a9f-b928-fc055416ddfd" containerName="payload-pre-processing"
Jul 28 14:33:40.022542 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.022408    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2922b193-83c9-4dba-ae17-8f1974c55ba6" containerName="maas-api"
Jul 28 14:33:40.025360 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.025339    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.028663 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.028639    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-049328b0-serving-cert\""
Jul 28 14:33:40.036704 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.036677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"]
Jul 28 14:33:40.159510 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.159467    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.159510 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.159511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppslb\" (UniqueName: \"kubernetes.io/projected/0578a49e-b912-4f27-85d6-cd41bc01b16c-kube-api-access-ppslb\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.159766 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.159545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0578a49e-b912-4f27-85d6-cd41bc01b16c-openshift-service-ca\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.260532 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.260489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.260532 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.260532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppslb\" (UniqueName: \"kubernetes.io/projected/0578a49e-b912-4f27-85d6-cd41bc01b16c-kube-api-access-ppslb\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.260836 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.260567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0578a49e-b912-4f27-85d6-cd41bc01b16c-openshift-service-ca\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.260836 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:33:40.260650    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-serving-cert: secret "maas-api-e2e-mt-049328b0-serving-cert" not found
Jul 28 14:33:40.260836 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:33:40.260724    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls podName:0578a49e-b912-4f27-85d6-cd41bc01b16c nodeName:}" failed. No retries permitted until 2026-07-28 14:33:40.760707403 +0000 UTC m=+2029.979509427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls") pod "maas-api-e2e-mt-049328b0-55c5849d8b-85cj4" (UID: "0578a49e-b912-4f27-85d6-cd41bc01b16c") : secret "maas-api-e2e-mt-049328b0-serving-cert" not found
Jul 28 14:33:40.261195 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.261176    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0578a49e-b912-4f27-85d6-cd41bc01b16c-openshift-service-ca\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.271664 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.271640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppslb\" (UniqueName: \"kubernetes.io/projected/0578a49e-b912-4f27-85d6-cd41bc01b16c-kube-api-access-ppslb\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.766176 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.766139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.768536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.768515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls\") pod \"maas-api-e2e-mt-049328b0-55c5849d8b-85cj4\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.936654 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.936620    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:40.988935 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.988894    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"]
Jul 28 14:33:40.992660 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.992639    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:40.995730 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.995706    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-049328b0\""
Jul 28 14:33:40.996019 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:40.996003    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-049328b0-dockercfg-rpmd9\""
Jul 28 14:33:41.002244 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.001764    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"]
Jul 28 14:33:41.069060 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.069026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be9ac0b-e238-410a-9f1c-0dc5e0139149-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh\" (UID: \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:41.069514 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.069080    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5ch\" (UniqueName: \"kubernetes.io/projected/2be9ac0b-e238-410a-9f1c-0dc5e0139149-kube-api-access-nv5ch\") pod \"payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh\" (UID: \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:41.096111 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.096086    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"]
Jul 28 14:33:41.098825 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:33:41.098752    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0578a49e_b912_4f27_85d6_cd41bc01b16c.slice/crio-876c11075e523fb7461ead822e587deff336bee0bd3f5a80a0a78844d94dbaa8 WatchSource:0}: Error finding container 876c11075e523fb7461ead822e587deff336bee0bd3f5a80a0a78844d94dbaa8: Status 404 returned error can't find the container with id 876c11075e523fb7461ead822e587deff336bee0bd3f5a80a0a78844d94dbaa8
Jul 28 14:33:41.169711 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.169674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5ch\" (UniqueName: \"kubernetes.io/projected/2be9ac0b-e238-410a-9f1c-0dc5e0139149-kube-api-access-nv5ch\") pod \"payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh\" (UID: \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:41.169915 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.169843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be9ac0b-e238-410a-9f1c-0dc5e0139149-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh\" (UID: \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:41.170505 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.170487    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be9ac0b-e238-410a-9f1c-0dc5e0139149-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh\" (UID: \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:41.179916 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.179889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5ch\" (UniqueName: \"kubernetes.io/projected/2be9ac0b-e238-410a-9f1c-0dc5e0139149-kube-api-access-nv5ch\") pod \"payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh\" (UID: \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:41.309483 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.309386    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:41.456231 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:33:41.456192    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be9ac0b_e238_410a_9f1c_0dc5e0139149.slice/crio-1c796ced84769064a341e7641c3e152dad24c30e2d165bd195bbf46c608a2b0e WatchSource:0}: Error finding container 1c796ced84769064a341e7641c3e152dad24c30e2d165bd195bbf46c608a2b0e: Status 404 returned error can't find the container with id 1c796ced84769064a341e7641c3e152dad24c30e2d165bd195bbf46c608a2b0e
Jul 28 14:33:41.456662 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.456640    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"]
Jul 28 14:33:41.963587 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.963550    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh" event={"ID":"2be9ac0b-e238-410a-9f1c-0dc5e0139149","Type":"ContainerStarted","Data":"f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d"}
Jul 28 14:33:41.963824 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.963613    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh" event={"ID":"2be9ac0b-e238-410a-9f1c-0dc5e0139149","Type":"ContainerStarted","Data":"1c796ced84769064a341e7641c3e152dad24c30e2d165bd195bbf46c608a2b0e"}
Jul 28 14:33:41.963824 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.963644    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:33:41.965048 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.965019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4" event={"ID":"0578a49e-b912-4f27-85d6-cd41bc01b16c","Type":"ContainerStarted","Data":"b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38"}
Jul 28 14:33:41.965162 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.965109    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:41.965162 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.965127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4" event={"ID":"0578a49e-b912-4f27-85d6-cd41bc01b16c","Type":"ContainerStarted","Data":"876c11075e523fb7461ead822e587deff336bee0bd3f5a80a0a78844d94dbaa8"}
Jul 28 14:33:41.984440 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:41.984384    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh" podStartSLOduration=1.984369705 podStartE2EDuration="1.984369705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:33:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:33:41.983134385 +0000 UTC m=+2031.201936432" watchObservedRunningTime="2026-07-28 14:33:41.984369705 +0000 UTC m=+2031.203171750"
Jul 28 14:33:42.002695 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:42.002638    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4" podStartSLOduration=2.543741267 podStartE2EDuration="3.002620944s" totalImagesPullingTime="458.879677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:33:42.000619439 +0000 UTC m=+2031.219421512" watchObservedRunningTime="2026-07-28 14:33:42.002620944 +0000 UTC m=+2031.221422989"
Jul 28 14:33:47.974713 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:47.974683    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:33:52.971469 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:33:52.971434    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:34:24.314681 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.314648    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"]
Jul 28 14:34:24.317094 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.314855    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4" podUID="0578a49e-b912-4f27-85d6-cd41bc01b16c" containerName="maas-api" containerID="cri-o://b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38" gracePeriod=30
Jul 28 14:34:24.380501 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.380468    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"]
Jul 28 14:34:24.380763 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.380715    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh" podUID="2be9ac0b-e238-410a-9f1c-0dc5e0139149" containerName="payload-pre-processing" containerID="cri-o://f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d" gracePeriod=30
Jul 28 14:34:24.646030 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.646003    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:34:24.668326 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.668247    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:34:24.754770 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.754732    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls\") pod \"0578a49e-b912-4f27-85d6-cd41bc01b16c\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") "
Jul 28 14:34:24.754966 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.754807    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be9ac0b-e238-410a-9f1c-0dc5e0139149-plugins-config-volume\") pod \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\" (UID: \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\") "
Jul 28 14:34:24.754966 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.754860    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv5ch\" (UniqueName: \"kubernetes.io/projected/2be9ac0b-e238-410a-9f1c-0dc5e0139149-kube-api-access-nv5ch\") pod \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\" (UID: \"2be9ac0b-e238-410a-9f1c-0dc5e0139149\") "
Jul 28 14:34:24.754966 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.754890    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppslb\" (UniqueName: \"kubernetes.io/projected/0578a49e-b912-4f27-85d6-cd41bc01b16c-kube-api-access-ppslb\") pod \"0578a49e-b912-4f27-85d6-cd41bc01b16c\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") "
Jul 28 14:34:24.755126 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.755064    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0578a49e-b912-4f27-85d6-cd41bc01b16c-openshift-service-ca\") pod \"0578a49e-b912-4f27-85d6-cd41bc01b16c\" (UID: \"0578a49e-b912-4f27-85d6-cd41bc01b16c\") "
Jul 28 14:34:24.755357 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.755227    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2be9ac0b-e238-410a-9f1c-0dc5e0139149-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2be9ac0b-e238-410a-9f1c-0dc5e0139149" (UID: "2be9ac0b-e238-410a-9f1c-0dc5e0139149"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:34:24.755436 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.755368    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0578a49e-b912-4f27-85d6-cd41bc01b16c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0578a49e-b912-4f27-85d6-cd41bc01b16c" (UID: "0578a49e-b912-4f27-85d6-cd41bc01b16c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:34:24.757067 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.757044    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0578a49e-b912-4f27-85d6-cd41bc01b16c-kube-api-access-ppslb" (OuterVolumeSpecName: "kube-api-access-ppslb") pod "0578a49e-b912-4f27-85d6-cd41bc01b16c" (UID: "0578a49e-b912-4f27-85d6-cd41bc01b16c"). InnerVolumeSpecName "kube-api-access-ppslb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:34:24.757466 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.757448    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0578a49e-b912-4f27-85d6-cd41bc01b16c" (UID: "0578a49e-b912-4f27-85d6-cd41bc01b16c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:34:24.757539 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.757461    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be9ac0b-e238-410a-9f1c-0dc5e0139149-kube-api-access-nv5ch" (OuterVolumeSpecName: "kube-api-access-nv5ch") pod "2be9ac0b-e238-410a-9f1c-0dc5e0139149" (UID: "2be9ac0b-e238-410a-9f1c-0dc5e0139149"). InnerVolumeSpecName "kube-api-access-nv5ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:34:24.856299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.856211    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0578a49e-b912-4f27-85d6-cd41bc01b16c-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:34:24.856299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.856241    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be9ac0b-e238-410a-9f1c-0dc5e0139149-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:34:24.856299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.856251    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv5ch\" (UniqueName: \"kubernetes.io/projected/2be9ac0b-e238-410a-9f1c-0dc5e0139149-kube-api-access-nv5ch\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:34:24.856299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.856260    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppslb\" (UniqueName: \"kubernetes.io/projected/0578a49e-b912-4f27-85d6-cd41bc01b16c-kube-api-access-ppslb\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:34:24.856299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:24.856272    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0578a49e-b912-4f27-85d6-cd41bc01b16c-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:34:25.161566 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.161528    2571 generic.go:356] "Generic (PLEG): container finished" podID="2be9ac0b-e238-410a-9f1c-0dc5e0139149" containerID="f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d" exitCode=0
Jul 28 14:34:25.161566 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.161569    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"
Jul 28 14:34:25.161798 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.161620    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh" event={"ID":"2be9ac0b-e238-410a-9f1c-0dc5e0139149","Type":"ContainerDied","Data":"f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d"}
Jul 28 14:34:25.161798 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.161739    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh" event={"ID":"2be9ac0b-e238-410a-9f1c-0dc5e0139149","Type":"ContainerDied","Data":"1c796ced84769064a341e7641c3e152dad24c30e2d165bd195bbf46c608a2b0e"}
Jul 28 14:34:25.161798 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.161772    2571 scope.go:117] "RemoveContainer" containerID="f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d"
Jul 28 14:34:25.162998 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.162972    2571 generic.go:356] "Generic (PLEG): container finished" podID="0578a49e-b912-4f27-85d6-cd41bc01b16c" containerID="b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38" exitCode=0
Jul 28 14:34:25.163111 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.163011    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4" event={"ID":"0578a49e-b912-4f27-85d6-cd41bc01b16c","Type":"ContainerDied","Data":"b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38"}
Jul 28 14:34:25.163111 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.163022    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"
Jul 28 14:34:25.163111 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.163050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4" event={"ID":"0578a49e-b912-4f27-85d6-cd41bc01b16c","Type":"ContainerDied","Data":"876c11075e523fb7461ead822e587deff336bee0bd3f5a80a0a78844d94dbaa8"}
Jul 28 14:34:25.171655 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.171635    2571 scope.go:117] "RemoveContainer" containerID="f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d"
Jul 28 14:34:25.171986 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:34:25.171965    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d\": container with ID starting with f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d not found: ID does not exist" containerID="f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d"
Jul 28 14:34:25.172086 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.171994    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d"} err="failed to get container status \"f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d\": rpc error: code = NotFound desc = could not find container \"f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d\": container with ID starting with f690291a33b997ca6c35164bf50b30a569593fbb330aa892cd9f93deff12273d not found: ID does not exist"
Jul 28 14:34:25.172086 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.172019    2571 scope.go:117] "RemoveContainer" containerID="b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38"
Jul 28 14:34:25.180591 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.180572    2571 scope.go:117] "RemoveContainer" containerID="b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38"
Jul 28 14:34:25.180881 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:34:25.180864    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38\": container with ID starting with b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38 not found: ID does not exist" containerID="b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38"
Jul 28 14:34:25.180930 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.180890    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38"} err="failed to get container status \"b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38\": rpc error: code = NotFound desc = could not find container \"b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38\": container with ID starting with b9bed2a18577f23c09a5cf4e2d529e13f181830924b6d9cbf82132d427597a38 not found: ID does not exist"
Jul 28 14:34:25.190858 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.190834    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"]
Jul 28 14:34:25.196328 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.196302    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-049328b0-55c5849d8b-85cj4"]
Jul 28 14:34:25.208871 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.208846    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"]
Jul 28 14:34:25.213429 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.213402    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-049328b0-65d45d9c6-dk5gh"]
Jul 28 14:34:25.342858 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.342826    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0578a49e-b912-4f27-85d6-cd41bc01b16c" path="/var/lib/kubelet/pods/0578a49e-b912-4f27-85d6-cd41bc01b16c/volumes"
Jul 28 14:34:25.343199 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:25.343186    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2be9ac0b-e238-410a-9f1c-0dc5e0139149" path="/var/lib/kubelet/pods/2be9ac0b-e238-410a-9f1c-0dc5e0139149/volumes"
Jul 28 14:34:55.524935 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.524901    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"]
Jul 28 14:34:55.525601 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.525580    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be9ac0b-e238-410a-9f1c-0dc5e0139149" containerName="payload-pre-processing"
Jul 28 14:34:55.525691 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.525604    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be9ac0b-e238-410a-9f1c-0dc5e0139149" containerName="payload-pre-processing"
Jul 28 14:34:55.525691 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.525625    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0578a49e-b912-4f27-85d6-cd41bc01b16c" containerName="maas-api"
Jul 28 14:34:55.525691 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.525633    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0578a49e-b912-4f27-85d6-cd41bc01b16c" containerName="maas-api"
Jul 28 14:34:55.525868 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.525746    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0578a49e-b912-4f27-85d6-cd41bc01b16c" containerName="maas-api"
Jul 28 14:34:55.525868 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.525759    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2be9ac0b-e238-410a-9f1c-0dc5e0139149" containerName="payload-pre-processing"
Jul 28 14:34:55.528821 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.528798    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:55.531550 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.531525    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f2131889-serving-cert\""
Jul 28 14:34:55.540184 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.540160    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"]
Jul 28 14:34:55.619019 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.618978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:55.619199 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.619107    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6365f87-f1fc-4be0-8b3c-e5622402600f-openshift-service-ca\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:55.619199 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.619135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z2mg\" (UniqueName: \"kubernetes.io/projected/a6365f87-f1fc-4be0-8b3c-e5622402600f-kube-api-access-2z2mg\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:55.720058 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.720015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6365f87-f1fc-4be0-8b3c-e5622402600f-openshift-service-ca\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:55.720241 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.720062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z2mg\" (UniqueName: \"kubernetes.io/projected/a6365f87-f1fc-4be0-8b3c-e5622402600f-kube-api-access-2z2mg\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:55.720241 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.720136    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:55.720361 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:34:55.720296    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-serving-cert: secret "maas-api-e2e-mt-f2131889-serving-cert" not found
Jul 28 14:34:55.720412 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:34:55.720372    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls podName:a6365f87-f1fc-4be0-8b3c-e5622402600f nodeName:}" failed. No retries permitted until 2026-07-28 14:34:56.220348769 +0000 UTC m=+2105.439150796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls") pod "maas-api-e2e-mt-f2131889-77d4db6676-ns65q" (UID: "a6365f87-f1fc-4be0-8b3c-e5622402600f") : secret "maas-api-e2e-mt-f2131889-serving-cert" not found
Jul 28 14:34:55.720871 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.720804    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6365f87-f1fc-4be0-8b3c-e5622402600f-openshift-service-ca\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:55.732044 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:55.732010    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z2mg\" (UniqueName: \"kubernetes.io/projected/a6365f87-f1fc-4be0-8b3c-e5622402600f-kube-api-access-2z2mg\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:56.225471 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:56.225433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:56.227956 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:56.227924    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls\") pod \"maas-api-e2e-mt-f2131889-77d4db6676-ns65q\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:56.440003 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:56.439968    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:56.581460 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:56.581432    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"]
Jul 28 14:34:56.584214 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:34:56.584174    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6365f87_f1fc_4be0_8b3c_e5622402600f.slice/crio-c045f5db809ad9bae8ad413471b5ad1e19fa8b7a68b1ee70d945cf2498a8c629 WatchSource:0}: Error finding container c045f5db809ad9bae8ad413471b5ad1e19fa8b7a68b1ee70d945cf2498a8c629: Status 404 returned error can't find the container with id c045f5db809ad9bae8ad413471b5ad1e19fa8b7a68b1ee70d945cf2498a8c629
Jul 28 14:34:56.585579 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:56.585561    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 14:34:57.311427 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:57.311319    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q" event={"ID":"a6365f87-f1fc-4be0-8b3c-e5622402600f","Type":"ContainerStarted","Data":"9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582"}
Jul 28 14:34:57.311427 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:57.311373    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q" event={"ID":"a6365f87-f1fc-4be0-8b3c-e5622402600f","Type":"ContainerStarted","Data":"c045f5db809ad9bae8ad413471b5ad1e19fa8b7a68b1ee70d945cf2498a8c629"}
Jul 28 14:34:57.311427 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:57.311424    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:34:57.335639 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:34:57.335585    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q" podStartSLOduration=1.9297840160000002 podStartE2EDuration="2.335570459s" totalImagesPullingTime="405.786443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:34:57.334109832 +0000 UTC m=+2106.552911880" watchObservedRunningTime="2026-07-28 14:34:57.335570459 +0000 UTC m=+2106.554372505"
Jul 28 14:35:03.322307 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:35:03.322277    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:36:20.799052 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:20.799017    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"]
Jul 28 14:36:20.799680 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:20.799279    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q" podUID="a6365f87-f1fc-4be0-8b3c-e5622402600f" containerName="maas-api" containerID="cri-o://9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582" gracePeriod=30
Jul 28 14:36:21.057479 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.057414    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:36:21.177952 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.177918    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z2mg\" (UniqueName: \"kubernetes.io/projected/a6365f87-f1fc-4be0-8b3c-e5622402600f-kube-api-access-2z2mg\") pod \"a6365f87-f1fc-4be0-8b3c-e5622402600f\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") "
Jul 28 14:36:21.178158 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.177977    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6365f87-f1fc-4be0-8b3c-e5622402600f-openshift-service-ca\") pod \"a6365f87-f1fc-4be0-8b3c-e5622402600f\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") "
Jul 28 14:36:21.178158 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.178009    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls\") pod \"a6365f87-f1fc-4be0-8b3c-e5622402600f\" (UID: \"a6365f87-f1fc-4be0-8b3c-e5622402600f\") "
Jul 28 14:36:21.178358 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.178331    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6365f87-f1fc-4be0-8b3c-e5622402600f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a6365f87-f1fc-4be0-8b3c-e5622402600f" (UID: "a6365f87-f1fc-4be0-8b3c-e5622402600f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:36:21.180003 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.179979    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a6365f87-f1fc-4be0-8b3c-e5622402600f" (UID: "a6365f87-f1fc-4be0-8b3c-e5622402600f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:36:21.180175 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.180155    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6365f87-f1fc-4be0-8b3c-e5622402600f-kube-api-access-2z2mg" (OuterVolumeSpecName: "kube-api-access-2z2mg") pod "a6365f87-f1fc-4be0-8b3c-e5622402600f" (UID: "a6365f87-f1fc-4be0-8b3c-e5622402600f"). InnerVolumeSpecName "kube-api-access-2z2mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:36:21.278958 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.278914    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z2mg\" (UniqueName: \"kubernetes.io/projected/a6365f87-f1fc-4be0-8b3c-e5622402600f-kube-api-access-2z2mg\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:36:21.278958 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.278949    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6365f87-f1fc-4be0-8b3c-e5622402600f-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:36:21.278958 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.278958    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6365f87-f1fc-4be0-8b3c-e5622402600f-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:36:21.696836 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.696803    2571 generic.go:356] "Generic (PLEG): container finished" podID="a6365f87-f1fc-4be0-8b3c-e5622402600f" containerID="9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582" exitCode=0
Jul 28 14:36:21.697009 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.696866    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"
Jul 28 14:36:21.697009 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.696879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q" event={"ID":"a6365f87-f1fc-4be0-8b3c-e5622402600f","Type":"ContainerDied","Data":"9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582"}
Jul 28 14:36:21.697009 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.696923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q" event={"ID":"a6365f87-f1fc-4be0-8b3c-e5622402600f","Type":"ContainerDied","Data":"c045f5db809ad9bae8ad413471b5ad1e19fa8b7a68b1ee70d945cf2498a8c629"}
Jul 28 14:36:21.697009 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.696944    2571 scope.go:117] "RemoveContainer" containerID="9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582"
Jul 28 14:36:21.705979 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.705957    2571 scope.go:117] "RemoveContainer" containerID="9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582"
Jul 28 14:36:21.706290 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:36:21.706258    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582\": container with ID starting with 9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582 not found: ID does not exist" containerID="9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582"
Jul 28 14:36:21.706439 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.706299    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582"} err="failed to get container status \"9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582\": rpc error: code = NotFound desc = could not find container \"9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582\": container with ID starting with 9faca95543d1de7ac2995c7e39aea4f9fe76e4ac09c385d5b47ae2542492e582 not found: ID does not exist"
Jul 28 14:36:21.716541 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.716517    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"]
Jul 28 14:36:21.721531 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:21.721508    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2131889-77d4db6676-ns65q"]
Jul 28 14:36:23.343757 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:36:23.343707    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6365f87-f1fc-4be0-8b3c-e5622402600f" path="/var/lib/kubelet/pods/a6365f87-f1fc-4be0-8b3c-e5622402600f/volumes"
Jul 28 14:38:38.594167 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.594126    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"]
Jul 28 14:38:38.594764 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.594626    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6365f87-f1fc-4be0-8b3c-e5622402600f" containerName="maas-api"
Jul 28 14:38:38.594764 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.594646    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6365f87-f1fc-4be0-8b3c-e5622402600f" containerName="maas-api"
Jul 28 14:38:38.594764 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.594740    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6365f87-f1fc-4be0-8b3c-e5622402600f" containerName="maas-api"
Jul 28 14:38:38.597887 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.597860    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:38.600637 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.600476    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e8f53c-serving-cert\""
Jul 28 14:38:38.610779 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.610747    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"]
Jul 28 14:38:38.682545 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.682507    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mbjf\" (UniqueName: \"kubernetes.io/projected/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-kube-api-access-7mbjf\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:38.682742 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.682648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:38.682742 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.682683    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:38.783210 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.783175    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:38.783426 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.783225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:38.783426 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.783280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mbjf\" (UniqueName: \"kubernetes.io/projected/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-kube-api-access-7mbjf\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:38.783426 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:38:38.783338    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-serving-cert: secret "maas-api-e2e-inf-a-e8f53c-serving-cert" not found
Jul 28 14:38:38.783590 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:38:38.783429    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls podName:0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b nodeName:}" failed. No retries permitted until 2026-07-28 14:38:39.283407798 +0000 UTC m=+2328.502209830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls") pod "maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz" (UID: "0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b") : secret "maas-api-e2e-inf-a-e8f53c-serving-cert" not found
Jul 28 14:38:38.783939 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.783915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:38.800728 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:38.800689    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mbjf\" (UniqueName: \"kubernetes.io/projected/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-kube-api-access-7mbjf\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:39.288262 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:39.288223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:39.290820 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:39.290765    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls\") pod \"maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:39.509640 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:39.509600    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:39.663108 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:39.663065    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"]
Jul 28 14:38:39.666110 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:38:39.666075    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdc954a_6dc0_4b7a_adf3_f4a42fb97a4b.slice/crio-1eae0e5a48abc8afc4ee7d58a85b9c18ef6251e37c2ade7eca26e18671683590 WatchSource:0}: Error finding container 1eae0e5a48abc8afc4ee7d58a85b9c18ef6251e37c2ade7eca26e18671683590: Status 404 returned error can't find the container with id 1eae0e5a48abc8afc4ee7d58a85b9c18ef6251e37c2ade7eca26e18671683590
Jul 28 14:38:40.313243 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:40.313208    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz" event={"ID":"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b","Type":"ContainerStarted","Data":"7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490"}
Jul 28 14:38:40.313468 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:40.313266    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz" event={"ID":"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b","Type":"ContainerStarted","Data":"1eae0e5a48abc8afc4ee7d58a85b9c18ef6251e37c2ade7eca26e18671683590"}
Jul 28 14:38:40.313468 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:40.313298    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:38:40.333834 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:40.333746    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz" podStartSLOduration=1.878178192 podStartE2EDuration="2.333730077s" totalImagesPullingTime="455.551885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:38:40.332847606 +0000 UTC m=+2329.551649653" watchObservedRunningTime="2026-07-28 14:38:40.333730077 +0000 UTC m=+2329.552532122"
Jul 28 14:38:46.322596 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:38:46.322516    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:39:08.553298 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.553262    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"]
Jul 28 14:39:08.556552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.556535    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:08.559359 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.559335    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-38f257\""
Jul 28 14:39:08.559503 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.559398    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-38f257-dockercfg-gxnf9\""
Jul 28 14:39:08.566857 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.566828    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"]
Jul 28 14:39:08.580170 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.580139    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"]
Jul 28 14:39:08.583291 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.583272    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:08.594884 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.594616    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"]
Jul 28 14:39:08.638507 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.638463    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/631ece84-b39d-4261-8e26-39fc96da1d61-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr\" (UID: \"631ece84-b39d-4261-8e26-39fc96da1d61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:08.638699 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.638532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnsgg\" (UniqueName: \"kubernetes.io/projected/631ece84-b39d-4261-8e26-39fc96da1d61-kube-api-access-pnsgg\") pod \"payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr\" (UID: \"631ece84-b39d-4261-8e26-39fc96da1d61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:08.638699 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.638561    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwrtz\" (UniqueName: \"kubernetes.io/projected/f6e11e79-0eca-4339-a897-25cb7c5bda4f-kube-api-access-pwrtz\") pod \"payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h\" (UID: \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:08.638699 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.638588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e11e79-0eca-4339-a897-25cb7c5bda4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h\" (UID: \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:08.739695 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.739653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/631ece84-b39d-4261-8e26-39fc96da1d61-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr\" (UID: \"631ece84-b39d-4261-8e26-39fc96da1d61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:08.739895 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.739722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsgg\" (UniqueName: \"kubernetes.io/projected/631ece84-b39d-4261-8e26-39fc96da1d61-kube-api-access-pnsgg\") pod \"payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr\" (UID: \"631ece84-b39d-4261-8e26-39fc96da1d61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:08.739895 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.739841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwrtz\" (UniqueName: \"kubernetes.io/projected/f6e11e79-0eca-4339-a897-25cb7c5bda4f-kube-api-access-pwrtz\") pod \"payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h\" (UID: \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:08.740020 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.739896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e11e79-0eca-4339-a897-25cb7c5bda4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h\" (UID: \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:08.740684 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.740656    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/631ece84-b39d-4261-8e26-39fc96da1d61-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr\" (UID: \"631ece84-b39d-4261-8e26-39fc96da1d61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:08.740821 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.740799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e11e79-0eca-4339-a897-25cb7c5bda4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h\" (UID: \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:08.750939 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.750912    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwrtz\" (UniqueName: \"kubernetes.io/projected/f6e11e79-0eca-4339-a897-25cb7c5bda4f-kube-api-access-pwrtz\") pod \"payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h\" (UID: \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:08.751050 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.750912    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnsgg\" (UniqueName: \"kubernetes.io/projected/631ece84-b39d-4261-8e26-39fc96da1d61-kube-api-access-pnsgg\") pod \"payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr\" (UID: \"631ece84-b39d-4261-8e26-39fc96da1d61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:08.868283 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.868191    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:08.895541 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:08.895503    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:09.019713 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.019506    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"]
Jul 28 14:39:09.022489 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:39:09.022461    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6e11e79_0eca_4339_a897_25cb7c5bda4f.slice/crio-96b03b75152f90e107bf77342521b79b18050076dd6ba20fc9579c441d5982f8 WatchSource:0}: Error finding container 96b03b75152f90e107bf77342521b79b18050076dd6ba20fc9579c441d5982f8: Status 404 returned error can't find the container with id 96b03b75152f90e107bf77342521b79b18050076dd6ba20fc9579c441d5982f8
Jul 28 14:39:09.045761 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.045717    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"]
Jul 28 14:39:09.059045 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:39:09.059017    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631ece84_b39d_4261_8e26_39fc96da1d61.slice/crio-df6ae7328087c36614fc8772b3eb430a8612b0077536d44888cd4673cf05ca56 WatchSource:0}: Error finding container df6ae7328087c36614fc8772b3eb430a8612b0077536d44888cd4673cf05ca56: Status 404 returned error can't find the container with id df6ae7328087c36614fc8772b3eb430a8612b0077536d44888cd4673cf05ca56
Jul 28 14:39:09.448140 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.448096    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h" event={"ID":"f6e11e79-0eca-4339-a897-25cb7c5bda4f","Type":"ContainerStarted","Data":"b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec"}
Jul 28 14:39:09.448422 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.448175    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:39:09.448422 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.448199    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h" event={"ID":"f6e11e79-0eca-4339-a897-25cb7c5bda4f","Type":"ContainerStarted","Data":"96b03b75152f90e107bf77342521b79b18050076dd6ba20fc9579c441d5982f8"}
Jul 28 14:39:09.449821 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.449776    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr" event={"ID":"631ece84-b39d-4261-8e26-39fc96da1d61","Type":"ContainerStarted","Data":"9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f"}
Jul 28 14:39:09.449957 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.449840    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr" event={"ID":"631ece84-b39d-4261-8e26-39fc96da1d61","Type":"ContainerStarted","Data":"df6ae7328087c36614fc8772b3eb430a8612b0077536d44888cd4673cf05ca56"}
Jul 28 14:39:09.449957 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.449935    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:09.466014 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.465966    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h" podStartSLOduration=1.465951518 podStartE2EDuration="1.465951518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:39:09.464904909 +0000 UTC m=+2358.683706955" watchObservedRunningTime="2026-07-28 14:39:09.465951518 +0000 UTC m=+2358.684753563"
Jul 28 14:39:09.482184 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:09.482142    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr" podStartSLOduration=1.482128439 podStartE2EDuration="1.482128439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:39:09.480947525 +0000 UTC m=+2358.699749572" watchObservedRunningTime="2026-07-28 14:39:09.482128439 +0000 UTC m=+2358.700930485"
Jul 28 14:39:20.458386 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:20.458355    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:39:20.458769 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:39:20.458426    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:41:09.417455 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.417415    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"]
Jul 28 14:41:09.417994 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.417678    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz" podUID="0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" containerName="maas-api" containerID="cri-o://7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490" gracePeriod=30
Jul 28 14:41:09.678548 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.678480    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:41:09.845807 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.845752    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls\") pod \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") "
Jul 28 14:41:09.846004 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.845864    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-openshift-service-ca\") pod \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") "
Jul 28 14:41:09.846004 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.845903    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mbjf\" (UniqueName: \"kubernetes.io/projected/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-kube-api-access-7mbjf\") pod \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\" (UID: \"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b\") "
Jul 28 14:41:09.846251 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.846222    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" (UID: "0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:41:09.847993 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.847973    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-kube-api-access-7mbjf" (OuterVolumeSpecName: "kube-api-access-7mbjf") pod "0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" (UID: "0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b"). InnerVolumeSpecName "kube-api-access-7mbjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:09.848161 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.848146    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" (UID: "0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:41:09.947467 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.947375    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mbjf\" (UniqueName: \"kubernetes.io/projected/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-kube-api-access-7mbjf\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:41:09.947467 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.947408    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:41:09.947467 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:09.947417    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:41:10.003062 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.003026    2571 generic.go:356] "Generic (PLEG): container finished" podID="0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" containerID="7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490" exitCode=0
Jul 28 14:41:10.003225 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.003074    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"
Jul 28 14:41:10.003225 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.003108    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz" event={"ID":"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b","Type":"ContainerDied","Data":"7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490"}
Jul 28 14:41:10.003225 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.003159    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz" event={"ID":"0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b","Type":"ContainerDied","Data":"1eae0e5a48abc8afc4ee7d58a85b9c18ef6251e37c2ade7eca26e18671683590"}
Jul 28 14:41:10.003225 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.003180    2571 scope.go:117] "RemoveContainer" containerID="7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490"
Jul 28 14:41:10.012596 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.012577    2571 scope.go:117] "RemoveContainer" containerID="7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490"
Jul 28 14:41:10.012895 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:41:10.012876    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490\": container with ID starting with 7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490 not found: ID does not exist" containerID="7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490"
Jul 28 14:41:10.012970 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.012910    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490"} err="failed to get container status \"7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490\": rpc error: code = NotFound desc = could not find container \"7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490\": container with ID starting with 7acaa766e96f1d3e2dfa844bda460fb50643335cf460d671aba812f88d56d490 not found: ID does not exist"
Jul 28 14:41:10.028223 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.028175    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"]
Jul 28 14:41:10.029824 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:10.029801    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e8f53c-6bcdfc6776-kfvlz"]
Jul 28 14:41:11.343316 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:11.343278    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" path="/var/lib/kubelet/pods/0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b/volumes"
Jul 28 14:41:23.184186 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.184136    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"]
Jul 28 14:41:23.184812 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.184381    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr" podUID="631ece84-b39d-4261-8e26-39fc96da1d61" containerName="payload-processing" containerID="cri-o://9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f" gracePeriod=30
Jul 28 14:41:23.192932 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.192899    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"]
Jul 28 14:41:23.193501 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.193466    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h" podUID="f6e11e79-0eca-4339-a897-25cb7c5bda4f" containerName="payload-pre-processing" containerID="cri-o://b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec" gracePeriod=30
Jul 28 14:41:23.447159 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.447095    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:41:23.468953 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.468924    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/631ece84-b39d-4261-8e26-39fc96da1d61-plugins-config-volume\") pod \"631ece84-b39d-4261-8e26-39fc96da1d61\" (UID: \"631ece84-b39d-4261-8e26-39fc96da1d61\") "
Jul 28 14:41:23.469088 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.468985    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnsgg\" (UniqueName: \"kubernetes.io/projected/631ece84-b39d-4261-8e26-39fc96da1d61-kube-api-access-pnsgg\") pod \"631ece84-b39d-4261-8e26-39fc96da1d61\" (UID: \"631ece84-b39d-4261-8e26-39fc96da1d61\") "
Jul 28 14:41:23.469343 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.469317    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/631ece84-b39d-4261-8e26-39fc96da1d61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "631ece84-b39d-4261-8e26-39fc96da1d61" (UID: "631ece84-b39d-4261-8e26-39fc96da1d61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:41:23.472132 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.472101    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/631ece84-b39d-4261-8e26-39fc96da1d61-kube-api-access-pnsgg" (OuterVolumeSpecName: "kube-api-access-pnsgg") pod "631ece84-b39d-4261-8e26-39fc96da1d61" (UID: "631ece84-b39d-4261-8e26-39fc96da1d61"). InnerVolumeSpecName "kube-api-access-pnsgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:23.479181 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.479159    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:41:23.569941 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.569911    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwrtz\" (UniqueName: \"kubernetes.io/projected/f6e11e79-0eca-4339-a897-25cb7c5bda4f-kube-api-access-pwrtz\") pod \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\" (UID: \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\") "
Jul 28 14:41:23.570121 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.569982    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e11e79-0eca-4339-a897-25cb7c5bda4f-plugins-config-volume\") pod \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\" (UID: \"f6e11e79-0eca-4339-a897-25cb7c5bda4f\") "
Jul 28 14:41:23.570261 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.570244    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/631ece84-b39d-4261-8e26-39fc96da1d61-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:41:23.570318 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.570266    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnsgg\" (UniqueName: \"kubernetes.io/projected/631ece84-b39d-4261-8e26-39fc96da1d61-kube-api-access-pnsgg\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:41:23.570402 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.570377    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6e11e79-0eca-4339-a897-25cb7c5bda4f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6e11e79-0eca-4339-a897-25cb7c5bda4f" (UID: "f6e11e79-0eca-4339-a897-25cb7c5bda4f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:41:23.572089 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.572068    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6e11e79-0eca-4339-a897-25cb7c5bda4f-kube-api-access-pwrtz" (OuterVolumeSpecName: "kube-api-access-pwrtz") pod "f6e11e79-0eca-4339-a897-25cb7c5bda4f" (UID: "f6e11e79-0eca-4339-a897-25cb7c5bda4f"). InnerVolumeSpecName "kube-api-access-pwrtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:23.670729 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.670692    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwrtz\" (UniqueName: \"kubernetes.io/projected/f6e11e79-0eca-4339-a897-25cb7c5bda4f-kube-api-access-pwrtz\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:41:23.670729 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:23.670724    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6e11e79-0eca-4339-a897-25cb7c5bda4f-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:41:24.070636 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.070600    2571 generic.go:356] "Generic (PLEG): container finished" podID="631ece84-b39d-4261-8e26-39fc96da1d61" containerID="9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f" exitCode=0
Jul 28 14:41:24.070857 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.070644    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"
Jul 28 14:41:24.070857 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.070683    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr" event={"ID":"631ece84-b39d-4261-8e26-39fc96da1d61","Type":"ContainerDied","Data":"9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f"}
Jul 28 14:41:24.070857 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.070734    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr" event={"ID":"631ece84-b39d-4261-8e26-39fc96da1d61","Type":"ContainerDied","Data":"df6ae7328087c36614fc8772b3eb430a8612b0077536d44888cd4673cf05ca56"}
Jul 28 14:41:24.071975 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.070759    2571 scope.go:117] "RemoveContainer" containerID="9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f"
Jul 28 14:41:24.072086 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.072007    2571 generic.go:356] "Generic (PLEG): container finished" podID="f6e11e79-0eca-4339-a897-25cb7c5bda4f" containerID="b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec" exitCode=0
Jul 28 14:41:24.072086 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.072062    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h" event={"ID":"f6e11e79-0eca-4339-a897-25cb7c5bda4f","Type":"ContainerDied","Data":"b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec"}
Jul 28 14:41:24.072187 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.072103    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h" event={"ID":"f6e11e79-0eca-4339-a897-25cb7c5bda4f","Type":"ContainerDied","Data":"96b03b75152f90e107bf77342521b79b18050076dd6ba20fc9579c441d5982f8"}
Jul 28 14:41:24.072187 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.072066    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"
Jul 28 14:41:24.081016 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.080999    2571 scope.go:117] "RemoveContainer" containerID="9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f"
Jul 28 14:41:24.081307 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:41:24.081280    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f\": container with ID starting with 9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f not found: ID does not exist" containerID="9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f"
Jul 28 14:41:24.081402 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.081314    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f"} err="failed to get container status \"9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f\": rpc error: code = NotFound desc = could not find container \"9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f\": container with ID starting with 9f197738fa94752c47fce389bae1cfcb6e8ac160db5587980b25b8e10b105a9f not found: ID does not exist"
Jul 28 14:41:24.081402 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.081335    2571 scope.go:117] "RemoveContainer" containerID="b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec"
Jul 28 14:41:24.089057 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.089031    2571 scope.go:117] "RemoveContainer" containerID="b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec"
Jul 28 14:41:24.089305 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:41:24.089287    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec\": container with ID starting with b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec not found: ID does not exist" containerID="b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec"
Jul 28 14:41:24.089362 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.089314    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec"} err="failed to get container status \"b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec\": rpc error: code = NotFound desc = could not find container \"b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec\": container with ID starting with b0f04710d824704c8e40a9f6e6cb33424cfade0f487900f7ed6869e208a0adec not found: ID does not exist"
Jul 28 14:41:24.096877 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.096854    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"]
Jul 28 14:41:24.101748 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.101726    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-38f257-7c49cd4bc8-f75rr"]
Jul 28 14:41:24.114367 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.114345    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"]
Jul 28 14:41:24.119656 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:24.119632    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-38f257-6855f85944-s8g8h"]
Jul 28 14:41:25.343266 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:25.343231    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="631ece84-b39d-4261-8e26-39fc96da1d61" path="/var/lib/kubelet/pods/631ece84-b39d-4261-8e26-39fc96da1d61/volumes"
Jul 28 14:41:25.343637 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:25.343581    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6e11e79-0eca-4339-a897-25cb7c5bda4f" path="/var/lib/kubelet/pods/f6e11e79-0eca-4339-a897-25cb7c5bda4f/volumes"
Jul 28 14:41:34.610977 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.610940    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"]
Jul 28 14:41:34.611340 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611270    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="631ece84-b39d-4261-8e26-39fc96da1d61" containerName="payload-processing"
Jul 28 14:41:34.611340 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611284    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="631ece84-b39d-4261-8e26-39fc96da1d61" containerName="payload-processing"
Jul 28 14:41:34.611340 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611313    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6e11e79-0eca-4339-a897-25cb7c5bda4f" containerName="payload-pre-processing"
Jul 28 14:41:34.611340 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611319    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6e11e79-0eca-4339-a897-25cb7c5bda4f" containerName="payload-pre-processing"
Jul 28 14:41:34.611340 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611331    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" containerName="maas-api"
Jul 28 14:41:34.611340 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611336    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" containerName="maas-api"
Jul 28 14:41:34.611524 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611394    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="631ece84-b39d-4261-8e26-39fc96da1d61" containerName="payload-processing"
Jul 28 14:41:34.611524 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611405    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cdc954a-6dc0-4b7a-adf3-f4a42fb97a4b" containerName="maas-api"
Jul 28 14:41:34.611524 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.611412    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6e11e79-0eca-4339-a897-25cb7c5bda4f" containerName="payload-pre-processing"
Jul 28 14:41:34.614312 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.614284    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.616704 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.616683    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-4e9663-serving-cert\""
Jul 28 14:41:34.624909 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.624884    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"]
Jul 28 14:41:34.665138 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.665099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r6fw\" (UniqueName: \"kubernetes.io/projected/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-kube-api-access-2r6fw\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.665138 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.665141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-maas-api-tls\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.665345 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.665167    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-openshift-service-ca\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.766179 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.766137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r6fw\" (UniqueName: \"kubernetes.io/projected/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-kube-api-access-2r6fw\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.766179 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.766185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-maas-api-tls\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.766402 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.766214    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-openshift-service-ca\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.766925 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.766901    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-openshift-service-ca\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.768942 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.768915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-maas-api-tls\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.776933 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.776907    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r6fw\" (UniqueName: \"kubernetes.io/projected/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-kube-api-access-2r6fw\") pod \"maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:34.927606 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:34.927564    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:35.061972 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.061945    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"]
Jul 28 14:41:35.064581 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:41:35.064549    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f9c922_c1e3_4f5f_b8be_4a8f3d492400.slice/crio-9bc883080e28ba42bab9318ca27f77127215ccd8db90e6f2cdd8bdaa3c5e85a5 WatchSource:0}: Error finding container 9bc883080e28ba42bab9318ca27f77127215ccd8db90e6f2cdd8bdaa3c5e85a5: Status 404 returned error can't find the container with id 9bc883080e28ba42bab9318ca27f77127215ccd8db90e6f2cdd8bdaa3c5e85a5
Jul 28 14:41:35.065948 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.065934    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 14:41:35.124961 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.124923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6" event={"ID":"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400","Type":"ContainerStarted","Data":"9bc883080e28ba42bab9318ca27f77127215ccd8db90e6f2cdd8bdaa3c5e85a5"}
Jul 28 14:41:35.518921 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.518884    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"]
Jul 28 14:41:35.523169 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.523149    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:35.525837 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.525808    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-4e9663-dockercfg-zwk4t\""
Jul 28 14:41:35.525957 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.525811    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-4e9663\""
Jul 28 14:41:35.532465 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.532433    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"]
Jul 28 14:41:35.574892 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.574861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ba8c7c-2159-4ad6-9cba-0d55233070c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm\" (UID: \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:35.575070 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.574916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6fvj\" (UniqueName: \"kubernetes.io/projected/42ba8c7c-2159-4ad6-9cba-0d55233070c0-kube-api-access-w6fvj\") pod \"payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm\" (UID: \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:35.675579 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.675545    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ba8c7c-2159-4ad6-9cba-0d55233070c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm\" (UID: \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:35.676098 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.675601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6fvj\" (UniqueName: \"kubernetes.io/projected/42ba8c7c-2159-4ad6-9cba-0d55233070c0-kube-api-access-w6fvj\") pod \"payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm\" (UID: \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:35.676277 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.676256    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ba8c7c-2159-4ad6-9cba-0d55233070c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm\" (UID: \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:35.685343 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.685315    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6fvj\" (UniqueName: \"kubernetes.io/projected/42ba8c7c-2159-4ad6-9cba-0d55233070c0-kube-api-access-w6fvj\") pod \"payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm\" (UID: \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:35.836243 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.836116    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:35.974089 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:35.973933    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"]
Jul 28 14:41:35.976721 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:41:35.976688    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ba8c7c_2159_4ad6_9cba_0d55233070c0.slice/crio-e90acbd9afdc3452829800a534336d9f9a9876436e47140da3c5f298c0f882de WatchSource:0}: Error finding container e90acbd9afdc3452829800a534336d9f9a9876436e47140da3c5f298c0f882de: Status 404 returned error can't find the container with id e90acbd9afdc3452829800a534336d9f9a9876436e47140da3c5f298c0f882de
Jul 28 14:41:36.131688 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:36.131578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm" event={"ID":"42ba8c7c-2159-4ad6-9cba-0d55233070c0","Type":"ContainerStarted","Data":"203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc"}
Jul 28 14:41:36.131688 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:36.131636    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:41:36.131688 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:36.131656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm" event={"ID":"42ba8c7c-2159-4ad6-9cba-0d55233070c0","Type":"ContainerStarted","Data":"e90acbd9afdc3452829800a534336d9f9a9876436e47140da3c5f298c0f882de"}
Jul 28 14:41:36.133227 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:36.133199    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6" event={"ID":"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400","Type":"ContainerStarted","Data":"a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b"}
Jul 28 14:41:36.133349 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:36.133309    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:36.150196 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:36.150142    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm" podStartSLOduration=1.150124294 podStartE2EDuration="1.150124294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:41:36.148283461 +0000 UTC m=+2505.367085521" watchObservedRunningTime="2026-07-28 14:41:36.150124294 +0000 UTC m=+2505.368926377"
Jul 28 14:41:36.170029 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:36.169976    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6" podStartSLOduration=1.6009064039999998 podStartE2EDuration="2.169958753s" totalImagesPullingTime="569.052349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:41:36.168084939 +0000 UTC m=+2505.386886986" watchObservedRunningTime="2026-07-28 14:41:36.169958753 +0000 UTC m=+2505.388760799"
Jul 28 14:41:42.142727 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:42.142696    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:41:47.139729 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:41:47.139699    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:42:03.636771 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.636735    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"]
Jul 28 14:42:03.640841 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.640814    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:03.643811 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.643772    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a409a3-serving-cert\""
Jul 28 14:42:03.653878 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.653846    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"]
Jul 28 14:42:03.733212 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.733164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zczk7\" (UniqueName: \"kubernetes.io/projected/614e79bf-9d27-425b-bb89-51ec39ee77b6-kube-api-access-zczk7\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:03.733400 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.733290    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:03.733400 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.733342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/614e79bf-9d27-425b-bb89-51ec39ee77b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:03.834180 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.834145    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/614e79bf-9d27-425b-bb89-51ec39ee77b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:03.834362 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.834203    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zczk7\" (UniqueName: \"kubernetes.io/projected/614e79bf-9d27-425b-bb89-51ec39ee77b6-kube-api-access-zczk7\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:03.834362 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.834252    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:03.834362 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:42:03.834344    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-serving-cert: secret "maas-api-e2e-api-b-a409a3-serving-cert" not found
Jul 28 14:42:03.834490 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:42:03.834406    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls podName:614e79bf-9d27-425b-bb89-51ec39ee77b6 nodeName:}" failed. No retries permitted until 2026-07-28 14:42:04.334390775 +0000 UTC m=+2533.553192799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls") pod "maas-api-e2e-api-b-a409a3-5979bccd58-slm5w" (UID: "614e79bf-9d27-425b-bb89-51ec39ee77b6") : secret "maas-api-e2e-api-b-a409a3-serving-cert" not found
Jul 28 14:42:03.834878 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.834859    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/614e79bf-9d27-425b-bb89-51ec39ee77b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:03.844420 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:03.844378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zczk7\" (UniqueName: \"kubernetes.io/projected/614e79bf-9d27-425b-bb89-51ec39ee77b6-kube-api-access-zczk7\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:04.339235 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.339193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:04.341687 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.341663    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls\") pod \"maas-api-e2e-api-b-a409a3-5979bccd58-slm5w\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:04.408909 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.408875    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"]
Jul 28 14:42:04.412956 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.412847    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:04.415618 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.415593    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a409a3-dockercfg-n8zj2\""
Jul 28 14:42:04.415965 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.415941    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a409a3\""
Jul 28 14:42:04.421630 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.421604    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"]
Jul 28 14:42:04.541279 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.541243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-767vr\" (UniqueName: \"kubernetes.io/projected/d4198905-4ff3-42bd-9652-938a784c2613-kube-api-access-767vr\") pod \"payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn\" (UID: \"d4198905-4ff3-42bd-9652-938a784c2613\") " pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:04.541279 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.541297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4198905-4ff3-42bd-9652-938a784c2613-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn\" (UID: \"d4198905-4ff3-42bd-9652-938a784c2613\") " pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:04.557370 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.557331    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:04.643041 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.642641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767vr\" (UniqueName: \"kubernetes.io/projected/d4198905-4ff3-42bd-9652-938a784c2613-kube-api-access-767vr\") pod \"payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn\" (UID: \"d4198905-4ff3-42bd-9652-938a784c2613\") " pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:04.643041 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.642709    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4198905-4ff3-42bd-9652-938a784c2613-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn\" (UID: \"d4198905-4ff3-42bd-9652-938a784c2613\") " pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:04.643986 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.643626    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4198905-4ff3-42bd-9652-938a784c2613-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn\" (UID: \"d4198905-4ff3-42bd-9652-938a784c2613\") " pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:04.652427 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.652392    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-767vr\" (UniqueName: \"kubernetes.io/projected/d4198905-4ff3-42bd-9652-938a784c2613-kube-api-access-767vr\") pod \"payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn\" (UID: \"d4198905-4ff3-42bd-9652-938a784c2613\") " pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:04.702731 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.702701    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"]
Jul 28 14:42:04.705508 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:42:04.705480    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614e79bf_9d27_425b_bb89_51ec39ee77b6.slice/crio-0bccd60559a7fe0c823094f767fb83f0d39dcedc839d5d9855977c6af6c5adb2 WatchSource:0}: Error finding container 0bccd60559a7fe0c823094f767fb83f0d39dcedc839d5d9855977c6af6c5adb2: Status 404 returned error can't find the container with id 0bccd60559a7fe0c823094f767fb83f0d39dcedc839d5d9855977c6af6c5adb2
Jul 28 14:42:04.725268 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.725228    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:04.868943 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:04.868913    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"]
Jul 28 14:42:04.871834 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:42:04.871775    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4198905_4ff3_42bd_9652_938a784c2613.slice/crio-2e0e339bc81bb60ec9d197fa6ee8b0ce178b36fe45b7708109f98ad4d0a95d50 WatchSource:0}: Error finding container 2e0e339bc81bb60ec9d197fa6ee8b0ce178b36fe45b7708109f98ad4d0a95d50: Status 404 returned error can't find the container with id 2e0e339bc81bb60ec9d197fa6ee8b0ce178b36fe45b7708109f98ad4d0a95d50
Jul 28 14:42:05.266094 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:05.266062    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn" event={"ID":"d4198905-4ff3-42bd-9652-938a784c2613","Type":"ContainerStarted","Data":"66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c"}
Jul 28 14:42:05.266288 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:05.266112    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn" event={"ID":"d4198905-4ff3-42bd-9652-938a784c2613","Type":"ContainerStarted","Data":"2e0e339bc81bb60ec9d197fa6ee8b0ce178b36fe45b7708109f98ad4d0a95d50"}
Jul 28 14:42:05.266288 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:05.266169    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:05.267283 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:05.267259    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w" event={"ID":"614e79bf-9d27-425b-bb89-51ec39ee77b6","Type":"ContainerStarted","Data":"0bccd60559a7fe0c823094f767fb83f0d39dcedc839d5d9855977c6af6c5adb2"}
Jul 28 14:42:05.284033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:05.283977    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn" podStartSLOduration=1.283955401 podStartE2EDuration="1.283955401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:42:05.283448514 +0000 UTC m=+2534.502250561" watchObservedRunningTime="2026-07-28 14:42:05.283955401 +0000 UTC m=+2534.502757448"
Jul 28 14:42:06.279583 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:06.279546    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w" event={"ID":"614e79bf-9d27-425b-bb89-51ec39ee77b6","Type":"ContainerStarted","Data":"0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b"}
Jul 28 14:42:06.280024 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:06.279805    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:06.300223 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:06.300178    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w" podStartSLOduration=2.779285288 podStartE2EDuration="3.300164514s" totalImagesPullingTime="520.879226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:42:06.299831251 +0000 UTC m=+2535.518633297" watchObservedRunningTime="2026-07-28 14:42:06.300164514 +0000 UTC m=+2535.518966586"
Jul 28 14:42:12.288771 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:12.288741    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:42:16.282146 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:16.282109    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:42:47.470629 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.470595    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"]
Jul 28 14:42:47.471236 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.470822    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6" podUID="c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" containerName="maas-api" containerID="cri-o://a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b" gracePeriod=30
Jul 28 14:42:47.542897 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.542860    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"]
Jul 28 14:42:47.543141 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.543113    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm" podUID="42ba8c7c-2159-4ad6-9cba-0d55233070c0" containerName="payload-pre-processing" containerID="cri-o://203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc" gracePeriod=30
Jul 28 14:42:47.819243 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.819215    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:42:47.834476 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.834449    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:42:47.932478 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.932437    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-maas-api-tls\") pod \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") "
Jul 28 14:42:47.932677 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.932488    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6fvj\" (UniqueName: \"kubernetes.io/projected/42ba8c7c-2159-4ad6-9cba-0d55233070c0-kube-api-access-w6fvj\") pod \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\" (UID: \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\") "
Jul 28 14:42:47.932677 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.932513    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-openshift-service-ca\") pod \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") "
Jul 28 14:42:47.932677 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.932589    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r6fw\" (UniqueName: \"kubernetes.io/projected/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-kube-api-access-2r6fw\") pod \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\" (UID: \"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400\") "
Jul 28 14:42:47.932677 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.932623    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ba8c7c-2159-4ad6-9cba-0d55233070c0-plugins-config-volume\") pod \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\" (UID: \"42ba8c7c-2159-4ad6-9cba-0d55233070c0\") "
Jul 28 14:42:47.933027 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.932990    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" (UID: "c2f9c922-c1e3-4f5f-b8be-4a8f3d492400"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:42:47.933123 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.933079    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ba8c7c-2159-4ad6-9cba-0d55233070c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42ba8c7c-2159-4ad6-9cba-0d55233070c0" (UID: "42ba8c7c-2159-4ad6-9cba-0d55233070c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:42:47.934724 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.934694    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-kube-api-access-2r6fw" (OuterVolumeSpecName: "kube-api-access-2r6fw") pod "c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" (UID: "c2f9c922-c1e3-4f5f-b8be-4a8f3d492400"). InnerVolumeSpecName "kube-api-access-2r6fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:42:47.934724 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.934698    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" (UID: "c2f9c922-c1e3-4f5f-b8be-4a8f3d492400"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:42:47.934724 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:47.934710    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ba8c7c-2159-4ad6-9cba-0d55233070c0-kube-api-access-w6fvj" (OuterVolumeSpecName: "kube-api-access-w6fvj") pod "42ba8c7c-2159-4ad6-9cba-0d55233070c0" (UID: "42ba8c7c-2159-4ad6-9cba-0d55233070c0"). InnerVolumeSpecName "kube-api-access-w6fvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:42:48.033642 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.033554    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r6fw\" (UniqueName: \"kubernetes.io/projected/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-kube-api-access-2r6fw\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:42:48.033642 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.033583    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ba8c7c-2159-4ad6-9cba-0d55233070c0-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:42:48.033642 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.033593    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:42:48.033642 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.033601    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6fvj\" (UniqueName: \"kubernetes.io/projected/42ba8c7c-2159-4ad6-9cba-0d55233070c0-kube-api-access-w6fvj\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:42:48.033642 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.033612    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:42:48.474577 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.474542    2571 generic.go:356] "Generic (PLEG): container finished" podID="42ba8c7c-2159-4ad6-9cba-0d55233070c0" containerID="203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc" exitCode=0
Jul 28 14:42:48.475075 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.474602    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"
Jul 28 14:42:48.475075 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.474632    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm" event={"ID":"42ba8c7c-2159-4ad6-9cba-0d55233070c0","Type":"ContainerDied","Data":"203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc"}
Jul 28 14:42:48.475075 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.474688    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm" event={"ID":"42ba8c7c-2159-4ad6-9cba-0d55233070c0","Type":"ContainerDied","Data":"e90acbd9afdc3452829800a534336d9f9a9876436e47140da3c5f298c0f882de"}
Jul 28 14:42:48.475075 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.474715    2571 scope.go:117] "RemoveContainer" containerID="203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc"
Jul 28 14:42:48.476148 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.476029    2571 generic.go:356] "Generic (PLEG): container finished" podID="c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" containerID="a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b" exitCode=0
Jul 28 14:42:48.476148 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.476080    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"
Jul 28 14:42:48.476148 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.476117    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6" event={"ID":"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400","Type":"ContainerDied","Data":"a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b"}
Jul 28 14:42:48.476346 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.476152    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6" event={"ID":"c2f9c922-c1e3-4f5f-b8be-4a8f3d492400","Type":"ContainerDied","Data":"9bc883080e28ba42bab9318ca27f77127215ccd8db90e6f2cdd8bdaa3c5e85a5"}
Jul 28 14:42:48.493187 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.493169    2571 scope.go:117] "RemoveContainer" containerID="203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc"
Jul 28 14:42:48.493477 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:42:48.493462    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc\": container with ID starting with 203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc not found: ID does not exist" containerID="203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc"
Jul 28 14:42:48.493533 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.493485    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc"} err="failed to get container status \"203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc\": rpc error: code = NotFound desc = could not find container \"203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc\": container with ID starting with 203d6a4499fe122700084ef8fbdd430a518bd72c01d2c664086390ccb8a4f9bc not found: ID does not exist"
Jul 28 14:42:48.493533 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.493503    2571 scope.go:117] "RemoveContainer" containerID="a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b"
Jul 28 14:42:48.501853 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.501832    2571 scope.go:117] "RemoveContainer" containerID="a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b"
Jul 28 14:42:48.502114 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:42:48.502095    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b\": container with ID starting with a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b not found: ID does not exist" containerID="a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b"
Jul 28 14:42:48.502186 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.502123    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b"} err="failed to get container status \"a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b\": rpc error: code = NotFound desc = could not find container \"a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b\": container with ID starting with a493aa9668d04103b2b679ad39582f371a70ad0dc2b87c5786af162054e92c3b not found: ID does not exist"
Jul 28 14:42:48.508172 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.508147    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"]
Jul 28 14:42:48.521050 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.521019    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4e9663-5cf985dcb8-k5gr6"]
Jul 28 14:42:48.534236 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.534207    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"]
Jul 28 14:42:48.540357 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:48.540331    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4e9663-ff7d9c988-vmdhm"]
Jul 28 14:42:49.343494 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:49.343462    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ba8c7c-2159-4ad6-9cba-0d55233070c0" path="/var/lib/kubelet/pods/42ba8c7c-2159-4ad6-9cba-0d55233070c0/volumes"
Jul 28 14:42:49.343939 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:42:49.343923    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" path="/var/lib/kubelet/pods/c2f9c922-c1e3-4f5f-b8be-4a8f3d492400/volumes"
Jul 28 14:43:10.693049 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:10.693014    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"]
Jul 28 14:43:10.693624 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:10.693297    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w" podUID="614e79bf-9d27-425b-bb89-51ec39ee77b6" containerName="maas-api" containerID="cri-o://0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b" gracePeriod=30
Jul 28 14:43:10.761862 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:10.761829    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"]
Jul 28 14:43:10.762166 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:10.762102    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn" podUID="d4198905-4ff3-42bd-9652-938a784c2613" containerName="payload-processing" containerID="cri-o://66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c" gracePeriod=30
Jul 28 14:43:11.014634 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.014606    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:43:11.023992 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.023965    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zczk7\" (UniqueName: \"kubernetes.io/projected/614e79bf-9d27-425b-bb89-51ec39ee77b6-kube-api-access-zczk7\") pod \"614e79bf-9d27-425b-bb89-51ec39ee77b6\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") "
Jul 28 14:43:11.024095 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.024065    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/614e79bf-9d27-425b-bb89-51ec39ee77b6-openshift-service-ca\") pod \"614e79bf-9d27-425b-bb89-51ec39ee77b6\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") "
Jul 28 14:43:11.024141 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.024110    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls\") pod \"614e79bf-9d27-425b-bb89-51ec39ee77b6\" (UID: \"614e79bf-9d27-425b-bb89-51ec39ee77b6\") "
Jul 28 14:43:11.024508 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.024481    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/614e79bf-9d27-425b-bb89-51ec39ee77b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "614e79bf-9d27-425b-bb89-51ec39ee77b6" (UID: "614e79bf-9d27-425b-bb89-51ec39ee77b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:43:11.026351 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.026322    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "614e79bf-9d27-425b-bb89-51ec39ee77b6" (UID: "614e79bf-9d27-425b-bb89-51ec39ee77b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:43:11.026449 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.026351    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/614e79bf-9d27-425b-bb89-51ec39ee77b6-kube-api-access-zczk7" (OuterVolumeSpecName: "kube-api-access-zczk7") pod "614e79bf-9d27-425b-bb89-51ec39ee77b6" (UID: "614e79bf-9d27-425b-bb89-51ec39ee77b6"). InnerVolumeSpecName "kube-api-access-zczk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:43:11.043871 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.043843    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:43:11.125506 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.125470    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-767vr\" (UniqueName: \"kubernetes.io/projected/d4198905-4ff3-42bd-9652-938a784c2613-kube-api-access-767vr\") pod \"d4198905-4ff3-42bd-9652-938a784c2613\" (UID: \"d4198905-4ff3-42bd-9652-938a784c2613\") "
Jul 28 14:43:11.125676 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.125513    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4198905-4ff3-42bd-9652-938a784c2613-plugins-config-volume\") pod \"d4198905-4ff3-42bd-9652-938a784c2613\" (UID: \"d4198905-4ff3-42bd-9652-938a784c2613\") "
Jul 28 14:43:11.125721 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.125680    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/614e79bf-9d27-425b-bb89-51ec39ee77b6-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:43:11.125721 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.125690    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/614e79bf-9d27-425b-bb89-51ec39ee77b6-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:43:11.125721 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.125699    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zczk7\" (UniqueName: \"kubernetes.io/projected/614e79bf-9d27-425b-bb89-51ec39ee77b6-kube-api-access-zczk7\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:43:11.125978 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.125951    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4198905-4ff3-42bd-9652-938a784c2613-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4198905-4ff3-42bd-9652-938a784c2613" (UID: "d4198905-4ff3-42bd-9652-938a784c2613"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:43:11.127657 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.127634    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4198905-4ff3-42bd-9652-938a784c2613-kube-api-access-767vr" (OuterVolumeSpecName: "kube-api-access-767vr") pod "d4198905-4ff3-42bd-9652-938a784c2613" (UID: "d4198905-4ff3-42bd-9652-938a784c2613"). InnerVolumeSpecName "kube-api-access-767vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:43:11.226102 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.226061    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-767vr\" (UniqueName: \"kubernetes.io/projected/d4198905-4ff3-42bd-9652-938a784c2613-kube-api-access-767vr\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:43:11.226102 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.226093    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4198905-4ff3-42bd-9652-938a784c2613-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:43:11.595368 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.595334    2571 generic.go:356] "Generic (PLEG): container finished" podID="d4198905-4ff3-42bd-9652-938a784c2613" containerID="66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c" exitCode=0
Jul 28 14:43:11.595557 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.595392    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"
Jul 28 14:43:11.595557 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.595424    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn" event={"ID":"d4198905-4ff3-42bd-9652-938a784c2613","Type":"ContainerDied","Data":"66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c"}
Jul 28 14:43:11.595557 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.595505    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn" event={"ID":"d4198905-4ff3-42bd-9652-938a784c2613","Type":"ContainerDied","Data":"2e0e339bc81bb60ec9d197fa6ee8b0ce178b36fe45b7708109f98ad4d0a95d50"}
Jul 28 14:43:11.595557 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.595537    2571 scope.go:117] "RemoveContainer" containerID="66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c"
Jul 28 14:43:11.597034 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.597004    2571 generic.go:356] "Generic (PLEG): container finished" podID="614e79bf-9d27-425b-bb89-51ec39ee77b6" containerID="0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b" exitCode=0
Jul 28 14:43:11.597128 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.597076    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w" event={"ID":"614e79bf-9d27-425b-bb89-51ec39ee77b6","Type":"ContainerDied","Data":"0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b"}
Jul 28 14:43:11.597203 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.597122    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"
Jul 28 14:43:11.597203 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.597161    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w" event={"ID":"614e79bf-9d27-425b-bb89-51ec39ee77b6","Type":"ContainerDied","Data":"0bccd60559a7fe0c823094f767fb83f0d39dcedc839d5d9855977c6af6c5adb2"}
Jul 28 14:43:11.604225 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.604206    2571 scope.go:117] "RemoveContainer" containerID="66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c"
Jul 28 14:43:11.604489 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:43:11.604472    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c\": container with ID starting with 66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c not found: ID does not exist" containerID="66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c"
Jul 28 14:43:11.604555 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.604505    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c"} err="failed to get container status \"66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c\": rpc error: code = NotFound desc = could not find container \"66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c\": container with ID starting with 66ea88e7f7fb204502913a74bb1c3f3ca190404992c1524512a8949ead43067c not found: ID does not exist"
Jul 28 14:43:11.604555 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.604521    2571 scope.go:117] "RemoveContainer" containerID="0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b"
Jul 28 14:43:11.613754 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.613733    2571 scope.go:117] "RemoveContainer" containerID="0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b"
Jul 28 14:43:11.614156 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:43:11.614130    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b\": container with ID starting with 0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b not found: ID does not exist" containerID="0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b"
Jul 28 14:43:11.614686 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.614165    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b"} err="failed to get container status \"0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b\": rpc error: code = NotFound desc = could not find container \"0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b\": container with ID starting with 0cd5e69c080a54f93b9caa5ba67836e15f1b46b7960f81701d72b87a166b246b not found: ID does not exist"
Jul 28 14:43:11.614815 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.614712    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"]
Jul 28 14:43:11.617457 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.617436    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a409a3-5979bccd58-slm5w"]
Jul 28 14:43:11.629565 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.629529    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"]
Jul 28 14:43:11.634611 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:11.634587    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a409a3-74f44cbcf8-b2tsn"]
Jul 28 14:43:13.343621 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:13.343519    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="614e79bf-9d27-425b-bb89-51ec39ee77b6" path="/var/lib/kubelet/pods/614e79bf-9d27-425b-bb89-51ec39ee77b6/volumes"
Jul 28 14:43:13.344151 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:13.344059    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4198905-4ff3-42bd-9652-938a784c2613" path="/var/lib/kubelet/pods/d4198905-4ff3-42bd-9652-938a784c2613/volumes"
Jul 28 14:43:22.114658 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.114621    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"]
Jul 28 14:43:22.115312 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115256    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ba8c7c-2159-4ad6-9cba-0d55233070c0" containerName="payload-pre-processing"
Jul 28 14:43:22.115312 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115278    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ba8c7c-2159-4ad6-9cba-0d55233070c0" containerName="payload-pre-processing"
Jul 28 14:43:22.115312 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115293    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4198905-4ff3-42bd-9652-938a784c2613" containerName="payload-processing"
Jul 28 14:43:22.115312 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115301    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4198905-4ff3-42bd-9652-938a784c2613" containerName="payload-processing"
Jul 28 14:43:22.115536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115317    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="614e79bf-9d27-425b-bb89-51ec39ee77b6" containerName="maas-api"
Jul 28 14:43:22.115536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115326    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="614e79bf-9d27-425b-bb89-51ec39ee77b6" containerName="maas-api"
Jul 28 14:43:22.115536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115346    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" containerName="maas-api"
Jul 28 14:43:22.115536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115356    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" containerName="maas-api"
Jul 28 14:43:22.115536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115449    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="614e79bf-9d27-425b-bb89-51ec39ee77b6" containerName="maas-api"
Jul 28 14:43:22.115536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115463    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2f9c922-c1e3-4f5f-b8be-4a8f3d492400" containerName="maas-api"
Jul 28 14:43:22.115536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115475    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ba8c7c-2159-4ad6-9cba-0d55233070c0" containerName="payload-pre-processing"
Jul 28 14:43:22.115536 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.115485    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4198905-4ff3-42bd-9652-938a784c2613" containerName="payload-processing"
Jul 28 14:43:22.120197 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.120175    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.122802 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.122767    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-910fb6-serving-cert\""
Jul 28 14:43:22.129080 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.129052    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"]
Jul 28 14:43:22.223822 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.223779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.223995 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.223871    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d95b82-7ca8-4c62-837c-f61004350928-openshift-service-ca\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.223995 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.223932    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmgvm\" (UniqueName: \"kubernetes.io/projected/b3d95b82-7ca8-4c62-837c-f61004350928-kube-api-access-fmgvm\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.325308 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.325269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d95b82-7ca8-4c62-837c-f61004350928-openshift-service-ca\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.325490 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.325334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmgvm\" (UniqueName: \"kubernetes.io/projected/b3d95b82-7ca8-4c62-837c-f61004350928-kube-api-access-fmgvm\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.325490 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.325364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.325490 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:43:22.325478    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-serving-cert: secret "maas-api-e2e-shared-a-910fb6-serving-cert" not found
Jul 28 14:43:22.325635 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:43:22.325543    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls podName:b3d95b82-7ca8-4c62-837c-f61004350928 nodeName:}" failed. No retries permitted until 2026-07-28 14:43:22.825526102 +0000 UTC m=+2612.044328126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls") pod "maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4" (UID: "b3d95b82-7ca8-4c62-837c-f61004350928") : secret "maas-api-e2e-shared-a-910fb6-serving-cert" not found
Jul 28 14:43:22.326015 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.325996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d95b82-7ca8-4c62-837c-f61004350928-openshift-service-ca\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.337334 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.337299    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmgvm\" (UniqueName: \"kubernetes.io/projected/b3d95b82-7ca8-4c62-837c-f61004350928-kube-api-access-fmgvm\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.830258 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.830223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:22.832590 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:22.832563    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls\") pod \"maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:23.032137 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:23.032102    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:23.172398 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:23.172371    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"]
Jul 28 14:43:23.174761 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:43:23.174732    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d95b82_7ca8_4c62_837c_f61004350928.slice/crio-64cffad794724e09db3a5f85cc3469f6a49ce91fb62f4d93598998c92e6c6ada WatchSource:0}: Error finding container 64cffad794724e09db3a5f85cc3469f6a49ce91fb62f4d93598998c92e6c6ada: Status 404 returned error can't find the container with id 64cffad794724e09db3a5f85cc3469f6a49ce91fb62f4d93598998c92e6c6ada
Jul 28 14:43:23.652904 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:23.652866    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4" event={"ID":"b3d95b82-7ca8-4c62-837c-f61004350928","Type":"ContainerStarted","Data":"64cffad794724e09db3a5f85cc3469f6a49ce91fb62f4d93598998c92e6c6ada"}
Jul 28 14:43:24.659565 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:24.659531    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4" event={"ID":"b3d95b82-7ca8-4c62-837c-f61004350928","Type":"ContainerStarted","Data":"8698e67a470cdcf2bc3ffb853315d1d2521cc912c2d67024fabd03875a6f5f87"}
Jul 28 14:43:24.659977 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:24.659667    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:24.679189 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:24.679135    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4" podStartSLOduration=2.099550613 podStartE2EDuration="2.679119378s" totalImagesPullingTime="579.568765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:43:24.677135629 +0000 UTC m=+2613.895937675" watchObservedRunningTime="2026-07-28 14:43:24.679119378 +0000 UTC m=+2613.897921420"
Jul 28 14:43:30.669523 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:30.669494    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:43:56.474069 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.474032    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"]
Jul 28 14:43:56.479218 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.479188    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.481926 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.481885    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-baa216-serving-cert\""
Jul 28 14:43:56.489430 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.489402    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"]
Jul 28 14:43:56.534506 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.534461    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghl79\" (UniqueName: \"kubernetes.io/projected/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-kube-api-access-ghl79\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.534686 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.534525    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-maas-api-tls\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.534686 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.534573    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-openshift-service-ca\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.636015 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.635980    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghl79\" (UniqueName: \"kubernetes.io/projected/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-kube-api-access-ghl79\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.636207 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.636028    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-maas-api-tls\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.636207 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.636069    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-openshift-service-ca\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.636646 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.636627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-openshift-service-ca\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.638289 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.638265    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-maas-api-tls\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.645354 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.645326    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghl79\" (UniqueName: \"kubernetes.io/projected/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-kube-api-access-ghl79\") pod \"maas-api-e2e-shared-b-baa216-76b4556974-7bnqm\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.792286 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.792195    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:56.928660 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:56.928632    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"]
Jul 28 14:43:56.931301 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:43:56.931275    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5998d53_8ad1_4e99_af78_9d3de3fa4f49.slice/crio-2e72469c4c2d2dd5d4aacebdc3f88fc8679fb7a057b8a21091918fcb9572f2ac WatchSource:0}: Error finding container 2e72469c4c2d2dd5d4aacebdc3f88fc8679fb7a057b8a21091918fcb9572f2ac: Status 404 returned error can't find the container with id 2e72469c4c2d2dd5d4aacebdc3f88fc8679fb7a057b8a21091918fcb9572f2ac
Jul 28 14:43:57.139363 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.139287    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"]
Jul 28 14:43:57.144168 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.144142    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.147750 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.147725    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-baa216\""
Jul 28 14:43:57.147750 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.147739    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-baa216-dockercfg-jhjhd\""
Jul 28 14:43:57.154470 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.154446    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"]
Jul 28 14:43:57.241621 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.241586    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stfsl\" (UniqueName: \"kubernetes.io/projected/74bb643e-3c42-496e-aafc-6d2e864c16f2-kube-api-access-stfsl\") pod \"payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz\" (UID: \"74bb643e-3c42-496e-aafc-6d2e864c16f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.241824 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.241698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bb643e-3c42-496e-aafc-6d2e864c16f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz\" (UID: \"74bb643e-3c42-496e-aafc-6d2e864c16f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.342432 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.342401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bb643e-3c42-496e-aafc-6d2e864c16f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz\" (UID: \"74bb643e-3c42-496e-aafc-6d2e864c16f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.342735 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.342702    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stfsl\" (UniqueName: \"kubernetes.io/projected/74bb643e-3c42-496e-aafc-6d2e864c16f2-kube-api-access-stfsl\") pod \"payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz\" (UID: \"74bb643e-3c42-496e-aafc-6d2e864c16f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.343218 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.343199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bb643e-3c42-496e-aafc-6d2e864c16f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz\" (UID: \"74bb643e-3c42-496e-aafc-6d2e864c16f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.352640 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.352612    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stfsl\" (UniqueName: \"kubernetes.io/projected/74bb643e-3c42-496e-aafc-6d2e864c16f2-kube-api-access-stfsl\") pod \"payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz\" (UID: \"74bb643e-3c42-496e-aafc-6d2e864c16f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.456595 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.456570    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.595222 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.595197    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"]
Jul 28 14:43:57.597655 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:43:57.597626    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74bb643e_3c42_496e_aafc_6d2e864c16f2.slice/crio-cda4d8f37f1c949abb6daba71c4f2666655fd63c8b3e83f22443079011c46fd4 WatchSource:0}: Error finding container cda4d8f37f1c949abb6daba71c4f2666655fd63c8b3e83f22443079011c46fd4: Status 404 returned error can't find the container with id cda4d8f37f1c949abb6daba71c4f2666655fd63c8b3e83f22443079011c46fd4
Jul 28 14:43:57.815084 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.814982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz" event={"ID":"74bb643e-3c42-496e-aafc-6d2e864c16f2","Type":"ContainerStarted","Data":"daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b"}
Jul 28 14:43:57.815084 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.815050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz" event={"ID":"74bb643e-3c42-496e-aafc-6d2e864c16f2","Type":"ContainerStarted","Data":"cda4d8f37f1c949abb6daba71c4f2666655fd63c8b3e83f22443079011c46fd4"}
Jul 28 14:43:57.815320 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.815086    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:43:57.816713 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.816687    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm" event={"ID":"c5998d53-8ad1-4e99-af78-9d3de3fa4f49","Type":"ContainerStarted","Data":"9c4c0cc25c5882e53c2be8757a0bd28feb086c31b913c6ec85d37bb1bb38ae3c"}
Jul 28 14:43:57.816845 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.816731    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm" event={"ID":"c5998d53-8ad1-4e99-af78-9d3de3fa4f49","Type":"ContainerStarted","Data":"2e72469c4c2d2dd5d4aacebdc3f88fc8679fb7a057b8a21091918fcb9572f2ac"}
Jul 28 14:43:57.816845 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.816756    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:43:57.833769 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.833718    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz" podStartSLOduration=0.833702676 podStartE2EDuration="833.702676ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:43:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:43:57.832878472 +0000 UTC m=+2647.051680521" watchObservedRunningTime="2026-07-28 14:43:57.833702676 +0000 UTC m=+2647.052504700"
Jul 28 14:43:57.852053 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:43:57.851996    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm" podStartSLOduration=1.355158254 podStartE2EDuration="1.851976619s" totalImagesPullingTime="496.818365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:43:57.85125139 +0000 UTC m=+2647.070053439" watchObservedRunningTime="2026-07-28 14:43:57.851976619 +0000 UTC m=+2647.070778667"
Jul 28 14:44:03.827525 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:44:03.827496    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:44:08.823954 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:44:08.823920    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:53:52.133334 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.133247    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"]
Jul 28 14:53:52.136571 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.136552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.139103 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.139071    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-18ece0-openshift-default-dockercfg-rpc7c\""
Jul 28 14:53:52.148128 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.148099    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"]
Jul 28 14:53:52.232063 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-token\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.232266 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232086    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7c2\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-kube-api-access-dr7c2\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.232266 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232218    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-socket\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.232385 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232277    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-certs\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.232385 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232318    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-envoy\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.232385 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-podinfo\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.232527 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232395    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b47f1b5-8605-42d0-b8ca-36534b178881-istiod-ca-cert\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.232527 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-data\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.232620 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.232544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-credential-socket\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.333766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-envoy\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.333836    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-podinfo\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.333871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b47f1b5-8605-42d0-b8ca-36534b178881-istiod-ca-cert\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.333904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-data\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.333956    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-credential-socket\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.333991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-token\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.334058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7c2\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-kube-api-access-dr7c2\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.334139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-socket\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.334186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-certs\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.335033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.334644    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-certs\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.340040 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.339800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-data\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.340040 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.340029    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-socket\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.340495 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.340466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-credential-socket\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.340639 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.340543    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-envoy\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.341417 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.341379    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b47f1b5-8605-42d0-b8ca-36534b178881-istiod-ca-cert\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.343772 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.343751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-podinfo\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.351315 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.351296    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-token\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.355349 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.355325    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7c2\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-kube-api-access-dr7c2\") pod \"e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") " pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.447715 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.447677    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:52.586456 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.586428    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"]
Jul 28 14:53:52.588254 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:53:52.588217    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b47f1b5_8605_42d0_b8ca_36534b178881.slice/crio-07e984b0451a01fb3d11dd5f16f37702af97cba74b6c895e83669131abffee6b WatchSource:0}: Error finding container 07e984b0451a01fb3d11dd5f16f37702af97cba74b6c895e83669131abffee6b: Status 404 returned error can't find the container with id 07e984b0451a01fb3d11dd5f16f37702af97cba74b6c895e83669131abffee6b
Jul 28 14:53:52.590455 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.590418    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:53:52.590543 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.590490    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:53:52.590543 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:52.590518    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:53:53.526218 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:53.526183    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" event={"ID":"5b47f1b5-8605-42d0-b8ca-36534b178881","Type":"ContainerStarted","Data":"8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949"}
Jul 28 14:53:53.526603 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:53.526240    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" event={"ID":"5b47f1b5-8605-42d0-b8ca-36534b178881","Type":"ContainerStarted","Data":"07e984b0451a01fb3d11dd5f16f37702af97cba74b6c895e83669131abffee6b"}
Jul 28 14:53:53.549737 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:53.549658    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" podStartSLOduration=1.549636792 podStartE2EDuration="1.549636792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:53:53.54938531 +0000 UTC m=+3242.768187357" watchObservedRunningTime="2026-07-28 14:53:53.549636792 +0000 UTC m=+3242.768438839"
Jul 28 14:53:54.448840 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:54.448771    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:54.453842 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:54.453817    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:54.531675 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:54.531646    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:53:54.532666 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:53:54.532643    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:54:10.369547 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:10.368909    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:46186->10.134.0.60:15021: read: connection reset by peer" start-of-body=
Jul 28 14:54:10.369547 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:10.369020    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:46186->10.134.0.60:15021: read: connection reset by peer"
Jul 28 14:54:10.611179 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:10.611100    2571 generic.go:356] "Generic (PLEG): container finished" podID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerID="8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949" exitCode=0
Jul 28 14:54:10.611179 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:10.611160    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" event={"ID":"5b47f1b5-8605-42d0-b8ca-36534b178881","Type":"ContainerDied","Data":"8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949"}
Jul 28 14:54:10.611551 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:10.611537    2571 scope.go:117] "RemoveContainer" containerID="8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949"
Jul 28 14:54:10.612546 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:10.612520    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:54:10.612610 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:10.612587    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:54:10.612646 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:10.612617    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 14:54:11.638158 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:11.638116    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" event={"ID":"5b47f1b5-8605-42d0-b8ca-36534b178881","Type":"ContainerStarted","Data":"1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a"}
Jul 28 14:54:12.448587 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:12.448540    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:54:12.448814 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:12.448763    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 28 14:54:12.448869 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:12.448850    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 28 14:54:13.448159 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:13.448124    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 28 14:54:13.448563 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:13.448181    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 28 14:54:14.448258 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:14.448217    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 28 14:54:14.448731 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:14.448286    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 28 14:54:15.448599 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:15.448562    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 28 14:54:15.449015 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:15.448622    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 28 14:54:16.452067 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:16.452030    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:54:16.452540 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:16.452432    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:54:16.453072 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:16.453055    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:54:26.859429 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.859390    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"]
Jul 28 14:54:26.862215 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.862194    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:26.864832 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.864810    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-fd71df-dockercfg-s2qzn\""
Jul 28 14:54:26.864948 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.864815    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-fd71df\""
Jul 28 14:54:26.869354 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.869309    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"]
Jul 28 14:54:26.879626 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.879535    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"]
Jul 28 14:54:26.879964 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.879631    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:26.887230 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.887206    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"]
Jul 28 14:54:26.961249 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.961210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e20fd6a-9a49-48eb-946f-5776330426ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj\" (UID: \"2e20fd6a-9a49-48eb-946f-5776330426ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:26.961249 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.961265    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ph4\" (UniqueName: \"kubernetes.io/projected/96a39b04-25da-43e9-b8a2-8b59f8513742-kube-api-access-22ph4\") pod \"payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j\" (UID: \"96a39b04-25da-43e9-b8a2-8b59f8513742\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:26.961491 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.961327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgr9g\" (UniqueName: \"kubernetes.io/projected/2e20fd6a-9a49-48eb-946f-5776330426ab-kube-api-access-sgr9g\") pod \"payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj\" (UID: \"2e20fd6a-9a49-48eb-946f-5776330426ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:26.961491 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:26.961360    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96a39b04-25da-43e9-b8a2-8b59f8513742-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j\" (UID: \"96a39b04-25da-43e9-b8a2-8b59f8513742\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:27.062278 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.062243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e20fd6a-9a49-48eb-946f-5776330426ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj\" (UID: \"2e20fd6a-9a49-48eb-946f-5776330426ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:27.062278 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.062280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ph4\" (UniqueName: \"kubernetes.io/projected/96a39b04-25da-43e9-b8a2-8b59f8513742-kube-api-access-22ph4\") pod \"payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j\" (UID: \"96a39b04-25da-43e9-b8a2-8b59f8513742\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:27.062531 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.062417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgr9g\" (UniqueName: \"kubernetes.io/projected/2e20fd6a-9a49-48eb-946f-5776330426ab-kube-api-access-sgr9g\") pod \"payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj\" (UID: \"2e20fd6a-9a49-48eb-946f-5776330426ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:27.062531 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.062473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96a39b04-25da-43e9-b8a2-8b59f8513742-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j\" (UID: \"96a39b04-25da-43e9-b8a2-8b59f8513742\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:27.063069 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.063052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e20fd6a-9a49-48eb-946f-5776330426ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj\" (UID: \"2e20fd6a-9a49-48eb-946f-5776330426ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:27.063138 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.063119    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96a39b04-25da-43e9-b8a2-8b59f8513742-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j\" (UID: \"96a39b04-25da-43e9-b8a2-8b59f8513742\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:27.071132 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.071107    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgr9g\" (UniqueName: \"kubernetes.io/projected/2e20fd6a-9a49-48eb-946f-5776330426ab-kube-api-access-sgr9g\") pod \"payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj\" (UID: \"2e20fd6a-9a49-48eb-946f-5776330426ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:27.071243 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.071209    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ph4\" (UniqueName: \"kubernetes.io/projected/96a39b04-25da-43e9-b8a2-8b59f8513742-kube-api-access-22ph4\") pod \"payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j\" (UID: \"96a39b04-25da-43e9-b8a2-8b59f8513742\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:27.175288 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.175254    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:27.193050 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.193018    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:27.341693 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:54:27.341660    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e20fd6a_9a49_48eb_946f_5776330426ab.slice/crio-4b69609c4ca535348fdfe3717c337bd9f0244c796ade631b1a0d5c2314df6f1e WatchSource:0}: Error finding container 4b69609c4ca535348fdfe3717c337bd9f0244c796ade631b1a0d5c2314df6f1e: Status 404 returned error can't find the container with id 4b69609c4ca535348fdfe3717c337bd9f0244c796ade631b1a0d5c2314df6f1e
Jul 28 14:54:27.344986 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.344965    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"]
Jul 28 14:54:27.364412 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.364330    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"]
Jul 28 14:54:27.371884 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:54:27.371856    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a39b04_25da_43e9_b8a2_8b59f8513742.slice/crio-95ee47c7b78a0a070bd37ebca4a550a613067fc9426121a63784e52f5c1e42e2 WatchSource:0}: Error finding container 95ee47c7b78a0a070bd37ebca4a550a613067fc9426121a63784e52f5c1e42e2: Status 404 returned error can't find the container with id 95ee47c7b78a0a070bd37ebca4a550a613067fc9426121a63784e52f5c1e42e2
Jul 28 14:54:27.719428 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.719392    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj" event={"ID":"2e20fd6a-9a49-48eb-946f-5776330426ab","Type":"ContainerStarted","Data":"58aa854ae243f96d4cc9a6964ff2d9e1e78e8dedcecdc92de5188d7a507dda8b"}
Jul 28 14:54:27.719636 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.719456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj" event={"ID":"2e20fd6a-9a49-48eb-946f-5776330426ab","Type":"ContainerStarted","Data":"4b69609c4ca535348fdfe3717c337bd9f0244c796ade631b1a0d5c2314df6f1e"}
Jul 28 14:54:27.719636 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.719584    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:27.721082 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.721057    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j" event={"ID":"96a39b04-25da-43e9-b8a2-8b59f8513742","Type":"ContainerStarted","Data":"5c884fea27227285746b5d563417321c2a0839fb8f9c106db4964fa3018630ca"}
Jul 28 14:54:27.721200 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.721102    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j" event={"ID":"96a39b04-25da-43e9-b8a2-8b59f8513742","Type":"ContainerStarted","Data":"95ee47c7b78a0a070bd37ebca4a550a613067fc9426121a63784e52f5c1e42e2"}
Jul 28 14:54:27.721200 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.721140    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:27.738376 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.738321    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj" podStartSLOduration=1.7383042149999999 podStartE2EDuration="1.738304215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:54:27.736228944 +0000 UTC m=+3276.955030981" watchObservedRunningTime="2026-07-28 14:54:27.738304215 +0000 UTC m=+3276.957106265"
Jul 28 14:54:27.756056 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:27.755981    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j" podStartSLOduration=1.755960097 podStartE2EDuration="1.755960097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:54:27.753887556 +0000 UTC m=+3276.972689604" watchObservedRunningTime="2026-07-28 14:54:27.755960097 +0000 UTC m=+3276.974762144"
Jul 28 14:54:38.727757 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:38.727720    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:54:38.728229 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:38.727825    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:54:46.415164 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:46.415132    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-s9nv8_4e48844b-ea34-4c14-aecf-d84c67656c69/payload-processing/0.log"
Jul 28 14:54:46.546231 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:54:46.546198    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j_96a39b04-25da-43e9-b8a2-8b59f8513742/payload-processing/0.log"
Jul 28 14:55:43.936003 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:43.935968    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-s9nv8_4e48844b-ea34-4c14-aecf-d84c67656c69/payload-processing/0.log"
Jul 28 14:55:44.061297 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:44.061266    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j_96a39b04-25da-43e9-b8a2-8b59f8513742/payload-processing/0.log"
Jul 28 14:55:49.755449 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.755413    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"]
Jul 28 14:55:49.758750 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.758733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:49.761838 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.761812    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-694dae\""
Jul 28 14:55:49.761970 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.761838    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-694dae-dockercfg-kdjxv\""
Jul 28 14:55:49.768830 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.768802    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"]
Jul 28 14:55:49.826760 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.826716    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e283a4-3f16-48a9-946c-b74f709a817d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp\" (UID: \"b5e283a4-3f16-48a9-946c-b74f709a817d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:49.826760 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.826755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pq9v\" (UniqueName: \"kubernetes.io/projected/b5e283a4-3f16-48a9-946c-b74f709a817d-kube-api-access-6pq9v\") pod \"payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp\" (UID: \"b5e283a4-3f16-48a9-946c-b74f709a817d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:49.927770 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.927727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e283a4-3f16-48a9-946c-b74f709a817d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp\" (UID: \"b5e283a4-3f16-48a9-946c-b74f709a817d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:49.927770 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.927771    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pq9v\" (UniqueName: \"kubernetes.io/projected/b5e283a4-3f16-48a9-946c-b74f709a817d-kube-api-access-6pq9v\") pod \"payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp\" (UID: \"b5e283a4-3f16-48a9-946c-b74f709a817d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:49.928474 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.928453    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e283a4-3f16-48a9-946c-b74f709a817d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp\" (UID: \"b5e283a4-3f16-48a9-946c-b74f709a817d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:49.937438 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:49.937413    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pq9v\" (UniqueName: \"kubernetes.io/projected/b5e283a4-3f16-48a9-946c-b74f709a817d-kube-api-access-6pq9v\") pod \"payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp\" (UID: \"b5e283a4-3f16-48a9-946c-b74f709a817d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:50.071384 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:50.071295    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:50.215077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:50.215054    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"]
Jul 28 14:55:50.217080 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:55:50.217054    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e283a4_3f16_48a9_946c_b74f709a817d.slice/crio-102186195fe16473f25c77d625d0a52bb8eec0c3457cefe0a0214a606837c84a WatchSource:0}: Error finding container 102186195fe16473f25c77d625d0a52bb8eec0c3457cefe0a0214a606837c84a: Status 404 returned error can't find the container with id 102186195fe16473f25c77d625d0a52bb8eec0c3457cefe0a0214a606837c84a
Jul 28 14:55:51.119019 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:51.118979    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp" event={"ID":"b5e283a4-3f16-48a9-946c-b74f709a817d","Type":"ContainerStarted","Data":"944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75"}
Jul 28 14:55:51.119419 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:51.119046    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp" event={"ID":"b5e283a4-3f16-48a9-946c-b74f709a817d","Type":"ContainerStarted","Data":"102186195fe16473f25c77d625d0a52bb8eec0c3457cefe0a0214a606837c84a"}
Jul 28 14:55:51.119419 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:51.119085    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:55:51.137243 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:55:51.137195    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp" podStartSLOduration=2.137180164 podStartE2EDuration="2.137180164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:51.136279982 +0000 UTC m=+3360.355082030" watchObservedRunningTime="2026-07-28 14:55:51.137180164 +0000 UTC m=+3360.355982208"
Jul 28 14:56:02.125645 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:02.125610    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:56:11.641182 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:11.641144    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"]
Jul 28 14:56:11.641584 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:11.641353    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp" podUID="b5e283a4-3f16-48a9-946c-b74f709a817d" containerName="payload-processing" containerID="cri-o://944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75" gracePeriod=30
Jul 28 14:56:11.909255 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:11.909230    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:56:11.944840 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:11.944779    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pq9v\" (UniqueName: \"kubernetes.io/projected/b5e283a4-3f16-48a9-946c-b74f709a817d-kube-api-access-6pq9v\") pod \"b5e283a4-3f16-48a9-946c-b74f709a817d\" (UID: \"b5e283a4-3f16-48a9-946c-b74f709a817d\") "
Jul 28 14:56:11.944840 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:11.944847    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e283a4-3f16-48a9-946c-b74f709a817d-plugins-config-volume\") pod \"b5e283a4-3f16-48a9-946c-b74f709a817d\" (UID: \"b5e283a4-3f16-48a9-946c-b74f709a817d\") "
Jul 28 14:56:11.945221 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:11.945198    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e283a4-3f16-48a9-946c-b74f709a817d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5e283a4-3f16-48a9-946c-b74f709a817d" (UID: "b5e283a4-3f16-48a9-946c-b74f709a817d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:56:11.947060 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:11.947034    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e283a4-3f16-48a9-946c-b74f709a817d-kube-api-access-6pq9v" (OuterVolumeSpecName: "kube-api-access-6pq9v") pod "b5e283a4-3f16-48a9-946c-b74f709a817d" (UID: "b5e283a4-3f16-48a9-946c-b74f709a817d"). InnerVolumeSpecName "kube-api-access-6pq9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:56:12.045835 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.045804    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pq9v\" (UniqueName: \"kubernetes.io/projected/b5e283a4-3f16-48a9-946c-b74f709a817d-kube-api-access-6pq9v\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:56:12.045835 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.045832    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e283a4-3f16-48a9-946c-b74f709a817d-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:56:12.225300 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.225260    2571 generic.go:356] "Generic (PLEG): container finished" podID="b5e283a4-3f16-48a9-946c-b74f709a817d" containerID="944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75" exitCode=0
Jul 28 14:56:12.225475 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.225313    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"
Jul 28 14:56:12.225475 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.225348    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp" event={"ID":"b5e283a4-3f16-48a9-946c-b74f709a817d","Type":"ContainerDied","Data":"944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75"}
Jul 28 14:56:12.225475 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.225419    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp" event={"ID":"b5e283a4-3f16-48a9-946c-b74f709a817d","Type":"ContainerDied","Data":"102186195fe16473f25c77d625d0a52bb8eec0c3457cefe0a0214a606837c84a"}
Jul 28 14:56:12.225475 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.225441    2571 scope.go:117] "RemoveContainer" containerID="944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75"
Jul 28 14:56:12.235130 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.235108    2571 scope.go:117] "RemoveContainer" containerID="944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75"
Jul 28 14:56:12.235417 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:56:12.235400    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75\": container with ID starting with 944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75 not found: ID does not exist" containerID="944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75"
Jul 28 14:56:12.235473 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.235426    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75"} err="failed to get container status \"944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75\": rpc error: code = NotFound desc = could not find container \"944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75\": container with ID starting with 944d52ff562b8b203cfc5490c1325344dad1c8441ae3350e7a73e3904d3d9e75 not found: ID does not exist"
Jul 28 14:56:12.253084 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.253053    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"]
Jul 28 14:56:12.258303 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:12.258274    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-694dae-6657dccbf4-rsvtp"]
Jul 28 14:56:13.343631 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:56:13.343593    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5e283a4-3f16-48a9-946c-b74f709a817d" path="/var/lib/kubelet/pods/b5e283a4-3f16-48a9-946c-b74f709a817d/volumes"
Jul 28 14:57:30.550339 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:30.550301    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"]
Jul 28 14:57:30.550848 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:30.550570    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy" containerID="cri-o://1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a" gracePeriod=30
Jul 28 14:57:31.454935 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:31.454889    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 14:57:31.455105 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:31.454973    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 14:57:35.807234 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.807207    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:57:35.836194 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836105    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-socket\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836194 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836143    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-envoy\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836194 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836169    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-certs\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836470 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836253    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-data\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836470 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836280    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-podinfo\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836470 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836309    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-token\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836470 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836346    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-credential-socket\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836470 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836390    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:35.836470 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836433    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:35.836470 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836451    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr7c2\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-kube-api-access-dr7c2\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836513    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b47f1b5-8605-42d0-b8ca-36534b178881-istiod-ca-cert\") pod \"5b47f1b5-8605-42d0-b8ca-36534b178881\" (UID: \"5b47f1b5-8605-42d0-b8ca-36534b178881\") "
Jul 28 14:57:35.836829 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836775    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b47f1b5-8605-42d0-b8ca-36534b178881-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:57:35.836945 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836838    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-socket\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:35.836945 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836855    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-workload-certs\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:35.837041 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.836966    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:35.837294 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.837264    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:35.838846 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.838758    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:35.838971 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.838940    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-kube-api-access-dr7c2" (OuterVolumeSpecName: "kube-api-access-dr7c2") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "kube-api-access-dr7c2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:35.839083 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.839063    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:35.839163 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.839147    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b47f1b5-8605-42d0-b8ca-36534b178881" (UID: "5b47f1b5-8605-42d0-b8ca-36534b178881"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:57:35.938017 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.937985    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b47f1b5-8605-42d0-b8ca-36534b178881-istiod-ca-cert\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:35.938017 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.938015    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-envoy\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:35.938017 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.938024    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-data\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:35.938017 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.938032    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-podinfo\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:35.938287 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.938040    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-istio-token\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:35.938287 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.938048    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b47f1b5-8605-42d0-b8ca-36534b178881-credential-socket\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:35.938287 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:35.938057    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr7c2\" (UniqueName: \"kubernetes.io/projected/5b47f1b5-8605-42d0-b8ca-36534b178881-kube-api-access-dr7c2\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:36.627651 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.627607    2571 generic.go:356] "Generic (PLEG): container finished" podID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerID="1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a" exitCode=0
Jul 28 14:57:36.627844 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.627664    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"
Jul 28 14:57:36.627844 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.627748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" event={"ID":"5b47f1b5-8605-42d0-b8ca-36534b178881","Type":"ContainerDied","Data":"1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a"}
Jul 28 14:57:36.627844 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.627836    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl" event={"ID":"5b47f1b5-8605-42d0-b8ca-36534b178881","Type":"ContainerDied","Data":"07e984b0451a01fb3d11dd5f16f37702af97cba74b6c895e83669131abffee6b"}
Jul 28 14:57:36.628048 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.627871    2571 scope.go:117] "RemoveContainer" containerID="1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a"
Jul 28 14:57:36.637934 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.637914    2571 scope.go:117] "RemoveContainer" containerID="8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949"
Jul 28 14:57:36.646223 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.646206    2571 scope.go:117] "RemoveContainer" containerID="1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a"
Jul 28 14:57:36.646476 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:57:36.646457    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a\": container with ID starting with 1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a not found: ID does not exist" containerID="1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a"
Jul 28 14:57:36.646514 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.646485    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a"} err="failed to get container status \"1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a\": rpc error: code = NotFound desc = could not find container \"1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a\": container with ID starting with 1f7f3428edd49e4676d9bcf2f20c4c467b60713c8c0fa553e0634d656ed1174a not found: ID does not exist"
Jul 28 14:57:36.646514 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.646502    2571 scope.go:117] "RemoveContainer" containerID="8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949"
Jul 28 14:57:36.646722 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:57:36.646704    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949\": container with ID starting with 8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949 not found: ID does not exist" containerID="8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949"
Jul 28 14:57:36.646755 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.646730    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949"} err="failed to get container status \"8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949\": rpc error: code = NotFound desc = could not find container \"8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949\": container with ID starting with 8018edc92c1308a0be6cdacaeb1976f99c9bf6397f8af8338261ebee7e93a949 not found: ID does not exist"
Jul 28 14:57:36.654250 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.654224    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"]
Jul 28 14:57:36.658585 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:36.658560    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-18ece0-openshift-default-655cb766c8-4wgdl"]
Jul 28 14:57:37.343951 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:37.343907    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" path="/var/lib/kubelet/pods/5b47f1b5-8605-42d0-b8ca-36534b178881/volumes"
Jul 28 14:57:38.389110 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.389075    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"]
Jul 28 14:57:38.389544 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.389355    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j" podUID="96a39b04-25da-43e9-b8a2-8b59f8513742" containerName="payload-processing" containerID="cri-o://5c884fea27227285746b5d563417321c2a0839fb8f9c106db4964fa3018630ca" gracePeriod=30
Jul 28 14:57:38.395985 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.395951    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"]
Jul 28 14:57:38.396235 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.396207    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj" podUID="2e20fd6a-9a49-48eb-946f-5776330426ab" containerName="payload-pre-processing" containerID="cri-o://58aa854ae243f96d4cc9a6964ff2d9e1e78e8dedcecdc92de5188d7a507dda8b" gracePeriod=30
Jul 28 14:57:38.642552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.642465    2571 generic.go:356] "Generic (PLEG): container finished" podID="2e20fd6a-9a49-48eb-946f-5776330426ab" containerID="58aa854ae243f96d4cc9a6964ff2d9e1e78e8dedcecdc92de5188d7a507dda8b" exitCode=0
Jul 28 14:57:38.642552 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.642517    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj" event={"ID":"2e20fd6a-9a49-48eb-946f-5776330426ab","Type":"ContainerDied","Data":"58aa854ae243f96d4cc9a6964ff2d9e1e78e8dedcecdc92de5188d7a507dda8b"}
Jul 28 14:57:38.643930 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.643908    2571 generic.go:356] "Generic (PLEG): container finished" podID="96a39b04-25da-43e9-b8a2-8b59f8513742" containerID="5c884fea27227285746b5d563417321c2a0839fb8f9c106db4964fa3018630ca" exitCode=0
Jul 28 14:57:38.644053 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.643971    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j" event={"ID":"96a39b04-25da-43e9-b8a2-8b59f8513742","Type":"ContainerDied","Data":"5c884fea27227285746b5d563417321c2a0839fb8f9c106db4964fa3018630ca"}
Jul 28 14:57:38.644053 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.644003    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j" event={"ID":"96a39b04-25da-43e9-b8a2-8b59f8513742","Type":"ContainerDied","Data":"95ee47c7b78a0a070bd37ebca4a550a613067fc9426121a63784e52f5c1e42e2"}
Jul 28 14:57:38.644053 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.644027    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95ee47c7b78a0a070bd37ebca4a550a613067fc9426121a63784e52f5c1e42e2"
Jul 28 14:57:38.651683 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.651663    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:57:38.664425 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.664390    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96a39b04-25da-43e9-b8a2-8b59f8513742-plugins-config-volume\") pod \"96a39b04-25da-43e9-b8a2-8b59f8513742\" (UID: \"96a39b04-25da-43e9-b8a2-8b59f8513742\") "
Jul 28 14:57:38.664578 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.664441    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22ph4\" (UniqueName: \"kubernetes.io/projected/96a39b04-25da-43e9-b8a2-8b59f8513742-kube-api-access-22ph4\") pod \"96a39b04-25da-43e9-b8a2-8b59f8513742\" (UID: \"96a39b04-25da-43e9-b8a2-8b59f8513742\") "
Jul 28 14:57:38.664825 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.664801    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a39b04-25da-43e9-b8a2-8b59f8513742-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96a39b04-25da-43e9-b8a2-8b59f8513742" (UID: "96a39b04-25da-43e9-b8a2-8b59f8513742"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:57:38.666653 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.666627    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a39b04-25da-43e9-b8a2-8b59f8513742-kube-api-access-22ph4" (OuterVolumeSpecName: "kube-api-access-22ph4") pod "96a39b04-25da-43e9-b8a2-8b59f8513742" (UID: "96a39b04-25da-43e9-b8a2-8b59f8513742"). InnerVolumeSpecName "kube-api-access-22ph4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:38.685383 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.685357    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:57:38.765436 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.765400    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e20fd6a-9a49-48eb-946f-5776330426ab-plugins-config-volume\") pod \"2e20fd6a-9a49-48eb-946f-5776330426ab\" (UID: \"2e20fd6a-9a49-48eb-946f-5776330426ab\") "
Jul 28 14:57:38.765436 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.765443    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgr9g\" (UniqueName: \"kubernetes.io/projected/2e20fd6a-9a49-48eb-946f-5776330426ab-kube-api-access-sgr9g\") pod \"2e20fd6a-9a49-48eb-946f-5776330426ab\" (UID: \"2e20fd6a-9a49-48eb-946f-5776330426ab\") "
Jul 28 14:57:38.765671 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.765627    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96a39b04-25da-43e9-b8a2-8b59f8513742-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:38.765671 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.765638    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22ph4\" (UniqueName: \"kubernetes.io/projected/96a39b04-25da-43e9-b8a2-8b59f8513742-kube-api-access-22ph4\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:38.765842 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.765818    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e20fd6a-9a49-48eb-946f-5776330426ab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e20fd6a-9a49-48eb-946f-5776330426ab" (UID: "2e20fd6a-9a49-48eb-946f-5776330426ab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:57:38.767487 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.767466    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e20fd6a-9a49-48eb-946f-5776330426ab-kube-api-access-sgr9g" (OuterVolumeSpecName: "kube-api-access-sgr9g") pod "2e20fd6a-9a49-48eb-946f-5776330426ab" (UID: "2e20fd6a-9a49-48eb-946f-5776330426ab"). InnerVolumeSpecName "kube-api-access-sgr9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:38.866738 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.866701    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e20fd6a-9a49-48eb-946f-5776330426ab-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:38.866738 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:38.866730    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgr9g\" (UniqueName: \"kubernetes.io/projected/2e20fd6a-9a49-48eb-946f-5776330426ab-kube-api-access-sgr9g\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:39.649816 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:39.649762    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"
Jul 28 14:57:39.650254 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:39.649820    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj" event={"ID":"2e20fd6a-9a49-48eb-946f-5776330426ab","Type":"ContainerDied","Data":"4b69609c4ca535348fdfe3717c337bd9f0244c796ade631b1a0d5c2314df6f1e"}
Jul 28 14:57:39.650254 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:39.649881    2571 scope.go:117] "RemoveContainer" containerID="58aa854ae243f96d4cc9a6964ff2d9e1e78e8dedcecdc92de5188d7a507dda8b"
Jul 28 14:57:39.650254 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:39.649994    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"
Jul 28 14:57:39.668755 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:39.668724    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"]
Jul 28 14:57:39.676937 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:39.676914    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fd71df-fd7cf44-vvr8j"]
Jul 28 14:57:39.689959 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:39.689931    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"]
Jul 28 14:57:39.692776 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:39.692752    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fd71df-7d96966548-v2qgj"]
Jul 28 14:57:41.348832 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:41.348797    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e20fd6a-9a49-48eb-946f-5776330426ab" path="/var/lib/kubelet/pods/2e20fd6a-9a49-48eb-946f-5776330426ab/volumes"
Jul 28 14:57:41.349272 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:41.349148    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96a39b04-25da-43e9-b8a2-8b59f8513742" path="/var/lib/kubelet/pods/96a39b04-25da-43e9-b8a2-8b59f8513742/volumes"
Jul 28 14:57:52.558420 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.558377    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"]
Jul 28 14:57:52.558999 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.558673    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4" podUID="b3d95b82-7ca8-4c62-837c-f61004350928" containerName="maas-api" containerID="cri-o://8698e67a470cdcf2bc3ffb853315d1d2521cc912c2d67024fabd03875a6f5f87" gracePeriod=30
Jul 28 14:57:52.713597 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.713559    2571 generic.go:356] "Generic (PLEG): container finished" podID="b3d95b82-7ca8-4c62-837c-f61004350928" containerID="8698e67a470cdcf2bc3ffb853315d1d2521cc912c2d67024fabd03875a6f5f87" exitCode=0
Jul 28 14:57:52.713757 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.713629    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4" event={"ID":"b3d95b82-7ca8-4c62-837c-f61004350928","Type":"ContainerDied","Data":"8698e67a470cdcf2bc3ffb853315d1d2521cc912c2d67024fabd03875a6f5f87"}
Jul 28 14:57:52.821778 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.821701    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:57:52.894266 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.894233    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls\") pod \"b3d95b82-7ca8-4c62-837c-f61004350928\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") "
Jul 28 14:57:52.894440 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.894318    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmgvm\" (UniqueName: \"kubernetes.io/projected/b3d95b82-7ca8-4c62-837c-f61004350928-kube-api-access-fmgvm\") pod \"b3d95b82-7ca8-4c62-837c-f61004350928\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") "
Jul 28 14:57:52.894440 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.894337    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d95b82-7ca8-4c62-837c-f61004350928-openshift-service-ca\") pod \"b3d95b82-7ca8-4c62-837c-f61004350928\" (UID: \"b3d95b82-7ca8-4c62-837c-f61004350928\") "
Jul 28 14:57:52.894815 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.894763    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d95b82-7ca8-4c62-837c-f61004350928-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3d95b82-7ca8-4c62-837c-f61004350928" (UID: "b3d95b82-7ca8-4c62-837c-f61004350928"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:57:52.896484 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.896449    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3d95b82-7ca8-4c62-837c-f61004350928" (UID: "b3d95b82-7ca8-4c62-837c-f61004350928"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:57:52.896584 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.896506    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d95b82-7ca8-4c62-837c-f61004350928-kube-api-access-fmgvm" (OuterVolumeSpecName: "kube-api-access-fmgvm") pod "b3d95b82-7ca8-4c62-837c-f61004350928" (UID: "b3d95b82-7ca8-4c62-837c-f61004350928"). InnerVolumeSpecName "kube-api-access-fmgvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:52.995403 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.995363    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmgvm\" (UniqueName: \"kubernetes.io/projected/b3d95b82-7ca8-4c62-837c-f61004350928-kube-api-access-fmgvm\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:52.995403 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.995398    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d95b82-7ca8-4c62-837c-f61004350928-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:52.995403 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:52.995412    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d95b82-7ca8-4c62-837c-f61004350928-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:57:53.719901 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:53.719867    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4" event={"ID":"b3d95b82-7ca8-4c62-837c-f61004350928","Type":"ContainerDied","Data":"64cffad794724e09db3a5f85cc3469f6a49ce91fb62f4d93598998c92e6c6ada"}
Jul 28 14:57:53.720374 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:53.719930    2571 scope.go:117] "RemoveContainer" containerID="8698e67a470cdcf2bc3ffb853315d1d2521cc912c2d67024fabd03875a6f5f87"
Jul 28 14:57:53.720374 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:53.719873    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"
Jul 28 14:57:53.740800 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:53.740752    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"]
Jul 28 14:57:53.743352 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:53.743329    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-910fb6-6bc6855d76-vzgq4"]
Jul 28 14:57:55.343700 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:57:55.343663    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3d95b82-7ca8-4c62-837c-f61004350928" path="/var/lib/kubelet/pods/b3d95b82-7ca8-4c62-837c-f61004350928/volumes"
Jul 28 14:58:06.618517 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:06.618475    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"]
Jul 28 14:58:06.619057 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:06.618724    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm" podUID="c5998d53-8ad1-4e99-af78-9d3de3fa4f49" containerName="maas-api" containerID="cri-o://9c4c0cc25c5882e53c2be8757a0bd28feb086c31b913c6ec85d37bb1bb38ae3c" gracePeriod=30
Jul 28 14:58:06.718595 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:06.718544    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"]
Jul 28 14:58:06.718889 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:06.718836    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz" podUID="74bb643e-3c42-496e-aafc-6d2e864c16f2" containerName="payload-processing" containerID="cri-o://daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b" gracePeriod=30
Jul 28 14:58:06.783396 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:06.783358    2571 generic.go:356] "Generic (PLEG): container finished" podID="c5998d53-8ad1-4e99-af78-9d3de3fa4f49" containerID="9c4c0cc25c5882e53c2be8757a0bd28feb086c31b913c6ec85d37bb1bb38ae3c" exitCode=0
Jul 28 14:58:06.783570 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:06.783427    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm" event={"ID":"c5998d53-8ad1-4e99-af78-9d3de3fa4f49","Type":"ContainerDied","Data":"9c4c0cc25c5882e53c2be8757a0bd28feb086c31b913c6ec85d37bb1bb38ae3c"}
Jul 28 14:58:06.889273 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:06.889248    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:58:06.989607 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:06.989585    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:58:07.023348 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.023310    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghl79\" (UniqueName: \"kubernetes.io/projected/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-kube-api-access-ghl79\") pod \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") "
Jul 28 14:58:07.023530 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.023353    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-maas-api-tls\") pod \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") "
Jul 28 14:58:07.023530 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.023487    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-openshift-service-ca\") pod \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\" (UID: \"c5998d53-8ad1-4e99-af78-9d3de3fa4f49\") "
Jul 28 14:58:07.023845 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.023815    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5998d53-8ad1-4e99-af78-9d3de3fa4f49" (UID: "c5998d53-8ad1-4e99-af78-9d3de3fa4f49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:58:07.025592 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.025566    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5998d53-8ad1-4e99-af78-9d3de3fa4f49" (UID: "c5998d53-8ad1-4e99-af78-9d3de3fa4f49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:58:07.025716 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.025589    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-kube-api-access-ghl79" (OuterVolumeSpecName: "kube-api-access-ghl79") pod "c5998d53-8ad1-4e99-af78-9d3de3fa4f49" (UID: "c5998d53-8ad1-4e99-af78-9d3de3fa4f49"). InnerVolumeSpecName "kube-api-access-ghl79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:58:07.124473 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.124389    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stfsl\" (UniqueName: \"kubernetes.io/projected/74bb643e-3c42-496e-aafc-6d2e864c16f2-kube-api-access-stfsl\") pod \"74bb643e-3c42-496e-aafc-6d2e864c16f2\" (UID: \"74bb643e-3c42-496e-aafc-6d2e864c16f2\") "
Jul 28 14:58:07.124624 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.124510    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bb643e-3c42-496e-aafc-6d2e864c16f2-plugins-config-volume\") pod \"74bb643e-3c42-496e-aafc-6d2e864c16f2\" (UID: \"74bb643e-3c42-496e-aafc-6d2e864c16f2\") "
Jul 28 14:58:07.124664 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.124656    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-openshift-service-ca\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:58:07.124701 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.124668    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghl79\" (UniqueName: \"kubernetes.io/projected/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-kube-api-access-ghl79\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:58:07.124701 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.124682    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5998d53-8ad1-4e99-af78-9d3de3fa4f49-maas-api-tls\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:58:07.124950 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.124919    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74bb643e-3c42-496e-aafc-6d2e864c16f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "74bb643e-3c42-496e-aafc-6d2e864c16f2" (UID: "74bb643e-3c42-496e-aafc-6d2e864c16f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:58:07.126535 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.126515    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74bb643e-3c42-496e-aafc-6d2e864c16f2-kube-api-access-stfsl" (OuterVolumeSpecName: "kube-api-access-stfsl") pod "74bb643e-3c42-496e-aafc-6d2e864c16f2" (UID: "74bb643e-3c42-496e-aafc-6d2e864c16f2"). InnerVolumeSpecName "kube-api-access-stfsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:58:07.225701 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.225663    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74bb643e-3c42-496e-aafc-6d2e864c16f2-plugins-config-volume\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:58:07.225701 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.225688    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stfsl\" (UniqueName: \"kubernetes.io/projected/74bb643e-3c42-496e-aafc-6d2e864c16f2-kube-api-access-stfsl\") on node \"ip-10-0-137-91.ec2.internal\" DevicePath \"\""
Jul 28 14:58:07.789611 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.789576    2571 generic.go:356] "Generic (PLEG): container finished" podID="74bb643e-3c42-496e-aafc-6d2e864c16f2" containerID="daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b" exitCode=0
Jul 28 14:58:07.790055 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.789623    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"
Jul 28 14:58:07.790055 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.789668    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz" event={"ID":"74bb643e-3c42-496e-aafc-6d2e864c16f2","Type":"ContainerDied","Data":"daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b"}
Jul 28 14:58:07.790055 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.789735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz" event={"ID":"74bb643e-3c42-496e-aafc-6d2e864c16f2","Type":"ContainerDied","Data":"cda4d8f37f1c949abb6daba71c4f2666655fd63c8b3e83f22443079011c46fd4"}
Jul 28 14:58:07.790055 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.789770    2571 scope.go:117] "RemoveContainer" containerID="daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b"
Jul 28 14:58:07.791296 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.791247    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"
Jul 28 14:58:07.791296 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.791259    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm" event={"ID":"c5998d53-8ad1-4e99-af78-9d3de3fa4f49","Type":"ContainerDied","Data":"2e72469c4c2d2dd5d4aacebdc3f88fc8679fb7a057b8a21091918fcb9572f2ac"}
Jul 28 14:58:07.800027 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.799998    2571 scope.go:117] "RemoveContainer" containerID="daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b"
Jul 28 14:58:07.800493 ip-10-0-137-91 kubenswrapper[2571]: E0728 14:58:07.800465    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b\": container with ID starting with daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b not found: ID does not exist" containerID="daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b"
Jul 28 14:58:07.800611 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.800503    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b"} err="failed to get container status \"daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b\": rpc error: code = NotFound desc = could not find container \"daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b\": container with ID starting with daf9f8f44cda2a5069dc3ae7636ad97c1f4889c1143577ee448ebcefe66d403b not found: ID does not exist"
Jul 28 14:58:07.800611 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.800529    2571 scope.go:117] "RemoveContainer" containerID="9c4c0cc25c5882e53c2be8757a0bd28feb086c31b913c6ec85d37bb1bb38ae3c"
Jul 28 14:58:07.811668 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.811646    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"]
Jul 28 14:58:07.816727 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.816706    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-baa216-76b4556974-7bnqm"]
Jul 28 14:58:07.830039 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.830011    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"]
Jul 28 14:58:07.834464 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:07.834439    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-baa216-574f8c586b-7g7fz"]
Jul 28 14:58:09.342548 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:09.342516    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74bb643e-3c42-496e-aafc-6d2e864c16f2" path="/var/lib/kubelet/pods/74bb643e-3c42-496e-aafc-6d2e864c16f2/volumes"
Jul 28 14:58:09.342967 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:09.342915    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5998d53-8ad1-4e99-af78-9d3de3fa4f49" path="/var/lib/kubelet/pods/c5998d53-8ad1-4e99-af78-9d3de3fa4f49/volumes"
Jul 28 14:58:20.575534 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:20.575454    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-x2bfd_75766632-1611-4c34-bfa4-f069566c8237/manager/0.log"
Jul 28 14:58:20.812566 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:20.812535    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f8dcf4b8-9d8wh_db98da70-2906-426e-8865-054171e73bf3/manager/0.log"
Jul 28 14:58:21.181211 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:21.181181    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b59958787-lz997_28850903-0c7c-4081-86dc-52a3c2ce3665/copy-manifests/0.log"
Jul 28 14:58:21.190309 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:21.190282    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b59958787-lz997_28850903-0c7c-4081-86dc-52a3c2ce3665/manager/0.log"
Jul 28 14:58:21.810736 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:21.810706    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-575598fc6-797pn_29abf9d6-224c-40c2-a29b-275657b62687/maas-api/0.log"
Jul 28 14:58:22.256956 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:22.256924    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zhw7k_aee8e1a1-d015-44b7-bb20-eb0b2d60aee6/postgres/0.log"
Jul 28 14:58:23.718077 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:23.718040    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bp7wl_8ac63aec-198d-4faf-92d9-dc1923e627bd/manager/0.log"
Jul 28 14:58:24.948911 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:24.948878    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xlpwg_d45895ba-b667-498b-b39b-cceb40e24e6e/discovery/0.log"
Jul 28 14:58:25.181044 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:25.181012    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-97487846c-g8zs9_2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20/kube-auth-proxy/0.log"
Jul 28 14:58:25.302411 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:25.302321    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-jskvr_a87eb071-4877-4f83-8ada-045ed9de5d33/istio-proxy/1.log"
Jul 28 14:58:25.422519 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:25.422493    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7vnzs_471c6804-46bf-42e4-a823-7f56ecdada52/payload-pre-processing/0.log"
Jul 28 14:58:25.541771 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:25.541732    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-s9nv8_4e48844b-ea34-4c14-aecf-d84c67656c69/payload-processing/0.log"
Jul 28 14:58:26.143950 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:26.143917    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jvmjd_88201f44-3009-4bde-84de-0b05dbb412ae/main/0.log"
Jul 28 14:58:26.376065 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:26.376026    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2wxgm_908f7141-1b21-4885-b80f-18828d5fa922/main/0.log"
Jul 28 14:58:26.493408 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:26.493380    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6cflh_20dddab8-589a-4433-925d-f10efb806a6f/main/0.log"
Jul 28 14:58:26.601506 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:26.601475    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-hcwwg_d251c37a-2a77-4cee-bfe4-690d648c8e33/main/0.log"
Jul 28 14:58:35.433290 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:35.433260    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2hw88_2705a3f5-fe74-472f-8de8-f7df5f91210a/global-pull-secret-syncer/0.log"
Jul 28 14:58:35.654593 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:35.654561    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pw9sn_84ddd743-7271-4c70-a157-605034c9df6a/konnectivity-agent/0.log"
Jul 28 14:58:35.679970 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:35.679944    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-91.ec2.internal_e8c5819ec42f2283f44c768b3a7b9474/haproxy/0.log"
Jul 28 14:58:40.758622 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:40.758590    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bp7wl_8ac63aec-198d-4faf-92d9-dc1923e627bd/manager/0.log"
Jul 28 14:58:43.423424 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:43.423395    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dqkl9_b4297804-de86-4c7b-adfc-e4964186ede8/node-exporter/0.log"
Jul 28 14:58:43.446721 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:43.446693    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dqkl9_b4297804-de86-4c7b-adfc-e4964186ede8/kube-rbac-proxy/0.log"
Jul 28 14:58:43.471064 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:43.471038    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dqkl9_b4297804-de86-4c7b-adfc-e4964186ede8/init-textfile/0.log"
Jul 28 14:58:45.479832 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.479792    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"]
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480185    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e283a4-3f16-48a9-946c-b74f709a817d" containerName="payload-processing"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480203    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e283a4-3f16-48a9-946c-b74f709a817d" containerName="payload-processing"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480219    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74bb643e-3c42-496e-aafc-6d2e864c16f2" containerName="payload-processing"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480225    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="74bb643e-3c42-496e-aafc-6d2e864c16f2" containerName="payload-processing"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480234    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d95b82-7ca8-4c62-837c-f61004350928" containerName="maas-api"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480239    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d95b82-7ca8-4c62-837c-f61004350928" containerName="maas-api"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480248    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5998d53-8ad1-4e99-af78-9d3de3fa4f49" containerName="maas-api"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480256    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5998d53-8ad1-4e99-af78-9d3de3fa4f49" containerName="maas-api"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480269    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e20fd6a-9a49-48eb-946f-5776330426ab" containerName="payload-pre-processing"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480275    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e20fd6a-9a49-48eb-946f-5776330426ab" containerName="payload-pre-processing"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480284    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480289    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480300    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy"
Jul 28 14:58:45.480299 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480307    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480318    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a39b04-25da-43e9-b8a2-8b59f8513742" containerName="payload-processing"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480324    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a39b04-25da-43e9-b8a2-8b59f8513742" containerName="payload-processing"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480386    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a39b04-25da-43e9-b8a2-8b59f8513742" containerName="payload-processing"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480395    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5998d53-8ad1-4e99-af78-9d3de3fa4f49" containerName="maas-api"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480400    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480406    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="74bb643e-3c42-496e-aafc-6d2e864c16f2" containerName="payload-processing"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480411    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b47f1b5-8605-42d0-b8ca-36534b178881" containerName="istio-proxy"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480419    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d95b82-7ca8-4c62-837c-f61004350928" containerName="maas-api"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480424    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e20fd6a-9a49-48eb-946f-5776330426ab" containerName="payload-pre-processing"
Jul 28 14:58:45.480767 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.480430    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e283a4-3f16-48a9-946c-b74f709a817d" containerName="payload-processing"
Jul 28 14:58:45.483391 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.483374    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.486033 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.486009    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh668\"/\"openshift-service-ca.crt\""
Jul 28 14:58:45.487079 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.487061    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qh668\"/\"default-dockercfg-gjnsx\""
Jul 28 14:58:45.487141 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.487069    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh668\"/\"kube-root-ca.crt\""
Jul 28 14:58:45.495034 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.495009    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"]
Jul 28 14:58:45.539096 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.539059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-lib-modules\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.539096 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.539094    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-proc\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.539367 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.539122    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-sys\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.539367 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.539246    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-podres\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.539367 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.539295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75l85\" (UniqueName: \"kubernetes.io/projected/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-kube-api-access-75l85\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640593 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-lib-modules\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640593 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640593    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-proc\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640828 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640674    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-proc\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640828 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640715    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-sys\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640828 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640741    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-lib-modules\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640828 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640771    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-podres\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640828 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640823    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75l85\" (UniqueName: \"kubernetes.io/projected/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-kube-api-access-75l85\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640992 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-sys\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.640992 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.640949    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-podres\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.650004 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.649980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75l85\" (UniqueName: \"kubernetes.io/projected/fb1cae66-e535-4961-9c7d-aa7ee9a359c3-kube-api-access-75l85\") pod \"perf-node-gather-daemonset-ljg4v\" (UID: \"fb1cae66-e535-4961-9c7d-aa7ee9a359c3\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.793140 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.793042    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:45.923619 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.923590    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"]
Jul 28 14:58:45.926201 ip-10-0-137-91 kubenswrapper[2571]: W0728 14:58:45.926175    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfb1cae66_e535_4961_9c7d_aa7ee9a359c3.slice/crio-9f19ed0a336cfb3291689d3a6487fe98714ab23126fe8b5c9437958eebcbc51a WatchSource:0}: Error finding container 9f19ed0a336cfb3291689d3a6487fe98714ab23126fe8b5c9437958eebcbc51a: Status 404 returned error can't find the container with id 9f19ed0a336cfb3291689d3a6487fe98714ab23126fe8b5c9437958eebcbc51a
Jul 28 14:58:45.967817 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:45.967766    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v" event={"ID":"fb1cae66-e535-4961-9c7d-aa7ee9a359c3","Type":"ContainerStarted","Data":"9f19ed0a336cfb3291689d3a6487fe98714ab23126fe8b5c9437958eebcbc51a"}
Jul 28 14:58:46.973998 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:46.973956    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v" event={"ID":"fb1cae66-e535-4961-9c7d-aa7ee9a359c3","Type":"ContainerStarted","Data":"75e867bee97e11b011f7c5650a2cd62221a2523d898c9c7c476fd896718f705f"}
Jul 28 14:58:46.974402 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:46.974086    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:46.993057 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:46.993010    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v" podStartSLOduration=1.9929950189999999 podStartE2EDuration="1.992995019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:58:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:58:46.992496064 +0000 UTC m=+3536.211298108" watchObservedRunningTime="2026-07-28 14:58:46.992995019 +0000 UTC m=+3536.211797065"
Jul 28 14:58:48.479875 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:48.479846    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vq28l_fcd66c8a-67e3-4c18-bdb0-dd275f91b520/dns/0.log"
Jul 28 14:58:48.511257 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:48.511228    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vq28l_fcd66c8a-67e3-4c18-bdb0-dd275f91b520/kube-rbac-proxy/0.log"
Jul 28 14:58:48.573708 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:48.573678    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mhhcq_c6d067b4-0a52-45ee-b70d-f56724815e25/dns-node-resolver/0.log"
Jul 28 14:58:49.288318 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:49.288294    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s24zx_cf5e24b2-e61d-4833-ad54-2b257498a0a5/node-ca/0.log"
Jul 28 14:58:50.450042 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:50.450013    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xlpwg_d45895ba-b667-498b-b39b-cceb40e24e6e/discovery/0.log"
Jul 28 14:58:50.507945 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:50.507918    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-97487846c-g8zs9_2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20/kube-auth-proxy/0.log"
Jul 28 14:58:50.543421 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:50.543391    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-jskvr_a87eb071-4877-4f83-8ada-045ed9de5d33/istio-proxy/0.log"
Jul 28 14:58:50.573416 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:50.573380    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-jskvr_a87eb071-4877-4f83-8ada-045ed9de5d33/istio-proxy/1.log"
Jul 28 14:58:50.610845 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:50.610809    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7vnzs_471c6804-46bf-42e4-a823-7f56ecdada52/payload-pre-processing/0.log"
Jul 28 14:58:50.645670 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:50.645638    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-s9nv8_4e48844b-ea34-4c14-aecf-d84c67656c69/payload-processing/0.log"
Jul 28 14:58:51.576109 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:51.576066    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z9v4z_9b6a3082-d979-4da5-8c24-5ecf223b6086/serve-healthcheck-canary/0.log"
Jul 28 14:58:52.261096 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:52.261063    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhv46_dda79aa5-6b8f-4e91-99b5-b88e7560bdb5/kube-rbac-proxy/0.log"
Jul 28 14:58:52.284476 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:52.284453    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhv46_dda79aa5-6b8f-4e91-99b5-b88e7560bdb5/exporter/0.log"
Jul 28 14:58:52.308769 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:52.308743    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhv46_dda79aa5-6b8f-4e91-99b5-b88e7560bdb5/extractor/0.log"
Jul 28 14:58:52.988869 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:52.988842    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-ljg4v"
Jul 28 14:58:54.574131 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:54.574106    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-x2bfd_75766632-1611-4c34-bfa4-f069566c8237/manager/0.log"
Jul 28 14:58:54.995082 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:54.995049    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f8dcf4b8-9d8wh_db98da70-2906-426e-8865-054171e73bf3/manager/0.log"
Jul 28 14:58:55.197085 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:55.197059    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b59958787-lz997_28850903-0c7c-4081-86dc-52a3c2ce3665/manager/0.log"
Jul 28 14:58:55.256181 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:55.256150    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b59958787-lz997_28850903-0c7c-4081-86dc-52a3c2ce3665/copy-manifests/0.log"
Jul 28 14:58:56.120154 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:56.120074    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xlpwg_d45895ba-b667-498b-b39b-cceb40e24e6e/discovery/0.log"
Jul 28 14:58:56.150488 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:56.150459    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-97487846c-g8zs9_2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20/kube-auth-proxy/0.log"
Jul 28 14:58:56.171619 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:56.171588    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-jskvr_a87eb071-4877-4f83-8ada-045ed9de5d33/istio-proxy/0.log"
Jul 28 14:58:56.199445 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:56.199413    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-jskvr_a87eb071-4877-4f83-8ada-045ed9de5d33/istio-proxy/1.log"
Jul 28 14:58:56.223180 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:56.223148    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7vnzs_471c6804-46bf-42e4-a823-7f56ecdada52/payload-pre-processing/0.log"
Jul 28 14:58:56.244117 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:56.244072    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-s9nv8_4e48844b-ea34-4c14-aecf-d84c67656c69/payload-processing/0.log"
Jul 28 14:58:56.755489 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:56.755414    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cb5zc_ea03b04a-2178-4175-a860-2fec9965c985/openshift-lws-operator/0.log"
Jul 28 14:58:57.855217 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:57.855184    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xlpwg_d45895ba-b667-498b-b39b-cceb40e24e6e/discovery/0.log"
Jul 28 14:58:57.890770 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:57.890736    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-97487846c-g8zs9_2e6a00ab-d2ae-4fa7-ac91-8eec04a1cc20/kube-auth-proxy/0.log"
Jul 28 14:58:57.919170 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:57.919142    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-jskvr_a87eb071-4877-4f83-8ada-045ed9de5d33/istio-proxy/0.log"
Jul 28 14:58:57.946680 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:57.946647    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-jskvr_a87eb071-4877-4f83-8ada-045ed9de5d33/istio-proxy/1.log"
Jul 28 14:58:57.970645 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:57.970617    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-7vnzs_471c6804-46bf-42e4-a823-7f56ecdada52/payload-pre-processing/0.log"
Jul 28 14:58:57.992113 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:58:57.992088    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-s9nv8_4e48844b-ea34-4c14-aecf-d84c67656c69/payload-processing/0.log"
Jul 28 14:59:01.824383 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:59:01.824350    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9sng6_da46c89a-a3ab-4549-bc82-3e07d3592c46/migrator/0.log"
Jul 28 14:59:01.847205 ip-10-0-137-91 kubenswrapper[2571]: I0728 14:59:01.847181    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9sng6_da46c89a-a3ab-4549-bc82-3e07d3592c46/graceful-termination/0.log"